-- Logs begin at Fri 2022-09-02 08:41:20 UTC, end at Fri 2022-09-02 10:30:29 UTC. -- Sep 02 09:23:54.832684 dv-cinder-850831-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 09:23:54.842141 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 09:23:54.844150 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 09:23:54 2022] *** Sep 02 09:23:54.844150 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 09:23:54.844150 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 09:23:54.844150 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: nodename: dv-cinder-850831-3-iscsi Sep 02 09:23:54.844150 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: machine: x86_64 Sep 02 09:23:54.844150 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: clock source: unix Sep 02 09:23:54.844150 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: pcre jit disabled Sep 02 09:23:54.844150 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: detected number of CPU cores: 4 Sep 02 09:23:54.844150 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: current working directory: / Sep 02 09:23:54.844150 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: detected binary path: /usr/bin/uwsgi-core Sep 02 09:23:54.844751 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: your processes number limit is 47680 Sep 02 09:23:54.844751 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: your memory page size is 4096 bytes Sep 02 09:23:54.844751 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: detected max file descriptor number: 2048 Sep 02 09:23:54.844751 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: lock engine: pthread robust mutexes Sep 02 09:23:54.844751 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: thunder lock: enabled Sep 02 09:23:54.844751 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 09:23:54.844751 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 09:23:54.882448 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: Python main interpreter initialized at 0x558114c0e9c0 Sep 02 09:23:54.882448 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: python threads support enabled Sep 02 09:23:54.882448 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: your server socket listen backlog is limited to 100 connections Sep 02 09:23:54.882448 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: your mercy for graceful operations on workers is 90 seconds Sep 02 09:23:54.882865 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 09:23:54.882944 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: *** Operational MODE: preforking *** Sep 02 09:23:54.883147 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: *** uWSGI is running in multiple interpreter mode *** Sep 02 09:23:54.883147 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: spawned uWSGI master process (pid: 105864) Sep 02 09:23:54.883347 dv-cinder-850831-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 09:23:54.885053 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: spawned uWSGI worker 1 (pid: 105865, cores: 1) Sep 02 09:23:54.885053 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: spawned uWSGI worker 2 (pid: 105866, cores: 1) Sep 02 09:23:54.885053 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 09:23:55.544116 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 09:23:55.561981 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 09:23:56.627384 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:23:56.627384 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: from cryptography.utils import int_from_bytes Sep 02 09:23:56.627984 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:23:56.627984 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: from cryptography.utils import int_from_bytes Sep 02 09:23:56.630724 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:23:56.630724 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: from cryptography.utils import int_from_bytes Sep 02 09:23:56.631165 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:23:56.631165 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: from cryptography.utils import int_from_bytes Sep 02 09:23:59.095432 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 09:23:59.095958 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 09:23:59.096128 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 09:23:59.096491 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 09:23:59.096714 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 09:23:59.097065 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 09:23:59.097149 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 09:23:59.097225 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.097443 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.097538 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 09:23:59.097766 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.097869 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 09:23:59.098087 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 09:23:59.098201 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.098414 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.098505 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.098758 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.098864 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.099086 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.099175 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.099406 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.099499 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.099736 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.099829 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.099997 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.100087 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.100316 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.100400 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.100643 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850831-3-iscsi {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.100739 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.100966 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.101050 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.101246 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.101376 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.101566 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.101663 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.101881 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.101969 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850831-3-iscsi {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.102187 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.102276 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.102502 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.102597 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.102842 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.102929 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.103167 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.103338 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.103479 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.104293 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.104450 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.104608 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.104701 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.104931 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.105111 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.105265 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.105430 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.105578 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.105741 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.105891 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.106058 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.106213 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.106400 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.106523 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.106724 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.106879 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.107124 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.107333 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.107534 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.107750 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850831-3-iscsi {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.107964 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.108185 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.108390 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.108585 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.108799 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.108996 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.109194 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850831-3-iscsi {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.109396 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.109605 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.109816 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.109985 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.110230 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.110410 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.110577 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.110778 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.110931 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.111068 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.111245 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.111393 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.111544 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.111690 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.111835 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.112010 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.112147 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.112296 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.112442 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.112588 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.112724 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.112859 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.113003 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.113139 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.113304 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.113451 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.113594 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.113742 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.113966 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.114112 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.114260 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.114403 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.114550 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.114695 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.114898 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.115035 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.115178 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.115321 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.115465 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.115602 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.115749 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.115925 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.116100 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.116100 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.116382 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.116536 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.116674 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.116810 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.116954 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.116954 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.117232 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.117369 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.117508 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.117651 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.117794 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.117953 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.118100 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.118236 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.118378 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.118520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.118657 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.118816 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.118965 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.119101 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.119247 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.119392 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.120146 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.120309 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.120446 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.120581 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.120719 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.120862 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.121007 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.121154 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.121291 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.121427 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.121562 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.121715 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.121868 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.122013 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.122165 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.122308 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.122444 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.122615 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.122781 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.122937 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.123074 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.123209 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.123343 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.123490 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.123634 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.123771 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.123911 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.124064 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.124202 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.124337 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.124485 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.124626 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.124762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.124904 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.125047 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.125182 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.125326 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.125468 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.125604 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.125739 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.125887 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.126030 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.126181 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.126329 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.126475 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.126616 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.126769 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.126922 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.127059 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.127194 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.127329 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.127464 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.127616 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.127765 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.127901 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.128037 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.128179 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.128322 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.128465 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.128614 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.128761 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.128897 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.129032 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.129167 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.129302 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.129466 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.129607 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.129742 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.129884 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.130029 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.130167 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.130310 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.130446 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.130581 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.130778 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.130924 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.131072 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.131216 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.131363 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.131499 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.131634 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.131782 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.131931 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.132076 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.132221 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.132364 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.132507 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.132643 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.132792 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.132940 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.133076 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.133231 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.133379 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.133514 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.133649 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.133797 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.133941 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.134077 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.134224 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.134362 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.134510 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.134654 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.134817 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.134964 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.135110 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.135245 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.135390 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.135526 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.135671 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.135807 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.135941 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.136076 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.136224 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.136362 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.136497 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.136639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.136776 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.136920 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.137065 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.137201 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.137336 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.137481 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.137618 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.137760 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.137897 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.138040 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.138175 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.138498 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.138651 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.138875 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.139014 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.139150 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.139294 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.139431 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.139578 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.139794 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.139933 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.140067 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.140203 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.140338 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.140480 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.140626 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.140772 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.140909 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.141044 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.141179 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.141323 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.141470 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:23:59.141609 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.141751 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.141895 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.142032 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.142180 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.142317 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.142488 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.142642 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.142830 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.142973 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.143147 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.143291 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.143474 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.143619 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.143790 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.143942 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.144106 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.144249 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.144418 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.144571 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.144740 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.144892 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.145061 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.145203 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.145391 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.145549 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.145711 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.145856 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.146033 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.146178 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.146506 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.146859 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.147186 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.147511 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.147830 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.148157 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.148491 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.148821 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.149137 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.149483 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.149832 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.150150 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.150480 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.150857 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.151179 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.151497 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.151652 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.151813 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.151956 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.152163 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.152306 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.152465 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.152654 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.152798 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.153002 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.153147 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.153341 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.153513 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.153709 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.153851 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.154028 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.154172 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.154346 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.154663 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.154863 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.155001 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.155201 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.155350 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.155535 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.155679 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.155881 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.156024 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.156222 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.156366 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.156560 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.156703 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.156926 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.157070 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.157412 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.157590 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.157732 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.157910 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.158062 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.158228 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.158379 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.158523 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.158659 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.158875 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.159019 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.159187 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.159341 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.159505 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.159655 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.159799 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.159936 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.160123 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.160276 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.160454 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.160605 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.160766 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.160908 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.161096 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.161248 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.161386 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.161521 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.161705 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.161848 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.162024 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.162175 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.162341 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.162484 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.162652 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.162849 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.162998 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.163141 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.163542 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.163682 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.163853 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.163995 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.164167 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.164327 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.164721 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.164865 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.165007 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.165150 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.165150 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.165429 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.165429 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.165688 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.165832 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.166041 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.166179 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.166821 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.166821 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.167098 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.167235 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.167386 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.167523 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.167658 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.167808 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.167953 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.168096 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.168241 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.168378 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.168519 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.168669 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.168812 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.168957 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.169092 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.169258 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.169409 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.169578 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.169727 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.169871 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.170009 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.170202 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.170352 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.170514 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.170666 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.170855 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.170993 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.171156 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.171306 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.171474 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.171618 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.171793 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.171936 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.172102 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.172251 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.172414 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.172569 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.172715 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.172865 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.173002 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.173140 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.173314 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.173470 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.173609 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.173745 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.173919 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.174063 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.174247 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.174399 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.174562 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.174752 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.174906 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.175044 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.175180 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.175325 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.175492 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.175634 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.175840 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.175984 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.176151 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.176294 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.176461 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.176623 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.176760 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.176896 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.177068 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.177211 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.177378 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.177522 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.177686 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.177828 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.177995 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.178139 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.178304 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.178447 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.178608 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.178781 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.178935 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.179072 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.179248 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.179398 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.179557 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.179707 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.179851 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.179994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.180157 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.180306 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.180505 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.180667 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.180804 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.180939 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.181129 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.181271 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.181457 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.181608 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.181769 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.181912 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.182640 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.182807 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.182989 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.183142 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.183295 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.183439 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.183619 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.183769 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.183944 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.184104 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.184248 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.184390 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.184563 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.184705 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.184879 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.185022 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.185193 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.185343 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.185508 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.185657 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.185802 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.185938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.186135 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.186285 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.186450 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.186591 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.186797 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.186943 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.187109 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.187250 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.187431 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.187573 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.187745 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.187895 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.188069 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.188218 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.188382 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.188530 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.188686 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.188843 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.189016 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.189164 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.189324 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.189476 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.189619 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.189761 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.189934 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.190095 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.190238 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.190388 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.190531 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.190671 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.190872 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.191026 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.191169 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.191332 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.191476 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.191618 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.191767 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.191909 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.192094 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.192277 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.192422 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.192564 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.192706 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.192855 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.193012 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.193154 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.193311 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.193452 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.193595 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.193738 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.193914 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.194064 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.194206 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.194367 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.194509 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.194651 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.194843 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.194988 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.195168 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.195325 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.195467 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.195608 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.195820 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.195976 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.196121 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.196287 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.196431 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.196585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.196728 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.196868 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.197016 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.197165 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.197318 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.197469 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.197650 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.197794 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.197936 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.198078 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.198221 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.198376 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.198527 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.198670 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.198859 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.199002 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.199170 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.199323 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.199466 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.199607 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.199748 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.199888 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.200039 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.200181 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.200330 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.200472 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.200613 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.200753 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.200904 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.201062 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.201205 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.201347 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.201530 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.201676 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.201826 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.201979 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.202122 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.202263 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.202406 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.202547 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.202721 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.202882 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.203034 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.203177 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.203318 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.203474 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.203617 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.203767 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.203908 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.204058 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.204232 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.204399 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.204544 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.204694 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.204837 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.204991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.205142 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.205293 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.205436 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.205752 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.205915 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.206058 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.206200 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.206373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.206522 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.206689 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.206881 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.207034 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.207197 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.207354 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.207513 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.207658 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.207808 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.207950 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.208091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.208233 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.208406 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.208556 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.208706 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.208849 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.209021 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.209176 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.209319 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.209469 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.209619 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.209775 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.209925 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.210218 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.210369 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.210519 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.210661 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.210835 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.210978 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.211141 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.211285 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.211452 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.211601 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.211752 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.211912 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.212056 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.212205 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.212348 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.212531 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.212679 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.212850 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.213015 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.213193 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.213350 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.213493 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.213635 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.213785 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.213936 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.214089 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.214231 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.214381 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.214530 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.214682 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.214896 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.215059 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.215210 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.215353 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.215495 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.215644 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.215794 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.215944 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.216095 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.216239 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.216380 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.216529 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.216683 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.216826 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.216978 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.217121 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.217286 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.217444 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.217588 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.217736 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.217886 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.218028 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.218178 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.218329 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.218479 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.218622 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.218793 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.218957 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.219099 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.219325 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.219470 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.219612 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.219754 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.219909 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.220052 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.220202 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.220345 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.220486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.220637 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.220790 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.220953 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.221097 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.221240 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.221383 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.221536 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.221679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.221833 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.221976 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.222117 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.222266 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.222410 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.222552 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.222782 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.222934 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.223076 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.223225 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.223368 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.223512 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.223673 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.223824 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.223974 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.224124 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.224273 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.224424 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.224567 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.224729 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.224887 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.225030 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.225171 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.225322 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.225465 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.225615 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.225757 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.225908 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.226050 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.226213 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.226356 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.226498 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.226651 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.226825 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.226968 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.227122 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.227265 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.227415 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.227564 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.227714 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.227872 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.228015 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.228156 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.228306 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.228467 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.228610 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.229266 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.229426 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.229570 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.229712 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.229864 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.230006 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.230162 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.230305 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.230448 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.230597 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.230785 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.230948 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.231104 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.231248 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.231391 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.231541 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.231698 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.231852 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.232002 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.232151 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.232294 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.232445 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.232596 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.232751 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.232905 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.233054 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.233205 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.233348 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.233498 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.233649 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.233799 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.233951 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.234099 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.234249 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.234393 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.234555 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.234726 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.234885 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.235040 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.235183 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.235334 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.235477 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.235619 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.235760 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.235902 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.236044 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.236195 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.236338 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.236587 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.236739 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.236892 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.237035 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.237186 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.237329 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.237478 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.237628 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.237769 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.237927 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.238079 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.238221 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.238371 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.238514 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.238666 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.238877 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.239030 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.239174 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.239323 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.239473 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.239616 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.239766 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.239909 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.240058 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.240209 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.240351 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.240493 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.240652 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.240802 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.240951 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.241094 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.241236 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.241378 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.241534 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.241677 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.241819 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.241962 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.242104 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.242246 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.242397 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.242559 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.242728 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.242878 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.243020 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.243173 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.243318 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.243459 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.243601 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.243743 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.243892 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.244043 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.244185 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.244327 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.245015 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.245166 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.245308 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.245470 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.245613 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.245755 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.245906 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.246057 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.246200 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.246359 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.246503 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.246645 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.246835 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.247001 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.247153 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.247296 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.247439 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.247582 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.247723 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.247865 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.248086 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.248231 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.248381 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.248524 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.248667 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.248819 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.248971 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.249114 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.249297 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.249446 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.249612 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.249762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.249917 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.250060 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.250202 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.250344 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.250533 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.250692 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.250880 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.251032 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.251176 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.251317 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.251466 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.251622 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.251766 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.251915 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.252065 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.252214 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.252357 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.252508 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.252770 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.252929 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.253072 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.253231 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.253373 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.253541 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.253733 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.253878 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.254020 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.254169 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.254319 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.254460 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.254601 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.254805 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.254964 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.255167 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.255325 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.255468 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.255618 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.255766 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.255933 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.256089 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.256242 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.256384 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.256525 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.256667 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.256850 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.256999 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.257151 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.257294 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.257443 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.257587 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.257774 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.257932 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.258083 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.258225 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.258367 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.258509 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.258675 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.258865 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.259032 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.259182 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.259324 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.259466 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.259652 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.259810 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.260070 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.260230 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.260374 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.260524 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.260699 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.260850 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.261003 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.261156 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.261322 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.261481 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.261654 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.261810 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.261975 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.262133 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.262293 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.262436 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.262661 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.262876 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.263041 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.263185 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.263336 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.263479 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.263628 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.263779 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.263931 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.264087 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.264237 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.264380 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.264523 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.264671 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.264823 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.264976 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.265119 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.265261 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.265441 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.265822 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.265974 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.266125 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.266269 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.266413 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.266556 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.266738 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.266738 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.267018 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.267172 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.267315 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.267459 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.267613 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.267757 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.267900 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.268042 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.268185 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.268335 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.268489 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.268632 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.268783 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.268936 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.269079 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.269229 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.269385 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.269530 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.269673 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.269822 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.269966 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.270124 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.270268 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.270411 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.270554 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.270697 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.270880 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.271035 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.271180 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.271322 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.271472 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.271616 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.271767 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.271922 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.272065 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.272208 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.272351 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.272533 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.272684 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.272868 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.273019 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.273185 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.273335 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.273507 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.273664 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.273810 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.273952 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.274135 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.274292 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.274435 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.274585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.274776 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.274936 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.275081 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.275231 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.275373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.275530 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.275698 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.275847 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.275990 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.276132 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.276320 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.276478 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.276622 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.276773 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.276925 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.277076 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.277227 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.277371 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.277521 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.277663 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.277813 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.277964 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.278115 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.278258 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.278400 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.278543 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.278695 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.278878 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.279034 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.279178 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.279359 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.279509 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.279673 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.279830 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.279983 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.280127 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.280276 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.280420 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.280619 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.280787 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.280931 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.281083 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.281226 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.281368 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.281511 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.281661 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.281811 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.281954 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.282097 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.282239 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.282422 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.282581 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.282791 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.282942 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.283085 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.283236 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.283378 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.283533 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.283683 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.283826 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.283974 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.284117 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.284273 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.284416 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.284578 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.284729 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.284873 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.285015 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.285169 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.285314 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.285483 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.285766 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.285916 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.286104 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.286263 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.286407 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.286548 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.286731 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.286892 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.287043 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.287233 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.287380 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.287530 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.287672 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.287814 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.287965 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.288109 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.288506 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.288654 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.288803 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.288957 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.289117 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.289268 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.289411 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.289561 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.289783 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.289932 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.290117 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.290276 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.290459 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.290616 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.290810 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.290985 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.291129 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.291775 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.291957 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.292113 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.292281 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.292439 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.292608 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.292764 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.292919 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.293062 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.293265 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.293421 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.293577 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.293729 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.293879 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.294030 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.294185 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.294328 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.294479 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.294623 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.294855 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.294999 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.295256 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.295417 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.295560 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.295702 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.295845 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.295997 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.296140 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.296282 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.296445 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.296589 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.296734 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.296891 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.297034 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.297187 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.297337 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.297481 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.297632 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.297782 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.297934 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.298078 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.298219 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.298362 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.298517 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.298660 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.298837 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.299034 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.299133 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.299363 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.299467 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.299710 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.299819 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.300022 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.300120 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.300339 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.300439 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.300666 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.300755 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.300990 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.301079 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.301317 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.301421 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.301628 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.301716 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.301943 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.302031 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.302260 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.302358 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.302582 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.302805 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.302912 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.303127 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.303226 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.303464 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.303552 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.303791 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.303880 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.304125 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.304235 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.304443 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.304532 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.304763 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.304978 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.305079 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.305329 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.305417 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.305654 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.305742 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.305977 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.306074 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.306290 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.306378 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.306598 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.306686 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.306987 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.307586 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.307788 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.307876 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.308097 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.308185 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.308407 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.308495 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.308720 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.308816 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.309035 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.309254 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.309352 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.309600 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.309689 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.309919 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.310014 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.310247 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.310348 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.310555 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.310642 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.310898 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.310989 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.311207 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.311349 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.311533 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.311621 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.311841 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.311928 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.312149 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.312238 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.312457 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.312543 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.312769 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.312873 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.313078 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.313166 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.313381 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.313467 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.313687 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.313782 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.313997 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.314094 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.314302 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.314396 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.314611 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.314698 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.314944 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.315033 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.315250 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.315344 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.315567 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.315665 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.315872 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.315967 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.316179 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.316268 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.316493 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.316592 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.316801 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.316896 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.317110 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.317220 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.317414 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.317516 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.317721 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.317818 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.318035 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.318122 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.318336 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.318433 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.318648 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.318797 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.318979 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.319068 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.319296 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.319394 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.319632 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.319719 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.319950 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.320177 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.320275 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.320518 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.320606 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.320844 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.321155 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.321251 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.321472 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.321560 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.321787 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.321882 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.322096 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.322192 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.322407 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.322495 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.322785 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.322878 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.323106 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.323196 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.323426 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.323513 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.323744 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.324007 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.324110 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.324346 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.324435 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.324661 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.324747 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.324976 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.325073 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.325291 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.325380 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.325607 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.325694 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.325917 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.326017 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.326226 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.326321 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.326538 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.326625 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.326877 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.326967 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.327194 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.327296 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.327505 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.327599 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.327818 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.327907 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.328132 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.328228 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.328445 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.328533 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.328759 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.328901 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.329071 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.329161 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.329386 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.329482 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.329695 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.329782 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.330007 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.330095 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.330320 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.330417 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.330629 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.330750 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.330967 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.331057 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.331282 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.331380 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.331588 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.331682 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.331933 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.332026 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.332253 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.332346 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.332572 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.332668 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.332891 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.332987 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.333204 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.333294 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.333517 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.333606 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.333833 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.333930 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.334145 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.334234 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.334464 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.334553 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.334814 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.334917 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.335137 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.335233 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.335445 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.335533 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.335793 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.335889 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.336123 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.336218 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.336438 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.336576 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.336751 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.336858 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.337063 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.337152 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.337383 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.337484 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.337703 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.337792 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.338014 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.338100 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.338350 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.338438 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.338662 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.338767 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.339002 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.339097 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.339314 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.339410 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.339625 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.339715 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.339942 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.340031 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.340253 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.340354 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.340566 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.340655 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.340874 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.340961 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.341184 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.341282 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.341493 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.341588 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.341800 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.341896 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.342104 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.342201 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.342409 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.342503 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.342730 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.342822 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.343045 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.343144 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.343354 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.343441 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.343663 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.343758 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.343969 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.344065 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.344276 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.344372 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.344582 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.344671 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.344887 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.344977 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.345193 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.345281 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.345545 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.345640 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.345805 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.345896 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.346111 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.346200 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.346421 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.346511 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.346745 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.346838 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.347055 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.347144 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.347370 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.347521 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.347665 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.347755 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.347969 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.348063 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.348301 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.348403 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.348636 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.348724 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.348969 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.349067 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.349270 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.349366 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.349582 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.349669 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.349905 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.349991 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.350217 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.350318 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.350541 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.350629 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.350885 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.350973 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.351201 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.351297 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.351515 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.351603 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.351842 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.351936 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.352153 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.352248 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.352469 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.352566 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.352784 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.352885 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.353097 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.353186 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.353410 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.353507 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.353726 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.354319 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.354581 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.354675 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.354926 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.355033 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.355239 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.355341 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.355558 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.355654 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.355875 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.355964 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.356196 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.356292 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.356518 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.356606 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.356832 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.356926 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.357167 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.357274 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.357483 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.357619 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.357796 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.357893 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.358112 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.358202 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.358429 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.358517 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.358773 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.358864 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.359097 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.359187 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.359413 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.359500 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.359730 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.359819 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.360052 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.360140 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.360371 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.360467 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.360619 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 09:23:59.360715 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.361018 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.361334 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.361664 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.361995 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.362344 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.362662 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.363032 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.363366 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.363686 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.364010 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.364324 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:23:59.364571 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 09:23:59.513424 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO dbcounter [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Registered counter for database nova_api Sep 02 09:23:59.517336 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO dbcounter [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Registered counter for database nova_api Sep 02 09:23:59.534857 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_db.sqlalchemy.engines [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:23:59.538636 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG oslo_db.sqlalchemy.engines [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:23:59.542444 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writer thread running {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:23:59.545922 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG dbcounter [-] [105865] Writer thread running {{(pid=105865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:23:59.599516 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.context [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4302fafa-fa9b-40be-bbd3-4d18650e680f(cell1) {{(pid=105866) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 09:23:59.602091 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.context [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4302fafa-fa9b-40be-bbd3-4d18650e680f(cell1) {{(pid=105865) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 09:23:59.603366 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:59.603890 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:59.605460 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:59.605989 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG oslo_concurrency.lockutils [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:59.606187 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:59.606467 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG oslo_concurrency.lockutils [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:59.606639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:59.608034 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG oslo_concurrency.lockutils [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:59.608651 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:59.608742 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG oslo_concurrency.lockutils [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:23:59.609190 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG oslo_concurrency.lockutils [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:23:59.610637 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO dbcounter [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Registered counter for database nova_cell0 Sep 02 09:23:59.611197 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG oslo_concurrency.lockutils [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:23:59.613154 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO dbcounter [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Registered counter for database nova_cell0 Sep 02 09:23:59.614726 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO dbcounter [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Registered counter for database nova_cell1 Sep 02 09:23:59.617068 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO dbcounter [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Registered counter for database nova_cell1 Sep 02 09:23:59.622836 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_db.sqlalchemy.engines [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:23:59.624527 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_db.sqlalchemy.engines [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:23:59.626318 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG oslo_db.sqlalchemy.engines [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:23:59.628150 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG oslo_db.sqlalchemy.engines [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:23:59.630215 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writer thread running {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:23:59.633025 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writer thread running {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:23:59.633656 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG dbcounter [-] [105865] Writer thread running {{(pid=105865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:23:59.637032 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG dbcounter [-] [105865] Writer thread running {{(pid=105865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:23:59.776790 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO dbcounter [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Registered counter for database nova_cell0 Sep 02 09:23:59.780928 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO dbcounter [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Registered counter for database nova_cell0 Sep 02 09:23:59.785612 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_db.sqlalchemy.engines [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:23:59.789703 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG oslo_db.sqlalchemy.engines [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:23:59.790281 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writer thread running {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:23:59.794141 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG dbcounter [-] [105865] Writer thread running {{(pid=105865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:24:00.217828 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: WARNING keystonemiddleware.auth_token [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:24:00.225143 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: WARNING keystonemiddleware.auth_token [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:24:00.237936 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: WARNING keystonemiddleware.auth_token [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:24:00.245130 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: WARNING keystonemiddleware.auth_token [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:24:00.565251 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: WARNING keystonemiddleware.auth_token [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:24:00.571211 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: WARNING keystonemiddleware.auth_token [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:24:00.576483 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558114c0e9c0 pid: 105866 (default app) Sep 02 09:24:00.578598 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:24:00.579844 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001817 Sep 02 09:24:00.580248 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Fri Sep 2 09:24:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:24:00.582066 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: WARNING keystonemiddleware.auth_token [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:24:00.588006 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: WARNING keystonemiddleware.auth_token [None req-1b72116e-bbe1-446b-bc89-016d26fea0a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:24:00.593756 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558114c0e9c0 pid: 105865 (default app) Sep 02 09:25:20.531488 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:20.532510 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 02 09:25:20.532918 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:25:20.545210 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG dbcounter [-] [105865] Writing DB stats nova_api:SELECT=3 {{(pid=105865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:20.546330 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG dbcounter [-] [105865] Writing DB stats nova_cell0:SELECT=3 {{(pid=105865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:20.547200 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG dbcounter [-] [105865] Writing DB stats nova_cell1:SELECT=3 {{(pid=105865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:20.548310 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG dbcounter [-] [105865] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:21.422935 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-19ba4bd9-5a61-4ac1-98c1-6b7687b1c6a0 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:21.454492 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-19ba4bd9-5a61-4ac1-98c1-6b7687b1c6a0 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.914412 Sep 02 09:25:21.461679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1292 bytes} [Fri Sep 2 09:25:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:25:23.795116 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:23.796139 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-6d0672a4-158e-468f-8a34-63f51779bce6 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 02 09:25:23.796695 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:25:24.232407 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-109ae656-b99e-4261-96ea-b0f68e380fe7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0}} {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:24.335782 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-109ae656-b99e-4261-96ea-b0f68e380fe7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.532444 Sep 02 09:25:24.336349 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1283 bytes} [Fri Sep 2 09:25:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:25:24.557419 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-93d4014f-c859-43fe-a9bf-594121ba09fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:24.580580 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writing DB stats nova_api:SELECT=3 {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:24.585986 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writing DB stats nova_cell1:SELECT=3 {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:24.585986 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writing DB stats nova_cell0:SELECT=3 {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:24.585986 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:24.678048 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-93d4014f-c859-43fe-a9bf-594121ba09fd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.333062 Sep 02 09:25:24.682727 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1336 bytes} [Fri Sep 2 09:25:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:25:27.025053 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-109ae656-b99e-4261-96ea-b0f68e380fe7 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:27.025990 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-109ae656-b99e-4261-96ea-b0f68e380fe7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Sep 02 09:25:27.026413 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:25:27.662560 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-b0fa6587-db9a-4546-9b9c-94b545e45877 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "ram": 512}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:27.790163 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-b0fa6587-db9a-4546-9b9c-94b545e45877 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.756721 Sep 02 09:25:27.790893 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1283 bytes} [Fri Sep 2 09:25:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:25:27.803206 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-ade91d1b-1d01-4560-b767-c0802ac176fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:27.914309 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-ade91d1b-1d01-4560-b767-c0802ac176fb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115266 Sep 02 09:25:27.914925 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1336 bytes} [Fri Sep 2 09:25:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:25:30.276410 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-b0fa6587-db9a-4546-9b9c-94b545e45877 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:30.277334 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-b0fa6587-db9a-4546-9b9c-94b545e45877 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 02 09:25:30.277740 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:25:30.675593 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-dc9b2a62-e352-4fdb-9979-2f8686413932 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "disk": 10, "id": "d2", "name": "ds1G"}} {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:30.759390 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-dc9b2a62-e352-4fdb-9979-2f8686413932 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474732 Sep 02 09:25:30.759944 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1283 bytes} [Fri Sep 2 09:25:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:25:30.772434 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-de54e36a-3d4b-4c11-8bd0-8d700f537449 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:30.865765 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-de54e36a-3d4b-4c11-8bd0-8d700f537449 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097494 Sep 02 09:25:30.866356 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1336 bytes} [Fri Sep 2 09:25:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:25:33.213760 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-dc9b2a62-e352-4fdb-9979-2f8686413932 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:33.216008 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-dc9b2a62-e352-4fdb-9979-2f8686413932 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003322 Sep 02 09:25:33.216008 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:25:33.661846 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-bf6790b8-94e6-45ba-bacb-d50a44ac25f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "id": "d3"}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:33.736698 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-bf6790b8-94e6-45ba-bacb-d50a44ac25f8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514777 Sep 02 09:25:33.737422 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1283 bytes} [Fri Sep 2 09:25:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:25:33.749507 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-ff902e06-bfc0-4cae-b470-9cd693982e7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:33.855167 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-ff902e06-bfc0-4cae-b470-9cd693982e7f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109190 Sep 02 09:25:33.855929 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1336 bytes} [Fri Sep 2 09:25:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:25:36.205937 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-bf6790b8-94e6-45ba-bacb-d50a44ac25f8 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:36.208064 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-bf6790b8-94e6-45ba-bacb-d50a44ac25f8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002539 Sep 02 09:25:36.208471 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:25:36.630419 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-71a8fb56-ddc3-4d46-aae0-2525643f5330 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:36.794068 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-71a8fb56-ddc3-4d46-aae0-2525643f5330 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.579080 Sep 02 09:25:36.794864 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1283 bytes} [Fri Sep 2 09:25:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:25:36.807726 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-7d095356-4d0c-4a52-959e-4a10bccc40cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:36.912564 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-7d095356-4d0c-4a52-959e-4a10bccc40cd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108462 Sep 02 09:25:36.913434 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1336 bytes} [Fri Sep 2 09:25:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:25:39.288382 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-71a8fb56-ddc3-4d46-aae0-2525643f5330 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:39.289447 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-71a8fb56-ddc3-4d46-aae0-2525643f5330 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 02 09:25:39.289803 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:25:39.711337 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-41c26191-8306-48e5-bd46-b0fd82d9e312 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:39.743233 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-41c26191-8306-48e5-bd46-b0fd82d9e312 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447077 Sep 02 09:25:39.743823 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1292 bytes} [Fri Sep 2 09:25:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:25:42.082506 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-71a8fb56-ddc3-4d46-aae0-2525643f5330 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:42.083471 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-71a8fb56-ddc3-4d46-aae0-2525643f5330 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 02 09:25:42.083907 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:25:42.513390 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-b0fb3fd6-15cb-48f4-bad4-a8dc5a79de8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "name": "m1.tiny", "swap": 0}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:42.587609 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-b0fb3fd6-15cb-48f4-bad4-a8dc5a79de8e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.497138 Sep 02 09:25:42.588191 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1283 bytes} [Fri Sep 2 09:25:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:25:42.600715 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-f06713a6-aabc-47ba-b2cc-bd278c96643e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:42.683530 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-f06713a6-aabc-47ba-b2cc-bd278c96643e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086770 Sep 02 09:25:42.684027 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1333 bytes} [Fri Sep 2 09:25:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:25:44.988984 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-b0fb3fd6-15cb-48f4-bad4-a8dc5a79de8e admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:44.989912 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-b0fb3fd6-15cb-48f4-bad4-a8dc5a79de8e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 02 09:25:44.990313 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:25:45.381378 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-76404e03-d3d4-41cf-adf4-be0ecdb118a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:45.444636 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-76404e03-d3d4-41cf-adf4-be0ecdb118a2 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.448175 Sep 02 09:25:45.445199 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1283 bytes} [Fri Sep 2 09:25:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:25:45.457237 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-4c320ccd-4b45-4c22-a082-0b29fd0c5e61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:45.539147 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-4c320ccd-4b45-4c22-a082-0b29fd0c5e61 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085458 Sep 02 09:25:45.539744 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1333 bytes} [Fri Sep 2 09:25:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:25:47.881852 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-76404e03-d3d4-41cf-adf4-be0ecdb118a2 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:47.882910 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-76404e03-d3d4-41cf-adf4-be0ecdb118a2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 02 09:25:47.883311 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:25:48.239418 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-b3b19589-00d3-4abf-8d6b-3d70a194154c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "swap": 0, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:48.299221 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-b3b19589-00d3-4abf-8d6b-3d70a194154c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.409444 Sep 02 09:25:48.299969 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1283 bytes} [Fri Sep 2 09:25:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:25:48.312498 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-24c44684-ef1e-4009-888d-4f24599cecef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:48.389949 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-24c44684-ef1e-4009-888d-4f24599cecef admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081036 Sep 02 09:25:48.390626 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1333 bytes} [Fri Sep 2 09:25:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:25:50.780785 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-b3b19589-00d3-4abf-8d6b-3d70a194154c admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:50.781391 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-b3b19589-00d3-4abf-8d6b-3d70a194154c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 02 09:25:50.782063 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:25:51.232135 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-27d999ce-b1ea-4bf9-b02d-07b6a21cc4d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "name": "m1.large", "ram": 8192, "id": "4"}} {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:51.240503 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG dbcounter [-] [105865] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:25:51.295672 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-27d999ce-b1ea-4bf9-b02d-07b6a21cc4d7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.507627 Sep 02 09:25:51.296223 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1283 bytes} [Fri Sep 2 09:25:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:25:51.309414 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-27ae225e-8790-4563-9440-2114c619082b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:51.380792 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-27ae225e-8790-4563-9440-2114c619082b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075065 Sep 02 09:25:51.381621 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1333 bytes} [Fri Sep 2 09:25:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:25:53.739588 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-27d999ce-b1ea-4bf9-b02d-07b6a21cc4d7 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:25:53.740797 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-27d999ce-b1ea-4bf9-b02d-07b6a21cc4d7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Sep 02 09:25:53.741462 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:25:54.182557 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-b11697e2-3e09-4439-8b12-e786083f0a76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "disk": 160, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:54.267382 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-b11697e2-3e09-4439-8b12-e786083f0a76 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.519549 Sep 02 09:25:54.268104 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1283 bytes} [Fri Sep 2 09:25:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:25:54.283080 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-da2ea34b-9010-4345-b935-e08173c87f5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:25:54.368092 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-da2ea34b-9010-4345-b935-e08173c87f5b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091520 Sep 02 09:25:54.372011 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1333 bytes} [Fri Sep 2 09:25:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:26:14.549214 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-b11697e2-3e09-4439-8b12-e786083f0a76 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:14.550241 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-b11697e2-3e09-4439-8b12-e786083f0a76 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 02 09:26:14.550645 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:26:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:26:14.936539 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-b38b8c8b-028e-49fc-9aa6-5cda4ffd9802 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:14.956953 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-b38b8c8b-028e-49fc-9aa6-5cda4ffd9802 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400128 Sep 02 09:26:14.957489 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1292 bytes} [Fri Sep 2 09:26:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 09:26:16.002275 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-b11697e2-3e09-4439-8b12-e786083f0a76 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:16.003324 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-b11697e2-3e09-4439-8b12-e786083f0a76 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 02 09:26:16.003719 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:26:16.517666 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-932f7f08-cacc-48c1-a007-c35a1f5f81e6 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:16.523268 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.wsgi [None req-932f7f08-cacc-48c1-a007-c35a1f5f81e6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-932f7f08-cacc-48c1-a007-c35a1f5f81e6 admin admin] Request method failure captured: Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Accept: application/json Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Accept-Encoding: gzip, deflate Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Connection: keep-alive Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Content-Length: 0 Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Host: 10.222.0.57 Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Openstack-Api-Version: compute 2.92 Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Openstack-System-Scope: None Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: User-Agent: python-novaclient Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Auth-Token: gAAAAABjEcw3_b4BVWCM1SUicjOqdz_5mF5mECkFPh20nMNTlE4hvWh3jbsdb_dQxGCL1gqvUH7zDGQeDpferyLH6eGprE4IaC4mfdwd3ZibnlLFnohExZzQFanfWUIDhyXEmQfLai810zU36Rdd-nKzAbVzOQ0OGoVHCViGbbA13TzQzbMPjgc Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Domain-Id: None Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Domain-Name: None Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Identity-Status: Confirmed Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Is-Admin-Project: True Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Domain-Id: default Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Domain-Name: Default Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Name: admin Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Role: member,reader,admin Sep 02 09:26:16.526486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Roles: member,reader,admin Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae5820815add48cd913951058cc9251c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae5820815add48cd913951058cc9251c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Tenant: admin Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Tenant-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Tenant-Name: admin Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User: admin Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Domain-Id: default Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Domain-Name: Default Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Id: 9cffe229f2f843e394c2248b000ecb37 Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Name: admin Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: method: > Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: exception: Flavor 42 could not be found. Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: action_args: {'id': '42'} Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:26:16.528182 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:16.529274 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:16.531171 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-932f7f08-cacc-48c1-a007-c35a1f5f81e6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:26:16.532582 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-932f7f08-cacc-48c1-a007-c35a1f5f81e6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387512 Sep 02 09:26:16.532582 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Sep 2 09:26:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:16.537731 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-1a51be35-3994-4af1-85a7-c03853b5279d admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:16.541835 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:26:16.560265 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-1a51be35-3994-4af1-85a7-c03853b5279d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026013 Sep 02 09:26:16.560858 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Sep 2 09:26:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:26:16.571316 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-9f8ac1ef-73a7-449d-96f4-53cdae0c39de admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:16.594078 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-9f8ac1ef-73a7-449d-96f4-53cdae0c39de admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026391 Sep 02 09:26:16.595207 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Sep 2 09:26:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:26:16.604562 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-7ebd9a78-e244-49df-9907-f711fecddd69 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:16.611312 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.wsgi [None req-7ebd9a78-e244-49df-9907-f711fecddd69 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-7ebd9a78-e244-49df-9907-f711fecddd69 admin admin] Request method failure captured: Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Accept: application/json Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Accept-Encoding: gzip, deflate Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Connection: keep-alive Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Content-Length: 0 Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Host: 10.222.0.57 Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Openstack-Api-Version: compute 2.92 Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Openstack-System-Scope: None Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: User-Agent: python-novaclient Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Auth-Token: gAAAAABjEcw3_b4BVWCM1SUicjOqdz_5mF5mECkFPh20nMNTlE4hvWh3jbsdb_dQxGCL1gqvUH7zDGQeDpferyLH6eGprE4IaC4mfdwd3ZibnlLFnohExZzQFanfWUIDhyXEmQfLai810zU36Rdd-nKzAbVzOQ0OGoVHCViGbbA13TzQzbMPjgc Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Domain-Id: None Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Domain-Name: None Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Identity-Status: Confirmed Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Is-Admin-Project: True Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Domain-Id: default Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Domain-Name: Default Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Name: admin Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Role: member,reader,admin Sep 02 09:26:16.614520 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Roles: member,reader,admin Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae5820815add48cd913951058cc9251c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae5820815add48cd913951058cc9251c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Tenant: admin Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Tenant-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Tenant-Name: admin Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User: admin Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Domain-Id: default Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Domain-Name: Default Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Id: 9cffe229f2f843e394c2248b000ecb37 Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Name: admin Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: method: > Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: exception: Flavor 42 could not be found. Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: action_args: {'id': '42'} Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:26:16.616091 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:16.617190 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:16.618484 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-7ebd9a78-e244-49df-9907-f711fecddd69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:26:16.619765 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-7ebd9a78-e244-49df-9907-f711fecddd69 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014910 Sep 02 09:26:16.619765 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Sep 2 09:26:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:17.585931 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-9f8ac1ef-73a7-449d-96f4-53cdae0c39de admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:17.586980 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-9f8ac1ef-73a7-449d-96f4-53cdae0c39de admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 02 09:26:17.587406 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:26:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:26:18.106594 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-7a83e9a1-52fe-492e-a10d-5a465e0e8740 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:18.112489 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.wsgi [None req-7a83e9a1-52fe-492e-a10d-5a465e0e8740 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-7a83e9a1-52fe-492e-a10d-5a465e0e8740 admin admin] Request method failure captured: Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Accept: application/json Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Accept-Encoding: gzip, deflate Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Connection: keep-alive Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Content-Length: 0 Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Host: 10.222.0.57 Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Openstack-Api-Version: compute 2.92 Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Openstack-System-Scope: None Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: User-Agent: python-novaclient Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Auth-Token: gAAAAABjEcw5WHS6yQ4VUgNfpYsIwKOuzstx7dkSiRIzIYjDVrQlUh2L-N_Vtd_mpQR0_Pipp8zT6ewbPlPLUPaFKQ9H3NKv9ZVpOy9JOLv_0rAKr9UBGa1iKDJIibNXa8b0X7rbgEh7EQjhW8GQHEWPWWrcD8dPgwByzNbFbKjfV38b1_2SYc0 Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Domain-Id: None Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Domain-Name: None Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Identity-Status: Confirmed Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Is-Admin-Project: True Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Domain-Id: default Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Domain-Name: Default Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Name: admin Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Role: member,reader,admin Sep 02 09:26:18.113991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Roles: member,reader,admin Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae5820815add48cd913951058cc9251c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae5820815add48cd913951058cc9251c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Tenant: admin Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Tenant-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Tenant-Name: admin Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User: admin Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Domain-Id: default Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Domain-Name: Default Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Id: 9cffe229f2f843e394c2248b000ecb37 Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Name: admin Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: method: > Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: exception: Flavor 84 could not be found. Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: action_args: {'id': '84'} Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:26:18.115563 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:18.116585 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:18.118073 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-7a83e9a1-52fe-492e-a10d-5a465e0e8740 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:26:18.119431 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-7a83e9a1-52fe-492e-a10d-5a465e0e8740 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391610 Sep 02 09:26:18.119431 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Sep 2 09:26:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:18.124982 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-defafaf0-dd61-43d2-9884-4e9be171e079 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:18.140405 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-defafaf0-dd61-43d2-9884-4e9be171e079 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018925 Sep 02 09:26:18.140930 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Sep 2 09:26:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:26:18.150410 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-ba0b4af1-5686-4ddd-99f5-54014c481fd1 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:18.166010 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-ba0b4af1-5686-4ddd-99f5-54014c481fd1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019127 Sep 02 09:26:18.166536 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Sep 2 09:26:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:26:18.176063 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-d9189bcd-d32d-459a-952a-56118d573c50 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:18.181179 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.wsgi [None req-d9189bcd-d32d-459a-952a-56118d573c50 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-d9189bcd-d32d-459a-952a-56118d573c50 admin admin] Request method failure captured: Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Accept: application/json Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Accept-Encoding: gzip, deflate Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Connection: keep-alive Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Content-Length: 0 Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Host: 10.222.0.57 Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Openstack-Api-Version: compute 2.92 Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Openstack-System-Scope: None Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: User-Agent: python-novaclient Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Auth-Token: gAAAAABjEcw5WHS6yQ4VUgNfpYsIwKOuzstx7dkSiRIzIYjDVrQlUh2L-N_Vtd_mpQR0_Pipp8zT6ewbPlPLUPaFKQ9H3NKv9ZVpOy9JOLv_0rAKr9UBGa1iKDJIibNXa8b0X7rbgEh7EQjhW8GQHEWPWWrcD8dPgwByzNbFbKjfV38b1_2SYc0 Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Domain-Id: None Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Domain-Name: None Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Identity-Status: Confirmed Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Is-Admin-Project: True Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Domain-Id: default Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Domain-Name: Default Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Name: admin Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Role: member,reader,admin Sep 02 09:26:18.182676 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Roles: member,reader,admin Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae5820815add48cd913951058cc9251c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae5820815add48cd913951058cc9251c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Tenant: admin Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Tenant-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Tenant-Name: admin Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User: admin Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Domain-Id: default Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Domain-Name: Default Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Id: 9cffe229f2f843e394c2248b000ecb37 Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Name: admin Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: method: > Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: exception: Flavor 84 could not be found. Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: action_args: {'id': '84'} Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:26:18.184208 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:18.185161 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:18.186229 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-d9189bcd-d32d-459a-952a-56118d573c50 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:26:18.187262 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-d9189bcd-d32d-459a-952a-56118d573c50 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011959 Sep 02 09:26:18.187262 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Fri Sep 2 09:26:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:19.148350 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-ba0b4af1-5686-4ddd-99f5-54014c481fd1 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:19.149360 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-ba0b4af1-5686-4ddd-99f5-54014c481fd1 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 02 09:26:19.149756 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:26:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:26:19.669433 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-20efb647-dbf3-4490-8495-cf4d71e1d873 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:19.675259 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.wsgi [None req-20efb647-dbf3-4490-8495-cf4d71e1d873 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-20efb647-dbf3-4490-8495-cf4d71e1d873 admin admin] Request method failure captured: Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Accept: application/json Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Accept-Encoding: gzip, deflate Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Connection: keep-alive Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Content-Length: 0 Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Host: 10.222.0.57 Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Openstack-Api-Version: compute 2.92 Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Openstack-System-Scope: None Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: User-Agent: python-novaclient Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Auth-Token: gAAAAABjEcw7XxlU38KgIdZbiisPG3GjfsnIrR23cCcTB5gUnzCjAU2AliIwSj9oC298vBepIVxLflpzGZ_9z12eS12fJoh6zHTwOLZFT08ioRRo7gX6SzvcK9oEcX_Rmc-ver29tb4m0ejfQPe1gAZgpsY0Cv5TwoJMe2wnrp0sAKyGTB6aoJE Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Domain-Id: None Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Domain-Name: None Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Identity-Status: Confirmed Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Is-Admin-Project: True Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Domain-Id: default Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Domain-Name: Default Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Project-Name: admin Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Role: member,reader,admin Sep 02 09:26:19.676812 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Roles: member,reader,admin Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae5820815add48cd913951058cc9251c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae5820815add48cd913951058cc9251c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Tenant: admin Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Tenant-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-Tenant-Name: admin Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User: admin Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Domain-Id: default Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Domain-Name: Default Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Id: 9cffe229f2f843e394c2248b000ecb37 Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: X-User-Name: admin Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: method: > Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: exception: Flavor 451 could not be found. Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: action_args: {'id': '451'} Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:26:19.678373 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:19.679679 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: ERROR nova.api.openstack.wsgi Sep 02 09:26:19.680762 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-20efb647-dbf3-4490-8495-cf4d71e1d873 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:26:19.681796 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-20efb647-dbf3-4490-8495-cf4d71e1d873 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391549 Sep 02 09:26:19.681796 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Sep 2 09:26:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:19.688519 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-dfffb49d-06a9-4e71-bb5b-21b3949f9d44 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:19.704059 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-dfffb49d-06a9-4e71-bb5b-21b3949f9d44 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019113 Sep 02 09:26:19.704572 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Sep 2 09:26:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:26:19.714256 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:19.729250 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018497 Sep 02 09:26:19.729786 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Fri Sep 2 09:26:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:26:19.739683 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-e9273002-572e-4a80-8a4f-034bfc27d865 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:19.745085 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.wsgi [None req-e9273002-572e-4a80-8a4f-034bfc27d865 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-e9273002-572e-4a80-8a4f-034bfc27d865 admin admin] Request method failure captured: Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Accept: application/json Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Accept-Encoding: gzip, deflate Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Connection: keep-alive Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Content-Length: 0 Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Host: 10.222.0.57 Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Openstack-Api-Version: compute 2.92 Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Openstack-System-Scope: None Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: User-Agent: python-novaclient Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Auth-Token: gAAAAABjEcw7XxlU38KgIdZbiisPG3GjfsnIrR23cCcTB5gUnzCjAU2AliIwSj9oC298vBepIVxLflpzGZ_9z12eS12fJoh6zHTwOLZFT08ioRRo7gX6SzvcK9oEcX_Rmc-ver29tb4m0ejfQPe1gAZgpsY0Cv5TwoJMe2wnrp0sAKyGTB6aoJE Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Domain-Id: None Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Domain-Name: None Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Identity-Status: Confirmed Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Is-Admin-Project: True Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Domain-Id: default Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Domain-Name: Default Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Project-Name: admin Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Role: member,reader,admin Sep 02 09:26:19.746639 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Roles: member,reader,admin Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ae5820815add48cd913951058cc9251c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ae5820815add48cd913951058cc9251c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ae5820815add48cd913951058cc9251c", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Tenant: admin Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Tenant-Id: ae5820815add48cd913951058cc9251c Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-Tenant-Name: admin Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User: admin Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Domain-Id: default Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Domain-Name: Default Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Id: 9cffe229f2f843e394c2248b000ecb37 Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: X-User-Name: admin Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: method: > Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: exception: Flavor 451 could not be found. Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: action_args: {'id': '451'} Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:26:19.748152 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:19.748994 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: ERROR nova.api.openstack.wsgi Sep 02 09:26:19.750938 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-e9273002-572e-4a80-8a4f-034bfc27d865 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:26:19.752294 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-e9273002-572e-4a80-8a4f-034bfc27d865 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011966 Sep 02 09:26:19.752294 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Sep 2 09:26:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 09:26:20.707480 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:20.708486 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 02 09:26:20.708877 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:26:21.231912 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-f40e5880-bd88-4f02-abc0-2c11fe5b619c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:26:21.394169 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-f40e5880-bd88-4f02-abc0-2c11fe5b619c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.535418 Sep 02 09:26:21.394169 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Sep 2 09:26:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:26:22.344855 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:22.345907 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Sep 02 09:26:22.346323 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:26:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:26:22.862687 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-00454b26-6b77-46eb-b22e-6ec252ee7fab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:26:22.940145 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-00454b26-6b77-46eb-b22e-6ec252ee7fab admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.458189 Sep 02 09:26:22.940697 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Sep 2 09:26:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:26:23.897095 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:23.898170 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 02 09:26:23.898569 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:26:24.421609 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-e53904ba-2273-4ac9-b200-af11a3ab76a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:26:24.557709 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-e53904ba-2273-4ac9-b200-af11a3ab76a6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.521247 Sep 02 09:26:24.558196 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Sep 2 09:26:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:26:25.520021 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:25.521034 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 02 09:26:25.521433 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:26:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:26:26.037235 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-e9cebd19-16a2-412f-87a9-e27ee18a83f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:26:26.115933 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-e9cebd19-16a2-412f-87a9-e27ee18a83f1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.457872 Sep 02 09:26:26.116475 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Fri Sep 2 09:26:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:26:27.080467 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:27.081499 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 02 09:26:27.081885 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:26:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:26:27.599519 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-1854242c-7670-404f-9b9b-002bc5f1ad52 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:26:27.620903 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-1854242c-7670-404f-9b9b-002bc5f1ad52 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400038 Sep 02 09:26:27.621548 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Fri Sep 2 09:26:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:27:20.763751 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:27:20.764777 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-503cfef3-3b54-4a2c-b2ee-9f3a67a9ca19 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 02 09:27:20.765180 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 931 bytes} [Fri Sep 2 09:27:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:27:20.775755 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:21.156991 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-b59a7eda-03dc-49d0-b486-636e7de2f7b6 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:27:21.177821 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-b59a7eda-03dc-49d0-b486-636e7de2f7b6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406530 Sep 02 09:27:21.178352 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1292 bytes} [Fri Sep 2 09:27:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:27:21.199466 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG dbcounter [-] [105865] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:27:21.203648 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-7c25c609-6c02-45e9-8f1d-91dc7efcd9c9 admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:27:21.211031 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-7c25c609-6c02-45e9-8f1d-91dc7efcd9c9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012950 Sep 02 09:27:21.211555 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1283 bytes} [Fri Sep 2 09:27:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:27:21.223462 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-be4ef15a-a6f3-42f9-a349-79fe6554b2b5 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:27:21.231022 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-be4ef15a-a6f3-42f9-a349-79fe6554b2b5 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011112 Sep 02 09:27:21.231567 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1286 bytes} [Fri Sep 2 09:27:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:27:21.242730 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-76af71d2-58d9-4c8a-9b15-92298a0b06fa admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:27:21.250146 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-76af71d2-58d9-4c8a-9b15-92298a0b06fa admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011176 Sep 02 09:27:21.251468 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1286 bytes} [Fri Sep 2 09:27:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:27:21.262006 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-3517a4c7-9494-4afc-8328-c49a6552346a admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:27:21.270170 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-3517a4c7-9494-4afc-8328-c49a6552346a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011774 Sep 02 09:27:21.270686 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1283 bytes} [Fri Sep 2 09:27:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:30:30.036131 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-76af71d2-58d9-4c8a-9b15-92298a0b06fa admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:30:30.037137 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-76af71d2-58d9-4c8a-9b15-92298a0b06fa admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 02 09:30:30.037526 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:30:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:30:30.179357 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writing DB stats nova_api:SELECT=6 {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:30:30.346208 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-1f26b2a9-d322-4870-856f-95bc8d8adca4 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:30:30.349762 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-1f26b2a9-d322-4870-856f-95bc8d8adca4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:30:30.350237 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-1f26b2a9-d322-4870-856f-95bc8d8adca4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:30:30.350665 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-1f26b2a9-d322-4870-856f-95bc8d8adca4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:30:30.351392 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-1f26b2a9-d322-4870-856f-95bc8d8adca4 admin admin] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:30:30.351836 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-1f26b2a9-d322-4870-856f-95bc8d8adca4 admin admin] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:30:30.352255 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-1f26b2a9-d322-4870-856f-95bc8d8adca4 admin admin] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:30:30.390578 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-1f26b2a9-d322-4870-856f-95bc8d8adca4 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.212712 Sep 02 09:30:30.391364 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Sep 2 09:30:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:30:31.234367 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-76af71d2-58d9-4c8a-9b15-92298a0b06fa admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:30:31.235565 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-76af71d2-58d9-4c8a-9b15-92298a0b06fa admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Sep 02 09:30:31.235964 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:30:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:30:31.433907 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-85329301-19fe-4db0-b56a-47f1c0fa69d2 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:30:31.437400 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-85329301-19fe-4db0-b56a-47f1c0fa69d2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:30:31.437873 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-85329301-19fe-4db0-b56a-47f1c0fa69d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:30:31.438333 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-85329301-19fe-4db0-b56a-47f1c0fa69d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:30:31.439145 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-85329301-19fe-4db0-b56a-47f1c0fa69d2 admin admin] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:30:31.439587 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-85329301-19fe-4db0-b56a-47f1c0fa69d2 admin admin] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:30:31.440001 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-85329301-19fe-4db0-b56a-47f1c0fa69d2 admin admin] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:30:31.461622 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-85329301-19fe-4db0-b56a-47f1c0fa69d2 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.083559 Sep 02 09:30:31.462127 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Sep 2 09:30:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:30:42.651521 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-76af71d2-58d9-4c8a-9b15-92298a0b06fa admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:30:42.652584 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-76af71d2-58d9-4c8a-9b15-92298a0b06fa admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Sep 02 09:30:42.652982 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:30:42.798296 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writing DB stats nova_cell0:SELECT=4 {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:30:42.799019 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writing DB stats nova_cell1:SELECT=4 {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:30:42.799582 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG dbcounter [-] [105866] Writing DB stats nova_api:SELECT=8 {{(pid=105866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:30:42.848443 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-e3a06383-ac9f-4f67-864d-6ca6ff0adf67 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:30:42.852049 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-e3a06383-ac9f-4f67-864d-6ca6ff0adf67 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:30:42.852535 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-e3a06383-ac9f-4f67-864d-6ca6ff0adf67 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:30:42.853139 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-e3a06383-ac9f-4f67-864d-6ca6ff0adf67 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:30:42.853859 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-e3a06383-ac9f-4f67-864d-6ca6ff0adf67 admin admin] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:30:42.854304 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-e3a06383-ac9f-4f67-864d-6ca6ff0adf67 admin admin] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:30:42.855297 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-e3a06383-ac9f-4f67-864d-6ca6ff0adf67 admin admin] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:30:42.882457 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-e3a06383-ac9f-4f67-864d-6ca6ff0adf67 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.088565 Sep 02 09:30:42.883052 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Sep 2 09:30:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:30:43.714747 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: DEBUG nova.api.openstack.wsgi [None req-76af71d2-58d9-4c8a-9b15-92298a0b06fa admin admin] Calling method '>' {{(pid=105865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:30:43.715783 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: INFO nova.api.openstack.requestlog [None req-76af71d2-58d9-4c8a-9b15-92298a0b06fa admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 02 09:30:43.716206 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: [pid: 105865|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Fri Sep 2 09:30:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:30:43.915735 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG nova.api.openstack.wsgi [None req-c8322a7a-fdaa-4cdb-af5c-4e6ff1d0d955 admin admin] Calling method '>' {{(pid=105866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:30:43.919763 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-c8322a7a-fdaa-4cdb-af5c-4e6ff1d0d955 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:30:43.920250 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-c8322a7a-fdaa-4cdb-af5c-4e6ff1d0d955 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:30:43.920687 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-c8322a7a-fdaa-4cdb-af5c-4e6ff1d0d955 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:30:43.921412 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-c8322a7a-fdaa-4cdb-af5c-4e6ff1d0d955 admin admin] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:30:43.921865 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-c8322a7a-fdaa-4cdb-af5c-4e6ff1d0d955 admin admin] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:30:43.922290 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: DEBUG oslo_concurrency.lockutils [None req-c8322a7a-fdaa-4cdb-af5c-4e6ff1d0d955 admin admin] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:30:43.945120 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: INFO nova.api.openstack.requestlog [None req-c8322a7a-fdaa-4cdb-af5c-4e6ff1d0d955 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.081169 Sep 02 09:30:43.945684 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: [pid: 105866|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Fri Sep 2 09:30:43 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 09:31:41.877903 dv-cinder-850831-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 02 09:31:41.878661 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: Fri Sep 2 09:31:41 2022 - graceful shutdown triggered... Sep 02 09:31:41.879169 dv-cinder-850831-3-iscsi devstack@n-api.service[105865]: Gracefully killing worker 1 (pid: 105865)... Sep 02 09:31:41.879607 dv-cinder-850831-3-iscsi devstack@n-api.service[105866]: Gracefully killing worker 2 (pid: 105866)... Sep 02 09:31:42.879088 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: worker 1 buried after 1 seconds Sep 02 09:31:42.879088 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: worker 2 buried after 1 seconds Sep 02 09:31:42.879088 dv-cinder-850831-3-iscsi devstack@n-api.service[105864]: goodbye to uWSGI. Sep 02 09:31:42.880544 dv-cinder-850831-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 02 09:31:42.881088 dv-cinder-850831-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 02 09:31:42.883962 dv-cinder-850831-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 09:31:42.893506 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 09:31:42.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 09:31:42 2022] *** Sep 02 09:31:42.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 09:31:42.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 09:31:42.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: nodename: dv-cinder-850831-3-iscsi Sep 02 09:31:42.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: machine: x86_64 Sep 02 09:31:42.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: clock source: unix Sep 02 09:31:42.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: pcre jit disabled Sep 02 09:31:42.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: detected number of CPU cores: 4 Sep 02 09:31:42.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: current working directory: / Sep 02 09:31:42.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: detected binary path: /usr/bin/uwsgi-core Sep 02 09:31:42.896293 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: your processes number limit is 47680 Sep 02 09:31:42.896293 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: your memory page size is 4096 bytes Sep 02 09:31:42.896293 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: detected max file descriptor number: 2048 Sep 02 09:31:42.896293 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: lock engine: pthread robust mutexes Sep 02 09:31:42.896293 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: thunder lock: enabled Sep 02 09:31:42.896293 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 09:31:42.896293 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 09:31:42.937028 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: Python main interpreter initialized at 0x5644743a79c0 Sep 02 09:31:42.937028 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: python threads support enabled Sep 02 09:31:42.937028 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: your server socket listen backlog is limited to 100 connections Sep 02 09:31:42.937028 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: your mercy for graceful operations on workers is 90 seconds Sep 02 09:31:42.937498 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 09:31:42.937498 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: *** Operational MODE: preforking *** Sep 02 09:31:42.937741 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: *** uWSGI is running in multiple interpreter mode *** Sep 02 09:31:42.937741 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: spawned uWSGI master process (pid: 127511) Sep 02 09:31:42.937943 dv-cinder-850831-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 09:31:42.938762 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: spawned uWSGI worker 1 (pid: 127531, cores: 1) Sep 02 09:31:42.939115 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: spawned uWSGI worker 2 (pid: 127533, cores: 1) Sep 02 09:31:42.941152 dv-cinder-850831-3-iscsi devstack@n-api.service[127511]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 09:31:43.598245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 09:31:43.606453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 09:31:44.760929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:31:44.760929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: from cryptography.utils import int_from_bytes Sep 02 09:31:44.761572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:31:44.761572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: from cryptography.utils import int_from_bytes Sep 02 09:31:44.767878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:31:44.767878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: from cryptography.utils import int_from_bytes Sep 02 09:31:44.768324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 09:31:44.768324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: from cryptography.utils import int_from_bytes Sep 02 09:31:47.203297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 09:31:47.203958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 09:31:47.204060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 09:31:47.204387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 09:31:47.204647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 09:31:47.205047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.205381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.205712 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.206041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.206346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 09:31:47.206861 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.206963 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 09:31:47.207066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.207066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.207203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 09:31:47.207462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.207574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 09:31:47.207660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.207744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 09:31:47.207914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.208144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.208244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.208477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.208586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850831-3-iscsi {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.208809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.209030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.209136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.209352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.209452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.209686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.209789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.210003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.210170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.210321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.210473 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.210643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.210837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.210996 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.211168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.211341 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.211512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.211821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850831-3-iscsi {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.212913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.213089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.213444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.213666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.213884 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.214114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.214333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.214548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.214757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.214983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.215232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.215232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.215641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.215862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.216066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.216284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.216518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.216731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.216947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.217152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.217382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.217603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.217809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.217809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.218213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850831-3-iscsi {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.218447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.218664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.218856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.219033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.219230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.219381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.219552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.219708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.219860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850831-3-iscsi {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.220010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.220211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.220852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.221007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.221165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.221310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.221458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.221640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.221800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.221958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.222108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.222256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.222405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.222555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.222882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.223036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.223191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.223342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.223484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.223634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.224360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.224487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.224582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.224664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.224746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.224825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.224907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.224981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225606 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.225949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.226869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.227007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.227101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.227185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.227284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.227368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.227442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.227519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.227912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.228011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.228092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.228166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.228243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.228315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.228534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.228669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.228841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.228965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.229389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.229557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.229716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.229873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.230021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.230180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.230338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.230499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.230654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.230916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.231066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.231222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.231382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.231542 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.231690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.231836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.231983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.232129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.232284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.232443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.232597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.232744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.232890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.233043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.233190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.233360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.233507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.233661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.233824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.233977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.234138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.234284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.234431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.234585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.234763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.234923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.234923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.235212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.235212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.235508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.235663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.235809 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.235979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.236134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.236281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.236435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.236588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.236741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.236902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.237064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.237232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.237386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.237534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.237690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.237847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.238011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.238169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.238316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.238467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.238690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.238896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.239053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.239200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.239364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.239561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.239727 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.239886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.240039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.240193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.240340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.240493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.240650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.240798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.240951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.241097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.241243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.241407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.241567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.241721 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.241876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.242036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.242183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.242335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.242482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.242634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.242847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.243035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.243184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.243331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.243499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.243654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.243809 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.243966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.244120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.244280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.244434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.244581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.244734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.244882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.245033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.245189 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.245344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.245499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.245654 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.245808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.245963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.246118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.246272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.246425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.246572 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.246746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.246899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.247069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.247227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.247384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.247530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.247683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.247843 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.247991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.248144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.248291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.248444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.248590 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.248746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.248900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.249048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.249194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.249349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.249495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.249692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.249851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.250006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.250161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.250308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.250453 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.250614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.250788 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.250947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.251095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.251249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.251425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.251425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.251712 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.251865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 09:31:47.252021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.252169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.252324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.252480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.252634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.252634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.252922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.253076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.253248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.253396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.253548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.253703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.253858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.254127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.254287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.254442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.254590 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.254782 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.254945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.255105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.255260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.255418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.255564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.255716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.255878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.255878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.256181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.256329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.256476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.256621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.256766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.256766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.257067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.257067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.257378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.257526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.257678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.257832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.257992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.258146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.258293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.258447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.259148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.259305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.259461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.259617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.260071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.260229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.260385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.260542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.260698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.260844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.260998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.261144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.261301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.261457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.261613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.261769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.261923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.262079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.262233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.262392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.262553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.262726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.262970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.263134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.263283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.263446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.263603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.263759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.263914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.264068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.264235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.264384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.264530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.264687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.264835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.264989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.265215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.265364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.265511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.265665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.265814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.265960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.266124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.266283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.266438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.266592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.266769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.266930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.267086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.267240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.267388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.267548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.267706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.267860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.268018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.268182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.268337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.268494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.268641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.268796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.268952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.269108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.269263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.269416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.269569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.269730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.269917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.270069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.270233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.270381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.270534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.270690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.270894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.271041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.271187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.271346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.271501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.271688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.271868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.272021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.272169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.272337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.272494 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.272728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.272999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.273162 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.273319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.273474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.273634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.273789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.273937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.274085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.274311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.274984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.275165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.275322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.275476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.275624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.275770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.275916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.276075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.276230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.276388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.276543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.276698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.276854 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.277013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.277173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.277328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.277477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.277642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.277799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.277947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.278101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.278101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.278388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.278543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.278754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.278910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.279078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.279234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.279388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.279543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.279704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.279857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.279857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.280194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.280352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.280515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.280669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.280817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.281581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.281738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.281885 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.282033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.282178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.282325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.282486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.282634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.282815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.282972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.283128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.283128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.283533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.283685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.283833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.283979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.284125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.284286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.284441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.284590 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.284738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.284884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.284884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.284884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.285318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.285475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.285621 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.285769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.285930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.286090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.286245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.286392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.286538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.286684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.286870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.287027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.287182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.287340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.287486 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.287654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.287812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.287967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.288114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.288268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.288430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.288583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.288749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.288911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.289064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.289217 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.289387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.289549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.289549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.289905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.290109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.290277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.290431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.290593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.290790 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.290960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.291115 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.291276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.291429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.291607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.291762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.291922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.292077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.292237 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.292390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.292551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.292705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.292857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.293009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.293171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.293171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.293481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.293653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.293813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.293975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.294129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.294281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.294443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.294603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.294784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.294784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.294784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.295315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.295466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.295630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.295795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.296178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.296349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.296502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.296652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.296758 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.296846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.296938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297487 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297676 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.297953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.298044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.298138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.298224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.298316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.298409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.298495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.298579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.298676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.298816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.298904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.299033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.299129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.299383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.299488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.299707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.299802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.300021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.300141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.300334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.300449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.300645 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.300746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.300959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.301053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.301277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.301375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.301591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.301690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.301903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.302002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.302209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.302301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.302529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.302622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.302872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.302966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.303187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.303497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.303620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.303814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.304010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.304146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.304343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.304646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.304744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.304830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.304967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.305124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.305282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.305410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.305633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.305735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.305966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.306068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.306287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.306389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.306596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.306688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.306933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.307044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.307243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.307337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.307563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.307654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.307896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.308000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.308208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.308310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.308520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.308619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.308834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.308936 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.309147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.309239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.309466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.309559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.309783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.309877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.310097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.310197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.310422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.310518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.310769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.310868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.311089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.311183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.311491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.311595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.311722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.311818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.312038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.312131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.312353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.312469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.312678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.312770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.312998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.313099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.313314 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.313575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.313752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.313929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.314032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.314245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.314338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.314567 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.314662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.315018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.315184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.315344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.315526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.315667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.315849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.315992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.316175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.316309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.316532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.316627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.316860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.316954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.317201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.317537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.317630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.317857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.318170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.318489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.318690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.318863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.319018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.319147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.319365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.319500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.319722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.319848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.320034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.320171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.320347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.320468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.320664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.320794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.320975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.321626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.321814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.321934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.322265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.322582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.322879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.323012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.323230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.323331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.323575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.323887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.324003 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.324089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.324162 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.324440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.324550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.324775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.324881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.325087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.325179 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.325399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.325512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.325747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.325853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.326059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.326158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.326395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.326484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.326734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.326840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.327076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.327187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.327400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.327488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.327907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.328018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.328099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.328171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.328394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.328510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.328707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.328814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.329018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.329116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.329323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.329432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.329635 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.329729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.329941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.330041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.330255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.330360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.330570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.330661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.330924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.331018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.331240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.331340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.331550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.331648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.331864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.331955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.332173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.332282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.332492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.332593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.332807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.332939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.333117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.333219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.333431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.333522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.333746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.333917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.334127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.334268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.334358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.334484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.334657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.334821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.334991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.335141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.335315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.335466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.335661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.335776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.335927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.336077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.336242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.336402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.336572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.337376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.337490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.337701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.337801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.338017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.338126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.338322 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.338418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.338634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.338756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.338978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.339092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.339290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.339387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.339592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.339690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.339901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.340009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.340220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.340318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.340522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.340629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.340835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.340943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.341138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.341242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.341446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.341546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.341753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.341942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.342106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.342268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.342431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.342586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.342773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.342944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.343100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.343253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.343409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.343570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.343956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.344186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.344469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.344633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.344795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.344949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.345110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.345275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.345437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.345600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.345754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.345909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.346077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.346231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.346392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.346560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.346751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.346929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.347094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.347258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.347413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.347574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.347728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.347881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.348043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.348196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.348350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.348511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.348683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.348837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.349063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.349219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.349372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.349525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.349687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.349856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.350018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.350188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.350349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.350510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.350664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.350868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.351032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.351196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.351358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.351511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.351665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.351830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.351983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.352137 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.352312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.352479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.352634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.352811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.352965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.353126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.353286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.353439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.353606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.353762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.354133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.354133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.354474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.354795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.354979 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.355143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.355322 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.355477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.355638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.355799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.355963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.356117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.356270 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.356422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.356583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.356737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.356929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.357086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.357239 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.357409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.357572 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.357733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.357896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.358052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.358214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.358374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.358535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.358698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.358888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.359043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.359197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.359350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.359521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.359684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.359853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.360006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.360168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.360331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.360485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.360649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.360803 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.360957 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.361111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.361265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.361425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.361606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.361768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.361930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.362084 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.362239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.362400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.362554 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.362757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.362930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.363085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.363248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.363416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.363581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.363734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.363734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.364259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.364434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.364599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.364786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.364950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.365112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.365266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.365430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.365598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.365760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.365930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.365930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.366233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.366396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.366552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.366731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.366899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.367053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.367225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.367394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.367557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.367718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.367897 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.368067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.368228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.368391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.368547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.368547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.368856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.368856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.369156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.369324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.369479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.369479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.369771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.369771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.370093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.370256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.370417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.370417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.370759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.370921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.371088 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.371250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.371412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.371573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.371735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.371896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.372068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.372230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.372391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.372547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.372700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.372873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.373040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.373040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.373340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.373503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.373666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.373822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.373983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.374173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.374472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.374633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.374877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.375035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.375205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.375360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.375522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.375685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.375840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.376011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.376173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.376352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.376507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.376671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.376832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.376998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.377161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.377322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.377476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.377644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.377807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.377964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.378118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.378280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.378445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.378608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.378793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.378961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.379124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.379287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.379454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.379610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.379764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.379924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.380087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.380248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.380412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.380584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.380584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.380887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.381057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.381212 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.381379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.381534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.381702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.381864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.382018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.382188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.382355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.382510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.382674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.382865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.383029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.383197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.383354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.384032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.384195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.384358 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.384667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.385099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.385264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.385430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.385585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.385755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.385910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.386080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.386234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.386388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.386542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.386731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.386894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.387060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.387224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.387388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.387544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.387709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.387876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.388047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.388209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.388364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.388519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.388680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.388848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.389004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.389165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.389327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.389489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.389651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.389824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.389985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.389985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.390287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.390449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.390605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.390796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.390965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.391127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.391290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.391290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.391593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.391756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.391921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.392074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.392227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.392382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.392545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.392708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.392863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.393017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.393178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.393341 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.393508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.393678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.393848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.394009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.394164 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.394327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.394634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.394851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.395009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.395163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.395317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.395485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.395652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.395817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.395974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.396149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.396311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.396479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.396634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.396788 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.396942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.397105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.397273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.397446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.397608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.397764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.397919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.398080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.398255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.398424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.398579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.398810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.398982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.399160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.399849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.400011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.400165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.400327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.400490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.400653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.400821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.400987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.401150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.401150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.401444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.401599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.401763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.401926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.402080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.402243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.402403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.402566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.402748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.402929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.403093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.403249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.403410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.403611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.403775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.403930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.404083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.404238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.404407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.404571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.404882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.405043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.405209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.405365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.405519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.405683 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.405838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.405993 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.406147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.406303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.406467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.406630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.406811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.406978 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.407144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.407305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.407474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.407636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.407798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.407963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.408117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.408284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.408455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.408619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.408772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.408933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.409105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.409273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.409430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.409583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.409744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.409906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.410067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.410235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.410396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.410551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.410752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.410752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.411160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.411318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.411318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.411620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.411782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.411936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.412104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.412259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.412422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.412578 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.412732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.412893 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.413070 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.413225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.413381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.413542 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.413704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.413867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.413867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.414171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.414324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.414478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.414639 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.414958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.415135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.415304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.415467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.415621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.415775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.415941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.416096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.416250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.416404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.416559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.416726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.416889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.417043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.417212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.417378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.417540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.417708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.417864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.417864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.418166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.418327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.418488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.418839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.419022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.419180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.419334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.419503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.419666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.419833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.419989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.420143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.420305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.420461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.420628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.420783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.420945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.421101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.421263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.421436 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.421604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.421768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.421922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.422077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.422238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.422392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.422560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.422752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.422915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.423071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.423236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.423410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.423576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.423730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.423883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.424042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.424206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.424375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.424540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.424703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.424868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.425121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.425284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.425448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.425603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.425769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.425769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.426071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.426234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.426407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.426570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.426753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.426915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.427071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.427237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.427405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.427560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.427732 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.427886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.428040 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.428204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.428368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.428523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.428688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.428842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.428995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.429187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.429354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.429508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.429662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.429835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.429997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.430163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.430318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.431047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.431214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.431377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.431542 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.431705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.431866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.432028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.432183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.432337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.432516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.432680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.432842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.432996 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.433162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.433330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.433498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.433654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.433808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.433962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.434117 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.434280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.434444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.434609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.434791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.434958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.435142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.435312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.435467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.435467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.435762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.435924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.436085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.436259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.436422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.436595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.436752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.436914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.437075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.437238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.437400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.437554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.437715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.437888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.438058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.438225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.438380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.438533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.438696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.438914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.439081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.439236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.439398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.439568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.439722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.439885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.440053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.440215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.440368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.440522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.440683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.440847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.441016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.441171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.441324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.441324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.441624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.441791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.441957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.442119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.442273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.442433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.442588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.442787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.442787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.443090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.443090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.443401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.443555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.443718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.443872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.444039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.444202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.444356 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.444510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.444673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.444839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.444993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.445155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.445309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.445472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.445634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.445789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.445944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.446649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.446856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.447023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.447187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.447356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.447518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.447681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.447853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.448018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.448181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.448338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.448498 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.448653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.448821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.448977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.449131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.449285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.449452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.449618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.449851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.450009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.450163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.450327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.450489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.450651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.450840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.450956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.451994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.452992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453460 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.453936 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454727 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.454978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.455932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.456919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.457993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.458085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.458169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.458261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.458345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.458437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.458532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.458624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.458726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.458813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.458998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.459228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.459228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.459543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.459699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.459855 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.460024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.460186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.460342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.460496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.460658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.460821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.460985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.461158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.461342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.461499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.461684 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.461862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.462028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.462184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.462346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.462501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.462656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.462885 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.463052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.463250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.463421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.463584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.463738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.463902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.464059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.464212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.464374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.464528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.464693 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.464862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.465026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.465188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.465342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.465507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.465676 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.465840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.465996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.466159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.466314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.466506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.466677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.466877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.467038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.467194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.467366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.467548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.467713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.467876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.468037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.468193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.468348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.468511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.468674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.468836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.468991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.469153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.469309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.469472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.469653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.469809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.469972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.470126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.470282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.470451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.470451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 09:31:47.470766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.470766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.470766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.470766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.471400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.471400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.471703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.471898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.472230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.472545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.472876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.473206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.473556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.473873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.474220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.474554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.474895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.475213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.475524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 09:31:47.475769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 09:31:47.531822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO dbcounter [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Registered counter for database nova_api Sep 02 09:31:47.537795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO dbcounter [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Registered counter for database nova_api Sep 02 09:31:47.552952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_db.sqlalchemy.engines [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:31:47.558048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_db.sqlalchemy.engines [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:31:47.560357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writer thread running {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:31:47.564548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writer thread running {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:31:47.616642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.context [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4302fafa-fa9b-40be-bbd3-4d18650e680f(cell1) {{(pid=127533) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 09:31:47.620939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.context [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4302fafa-fa9b-40be-bbd3-4d18650e680f(cell1) {{(pid=127531) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 09:31:47.621197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:31:47.621674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:31:47.623299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:31:47.624019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:31:47.624461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:31:47.624912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:31:47.625391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:31:47.626466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:31:47.626980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:31:47.627709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:31:47.628157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:31:47.628447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO dbcounter [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Registered counter for database nova_cell0 Sep 02 09:31:47.630167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:31:47.632169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO dbcounter [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Registered counter for database nova_cell0 Sep 02 09:31:47.632571 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO dbcounter [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Registered counter for database nova_cell1 Sep 02 09:31:47.636974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO dbcounter [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Registered counter for database nova_cell1 Sep 02 09:31:47.642127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_db.sqlalchemy.engines [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:31:47.643100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_db.sqlalchemy.engines [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:31:47.646015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_db.sqlalchemy.engines [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:31:47.646831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_db.sqlalchemy.engines [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:31:47.651161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writer thread running {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:31:47.651708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writer thread running {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:31:47.654688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writer thread running {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:31:47.655052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writer thread running {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:31:47.801526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO dbcounter [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Registered counter for database nova_cell0 Sep 02 09:31:47.803581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO dbcounter [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Registered counter for database nova_cell0 Sep 02 09:31:47.813659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_db.sqlalchemy.engines [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:31:47.816610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_db.sqlalchemy.engines [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 09:31:47.818419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writer thread running {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:31:47.821837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writer thread running {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 09:31:48.139800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: WARNING keystonemiddleware.auth_token [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:31:48.140942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: WARNING keystonemiddleware.auth_token [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:31:48.147186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: WARNING keystonemiddleware.auth_token [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:31:48.148317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: WARNING keystonemiddleware.auth_token [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:31:48.496818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: WARNING keystonemiddleware.auth_token [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:31:48.500854 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: WARNING keystonemiddleware.auth_token [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 09:31:48.502915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: WARNING keystonemiddleware.auth_token [None req-205b52bc-a0dd-49d8-aba6-52eb95a93e71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:31:48.506895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: WARNING keystonemiddleware.auth_token [None req-23fd0d94-7758-42a1-bf70-22177a0c7cfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 09:31:48.508261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5644743a79c0 pid: 127531 (default app) Sep 02 09:31:48.513180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5644743a79c0 pid: 127533 (default app) Sep 02 09:32:25.479313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:25.484038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:25.484038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:25.484038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:25.588397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:25.589293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:25.590098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:25.590958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:27.144063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-51040739-44a6-4157-bd56-4dcc9c86e611 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Action: 'create', calling method: .version_select at 0x7f4e5d329700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-443767278", "metadata": {"Type": "work"}}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:27.301489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7652920c-d0f8-4598-86ba-a60fa15f6823 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Action: 'create', calling method: .version_select at 0x7f4e5d32a700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-345288344"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:30.232157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7652920c-d0f8-4598-86ba-a60fa15f6823 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.762646 Sep 02 09:32:30.232157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1155 bytes} [Fri Sep 2 09:32:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4765 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 09:32:30.247314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5eb2e0de-69aa-42e1-b2bb-38800807f450 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d1ff550>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:30.499152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5eb2e0de-69aa-42e1-b2bb-38800807f450 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b" status: 200 len: 344 microversion: 2.1 time: 0.258164 Sep 02 09:32:30.501076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 2/2] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:30 2022] GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b => generated 344 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:32:30.648998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-51040739-44a6-4157-bd56-4dcc9c86e611 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 5.066276 Sep 02 09:32:30.650069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1156 bytes} [Fri Sep 2 09:32:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 5069 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 02 09:32:30.665452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a5acaeb3-a05d-4d14-8490-84fc3decb7cc tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d1ffc10>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:30.832483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a5acaeb3-a05d-4d14-8490-84fc3decb7cc tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 352 microversion: 2.1 time: 0.171193 Sep 02 09:32:30.833378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:30 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 352 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:31.516874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c002ea8a-344e-404f-852a-8f4e3dfb9174 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d1fb550>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:31.606122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c002ea8a-344e-404f-852a-8f4e3dfb9174 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b" status: 200 len: 344 microversion: 2.1 time: 0.093570 Sep 02 09:32:31.608289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 2/5] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:31 2022] GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b => generated 344 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:31.850801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-306d2348-1781-4d88-a80d-9466608a5dd5 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d1963a0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:32.186854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-306d2348-1781-4d88-a80d-9466608a5dd5 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 352 microversion: 2.1 time: 0.343407 Sep 02 09:32:32.199870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 4/6] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:31 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 352 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:32.621397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9eec0cba-221d-43f0-b42a-fdbbbee7ad3c tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d1fbca0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:32.806371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9eec0cba-221d-43f0-b42a-fdbbbee7ad3c tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b" status: 200 len: 345 microversion: 2.1 time: 0.189210 Sep 02 09:32:32.807036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:32 2022] GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b => generated 345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:32.821626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b3057561-8157-4c33-92a2-3392975a37da tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Action: 'create', calling method: .version_select at 0x7f4e5d1ffe50>, body: {"snapshot": {"volume_id": "1cb6e12c-3e2b-4558-b873-a6bc4a00c50b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1868478289"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:33.208601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-512d4a7a-b4e6-4a94-b957-4d1a2f6ac893 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d20e3a0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:33.322588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-512d4a7a-b4e6-4a94-b957-4d1a2f6ac893 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 353 microversion: 2.1 time: 0.118669 Sep 02 09:32:33.323822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:33 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:33.341463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b50eca98-0289-44fd-a95d-4db93a6f2b71 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d1fbd30>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:33.440251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b50eca98-0289-44fd-a95d-4db93a6f2b71 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 353 microversion: 2.1 time: 0.106477 Sep 02 09:32:33.441154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 5/9] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:33 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:33.470494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f636e4f1-e748-4ce8-810c-316d49e016e3 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d1fb5e0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:33.612736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b3057561-8157-4c33-92a2-3392975a37da tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.795581 Sep 02 09:32:33.618966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 5/10] 10.222.0.57 () {60 vars in 1162 bytes} [Fri Sep 2 09:32:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:33.623328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d2072033-9810-45a1-aa34-5219e86a801f tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d1961f0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:33.698582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d2072033-9810-45a1-aa34-5219e86a801f tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 200 len: 287 microversion: 2.1 time: 0.078835 Sep 02 09:32:33.702744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 6/11] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:33 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:32:33.710538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-325e8c31-8275-44f0-9885-c37a99e58869 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d196dc0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:33.776265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-325e8c31-8275-44f0-9885-c37a99e58869 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.067418 Sep 02 09:32:33.784191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 7/12] 10.222.0.57 () {58 vars in 1140 bytes} [Fri Sep 2 09:32:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:32:33.801181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-677fbf2e-ba52-46eb-b7ce-eba55738f62b tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d1ff790>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:33.838606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f636e4f1-e748-4ce8-810c-316d49e016e3 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 202 len: 0 microversion: 2.1 time: 0.380069 Sep 02 09:32:33.841542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 6/13] 10.222.0.57 () {58 vars in 1248 bytes} [Fri Sep 2 09:32:33 2022] DELETE /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:32:33.859264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e29b5c4c-4cd9-4897-8f05-8f024c0171ec tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d20e310>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:33.875331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-677fbf2e-ba52-46eb-b7ce-eba55738f62b tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 200 len: 287 microversion: 2.1 time: 0.087597 Sep 02 09:32:33.883172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 8/14] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:33 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:32:33.975544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e29b5c4c-4cd9-4897-8f05-8f024c0171ec tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 352 microversion: 2.1 time: 0.128983 Sep 02 09:32:33.982517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 7/15] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:33 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:34.891059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-60a43dcf-9ef7-4794-8dbf-dddd2c362b4f tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d1ffee0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:34.993714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cff408fc-527d-4973-9f0c-b3996506707b tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d1fb700>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:35.049314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-60a43dcf-9ef7-4794-8dbf-dddd2c362b4f tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 200 len: 287 microversion: 2.1 time: 0.161896 Sep 02 09:32:35.049901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 9/16] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:34 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:35.096538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cff408fc-527d-4973-9f0c-b3996506707b tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 352 microversion: 2.1 time: 0.110575 Sep 02 09:32:35.103071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 8/17] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:34 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:32:35.869776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-576b7e32-f612-43d2-ae71-7f6c7e9ba5c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Action: 'create', calling method: .version_select at 0x7f4e5d196940>, body: {"keypair": {"name": "tempest-keypair-1637250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEudoS2rB7zMlidmb4B2/rOEIZgIUdNC4bKcdqZYZEAhMBCTUnJBP/1HYJOkdwoPP5tJG6RFpzTCs2+zzmZIURyZ5L43WvRrp3eTjKnyS0qxQY6RnLm+SuhCBQPmlFr82A=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:36.004691 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-576b7e32-f612-43d2-ae71-7f6c7e9ba5c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Getting quotas for project ea33fe1eaf1047f78312a8e9fa9152c4. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:32:36.014689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-576b7e32-f612-43d2-ae71-7f6c7e9ba5c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Getting quotas for user f65429de28ae41578c51a6b9099fea5c and project ea33fe1eaf1047f78312a8e9fa9152c4. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:32:36.064117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-efda21d2-2535-4804-9aba-ac6183a47a61 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d1fbe50>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:36.136489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-efda21d2-2535-4804-9aba-ac6183a47a61 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 200 len: 287 microversion: 2.1 time: 0.077384 Sep 02 09:32:36.144033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 9/18] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:36 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:36.149950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fe0f6516-607d-4c72-8daf-386054714b78 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d20e0d0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:36.184413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-576b7e32-f612-43d2-ae71-7f6c7e9ba5c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.652920 Sep 02 09:32:36.190810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 10/19] 10.222.0.57 () {60 vars in 1159 bytes} [Fri Sep 2 09:32:35 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:36.252508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fe0f6516-607d-4c72-8daf-386054714b78 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 352 microversion: 2.1 time: 0.107050 Sep 02 09:32:36.262351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 10/20] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:36 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:37.151564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b9422e73-565a-42d9-af51-676f8de793c4 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d16fca0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:37.198215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b9422e73-565a-42d9-af51-676f8de793c4 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 200 len: 287 microversion: 2.1 time: 0.050698 Sep 02 09:32:37.198814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 11/21] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:37 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:37.268650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2ae51ddc-71ae-474c-a750-2004f7cd699d tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d1fbee0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:37.380858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2ae51ddc-71ae-474c-a750-2004f7cd699d tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 352 microversion: 2.1 time: 0.117693 Sep 02 09:32:37.387268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 11/22] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:37 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:38.212513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6009552f-25d0-43b4-9588-0ae42f76a2bc tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d1203a0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:38.303600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6009552f-25d0-43b4-9588-0ae42f76a2bc tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 200 len: 287 microversion: 2.1 time: 0.094922 Sep 02 09:32:38.304457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:38 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:38.394268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ccb9373b-9d47-4e76-863f-68d69433706c tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d1fb790>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:38.510737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ccb9373b-9d47-4e76-863f-68d69433706c tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 352 microversion: 2.1 time: 0.120356 Sep 02 09:32:38.511640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:38 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:39.318546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-94391d8d-a5c1-4c8a-b383-36042a1df351 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d20e550>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:39.379603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-94391d8d-a5c1-4c8a-b383-36042a1df351 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 200 len: 287 microversion: 2.1 time: 0.066223 Sep 02 09:32:39.381563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 13/25] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:39 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:39.525935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3c2a1a32-992e-4342-ad25-35b20d5c2e9d tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d20eb80>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:39.666364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3c2a1a32-992e-4342-ad25-35b20d5c2e9d tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 352 microversion: 2.1 time: 0.145396 Sep 02 09:32:39.666972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 14/26] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:39 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:32:40.236294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1571903155", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:40.392852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4659e841-7632-4308-90a3-9832013a8571 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d1fb310>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:40.410120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] validate_networks() for [('6039bcf1-9eb4-424a-b518-61e41a24db11', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:32:40.440018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4659e841-7632-4308-90a3-9832013a8571 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 200 len: 287 microversion: 2.1 time: 0.050992 Sep 02 09:32:40.446345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 15/27] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:40 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:40.681495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2c9293b4-9a55-4d56-8e02-f05e1b45e605 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5d1fbc10>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:40.771145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2c9293b4-9a55-4d56-8e02-f05e1b45e605 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 200 len: 352 microversion: 2.1 time: 0.094751 Sep 02 09:32:40.771925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 16/28] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:40 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:41.358783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2064479691", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "networks": [{"uuid": "87a878d2-9c75-4206-a67b-b75578e7dce0"}]}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:41.515952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.network.neutron [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] validate_networks() for [('87a878d2-9c75-4206-a67b-b75578e7dce0', None, None, None, None, None)] {{(pid=127533) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:32:42.052689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:32:42.053133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:32:42.053710 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:32:42.054402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:32:42.054980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:32:42.068519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:42.069379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:42.070040 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:42.070852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:42.071489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:42.071919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:42.124546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Getting quotas for project c2945ae512e14bfbb7d02dedc4de7cd4. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:32:42.128966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Getting quotas for user c79aaf1f72634eefb5e89c8005afe54b and project c2945ae512e14bfbb7d02dedc4de7cd4. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:32:42.149013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:32:42.153488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:32:42.330881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1510ea37-f403-4110-9d5b-7ed28a982355 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.054866 Sep 02 09:32:42.339970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 13/29] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 09:32:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:32:42.345300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cf1b118c-0ef3-423a-8586-d1937a812b41 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d0a49d0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:42.421708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cf1b118c-0ef3-423a-8586-d1937a812b41 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 200 len: 288 microversion: 2.1 time: 0.080402 Sep 02 09:32:42.422282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 14/30] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:42 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 288 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:42.427028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Flavor limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:32:42.428496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Image limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:32:42.429276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Flavor pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:32:42.429696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Image pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:32:42.430214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:32:42.434904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1223574817", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03a44734-2ee4-42c1-bac2-2865fbb1a5aa"}], "security_groups": [{"name": "tempest-securitygroup--1257762377"}], "key_name": "tempest-keypair-1637250", "user_data": "}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:42.446567 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:42.447360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:42.447801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:42.448688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:42.449282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:42.449714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:42.481060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Getting quotas for project e553fe4257cc4983ac82027b05a53e65. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:32:42.488221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Getting quotas for user d4d4f092761d44a2a30f0e1d044888b6 and project e553fe4257cc4983ac82027b05a53e65. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:32:42.503620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Going to run 1 instances... {{(pid=127533) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:32:42.507591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127533) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:32:42.611060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] validate_networks() for [('03a44734-2ee4-42c1-bac2-2865fbb1a5aa', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:32:42.946691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-00ad4668-3a52-429c-9817-54f58c2f4478 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.025304 Sep 02 09:32:42.952871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 17/31] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 09:32:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 09:32:42.954405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-df72cc04-52cf-4740-bd6c-12710439e152 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Calling method '.version_select at 0x7f4e5c8a51f0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:43.292421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:32:43.292421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:32:43.293307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:32:43.293307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:32:43.296533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:32:43.305317 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-df72cc04-52cf-4740-bd6c-12710439e152 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] HTTP exception thrown: Volume deb883e5-726a-4bdb-ae69-12bba4a80845 could not be found. Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-df72cc04-52cf-4740-bd6c-12710439e152 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Request method failure captured: Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 HTTP/1.1 Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc2pipZ9_xCBbr0IjcJAUe5ahMxKEvYYkE2XFS3Cfbp4SbrJmCiJFjiPbVzY3Jm4LBl7IzbmEncmANXIJrVPhNlboKvAGf1DUjXBZki2zNvG8yOoFfvtXSUUSG03OMBvIOLM7iBqqjpOaBFvUe1EQVZ7PCQsLhdLO2vdWP6Nsp5YB8c Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 7f784a9048784529aaf1febe6fe1322d Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesGetTestJSON-878209222 Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:32:43.311688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7f784a9048784529aaf1febe6fe1322d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7f784a9048784529aaf1febe6fe1322d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7f784a9048784529aaf1febe6fe1322d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7f784a9048784529aaf1febe6fe1322d", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesGetTestJSON-878209222 Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 7f784a9048784529aaf1febe6fe1322d Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesGetTestJSON-878209222 Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesGetTestJSON-878209222-project Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 4d632542a6e24e84ab479f1ac1eed112 Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesGetTestJSON-878209222-project Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Volume deb883e5-726a-4bdb-ae69-12bba4a80845 could not be found. Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': 'deb883e5-726a-4bdb-ae69-12bba4a80845'} Sep 02 09:32:43.314060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume deb883e5-726a-4bdb-ae69-12bba4a80845 could not be found. (HTTP 404) (Request-ID: req-f7f9e75c-cf91-4127-8ee0-da26aae0808e) Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:43.314997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:32:43.316538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume deb883e5-726a-4bdb-ae69-12bba4a80845 could not be found. Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 09:32:43.318348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume deb883e5-726a-4bdb-ae69-12bba4a80845 could not be found. Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume deb883e5-726a-4bdb-ae69-12bba4a80845 could not be found. Sep 02 09:32:43.319706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:43.320405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:43.320498 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-df72cc04-52cf-4740-bd6c-12710439e152 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] Returning 404 to user: Volume deb883e5-726a-4bdb-ae69-12bba4a80845 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:32:43.321323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:43.321323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:43.321527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-df72cc04-52cf-4740-bd6c-12710439e152 tempest-VolumesGetTestJSON-878209222 tempest-VolumesGetTestJSON-878209222-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845" status: 404 len: 109 microversion: 2.1 time: 0.365040 Sep 02 09:32:43.321611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:43.321699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 18/32] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:42 2022] GET /compute/v2.1/os-volumes/deb883e5-726a-4bdb-ae69-12bba4a80845 => generated 109 bytes in 366 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:32:43.321784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:43.321784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:43.321973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dbaaf490-33b4-48e4-b9e7-000242139085 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:43.321973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dbaaf490-33b4-48e4-b9e7-000242139085 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:43.415839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Getting quotas for project ea33fe1eaf1047f78312a8e9fa9152c4. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:32:43.423721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Getting quotas for user f65429de28ae41578c51a6b9099fea5c and project ea33fe1eaf1047f78312a8e9fa9152c4. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:32:43.451445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:32:43.456080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:32:43.469889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dbaaf490-33b4-48e4-b9e7-000242139085 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:43.492646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dbaaf490-33b4-48e4-b9e7-000242139085 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1222 microversion: 2.1 time: 0.177091 Sep 02 09:32:43.493636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 19/33] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:43 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:43.517353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b5d4cb31-5d9c-4b30-81cf-383eb37f5de6 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5c83adc0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:43.680057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b5d4cb31-5d9c-4b30-81cf-383eb37f5de6 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 202 len: 0 microversion: 2.1 time: 0.185303 Sep 02 09:32:43.680674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 20/34] 10.222.0.57 () {58 vars in 1254 bytes} [Fri Sep 2 09:32:43 2022] DELETE /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:32:43.689984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a5ab573a-597a-4492-893c-d1cd4538c1ec tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:43.690605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a5ab573a-597a-4492-893c-d1cd4538c1ec tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:43.709421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-12eb0e61-2c32-45b3-88fc-55a82b83279e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.285034 Sep 02 09:32:43.710147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 15/35] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 09:32:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:32:43.717456 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-57c30acf-7539-4b2c-8bbe-b2e4dbac583a tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5d120dc0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:43.765925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-57c30acf-7539-4b2c-8bbe-b2e4dbac583a tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 200 len: 287 microversion: 2.1 time: 0.054079 Sep 02 09:32:43.768199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 16/36] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:43 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:43.777524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a97b7dcb-c606-4e0b-89d0-e9b061631c0a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:43.780060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a5ab573a-597a-4492-893c-d1cd4538c1ec tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:43.780277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a97b7dcb-c606-4e0b-89d0-e9b061631c0a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:43.788780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a5ab573a-597a-4492-893c-d1cd4538c1ec tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1215 microversion: 2.1 time: 0.107092 Sep 02 09:32:43.790933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 21/37] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:43 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:43.910660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1370638279", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:44.000344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a97b7dcb-c606-4e0b-89d0-e9b061631c0a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:44.053288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.network.neutron [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] validate_networks() for [('6039bcf1-9eb4-424a-b518-61e41a24db11', None, None, None, None, None)] {{(pid=127533) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:32:44.059920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a97b7dcb-c606-4e0b-89d0-e9b061631c0a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1235 microversion: 2.1 time: 0.290297 Sep 02 09:32:44.063756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 17/38] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:43 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1235 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:44.727036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Flavor limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:32:44.727658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Image limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:32:44.727970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Flavor pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:32:44.728376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Image pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:32:44.728794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:32:44.745134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:44.745356 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:44.747379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:44.748886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:44.750544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:44.751028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:44.781012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-16d0a402-ade1-45f8-8819-bc3cd4cd0760 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5c856ca0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:44.794295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Getting quotas for project c2945ae512e14bfbb7d02dedc4de7cd4. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:32:44.821580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Getting quotas for user c79aaf1f72634eefb5e89c8005afe54b and project c2945ae512e14bfbb7d02dedc4de7cd4. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:32:44.836723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Going to run 1 instances... {{(pid=127533) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:32:44.839993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127533) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:32:44.905804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-16d0a402-ade1-45f8-8819-bc3cd4cd0760 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] HTTP exception thrown: Snapshot f42db8d3-18ec-4123-9fb9-619d7f3b705d could not be found. Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-16d0a402-ade1-45f8-8819-bc3cd4cd0760 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Request method failure captured: Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d HTTP/1.1 Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc2ppU9ZpsmxKFmu8E3lr-ezTd608wRkPf3UXGz0sMufGxK7I6nfZ5CfR1GHpvqvr_bAp0MwVgvCVMeJoe0wUQRA8F7g7RgGc3Ivp9se0sxpI9VbGbemjGEabhgywH8CM4pok-B2Y0qYNAdfVZlXvBNWyvwrB8zwYAeQu4Sq3GF0PO4 Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 2f0e11fc747c4619a370655d8b489cd4 Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:32:44.912501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2f0e11fc747c4619a370655d8b489cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 2f0e11fc747c4619a370655d8b489cd4 Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesSnapshotsTestJSON-1828127283-project Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 9d0680d3e3644bb4a52e140a12f5f54d Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1828127283-project Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Snapshot f42db8d3-18ec-4123-9fb9-619d7f3b705d could not be found. Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'f42db8d3-18ec-4123-9fb9-619d7f3b705d'} Sep 02 09:32:44.913914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f42db8d3-18ec-4123-9fb9-619d7f3b705d could not be found. (HTTP 404) (Request-ID: req-befae968-7e2e-441f-852e-a077d87eaf00) Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:44.914867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:32:44.916015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f42db8d3-18ec-4123-9fb9-619d7f3b705d could not be found. Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 02 09:32:44.917062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f42db8d3-18ec-4123-9fb9-619d7f3b705d could not be found. Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f42db8d3-18ec-4123-9fb9-619d7f3b705d could not be found. Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-16d0a402-ade1-45f8-8819-bc3cd4cd0760 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Returning 404 to user: Snapshot f42db8d3-18ec-4123-9fb9-619d7f3b705d could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:32:44.918189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-16d0a402-ade1-45f8-8819-bc3cd4cd0760 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d" status: 404 len: 111 microversion: 2.1 time: 0.138006 Sep 02 09:32:44.918891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 18/39] 10.222.0.57 () {58 vars in 1251 bytes} [Fri Sep 2 09:32:44 2022] GET /compute/v2.1/os-snapshots/f42db8d3-18ec-4123-9fb9-619d7f3b705d => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:32:44.934640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-12faa4a2-e10b-49a7-bb68-6b95a7564a11 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:44.934640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-12faa4a2-e10b-49a7-bb68-6b95a7564a11 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:44.994157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-12faa4a2-e10b-49a7-bb68-6b95a7564a11 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:45.019457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-12faa4a2-e10b-49a7-bb68-6b95a7564a11 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1215 microversion: 2.1 time: 0.099178 Sep 02 09:32:45.020042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 19/40] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:44 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:45.037713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-afff7c1d-ff7c-493a-bad1-dbca3e0b838b tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5c7d6ca0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:45.075351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f35fc71d-4ab6-4a00-8280-92a64d4b07b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.164011 Sep 02 09:32:45.076067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 22/41] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 09:32:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 09:32:45.095671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f0607716-1f06-4b9a-98b1-6ea9d2c1a243 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:45.104262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f0607716-1f06-4b9a-98b1-6ea9d2c1a243 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:45.292000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f0607716-1f06-4b9a-98b1-6ea9d2c1a243 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:45.294310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f0607716-1f06-4b9a-98b1-6ea9d2c1a243 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1235 microversion: 2.1 time: 0.212991 Sep 02 09:32:45.296625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 23/42] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:45 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1235 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:45.312045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8e8f58a9-eed1-4987-b718-bf09c1eef9cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:45.312670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8e8f58a9-eed1-4987-b718-bf09c1eef9cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:45.447214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8e8f58a9-eed1-4987-b718-bf09c1eef9cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:45.454456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8e8f58a9-eed1-4987-b718-bf09c1eef9cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1222 microversion: 2.1 time: 0.156369 Sep 02 09:32:45.456667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 24/43] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:45 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:45.472995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-afff7c1d-ff7c-493a-bad1-dbca3e0b838b tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b" status: 202 len: 0 microversion: 2.1 time: 0.444874 Sep 02 09:32:45.473587 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 20/44] 10.222.0.57 () {58 vars in 1248 bytes} [Fri Sep 2 09:32:45 2022] DELETE /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:32:45.483999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-df48a274-f98d-4e0b-9cf1-f133fdf3b9ea tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5c845a60>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:45.594411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-df48a274-f98d-4e0b-9cf1-f133fdf3b9ea tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b" status: 200 len: 344 microversion: 2.1 time: 0.114816 Sep 02 09:32:45.595487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 25/45] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:45 2022] GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b => generated 344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:46.041515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7f1f697f-806f-442e-ba52-6fc0f8f5b03e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:46.043901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7f1f697f-806f-442e-ba52-6fc0f8f5b03e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:46.051589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f1f697f-806f-442e-ba52-6fc0f8f5b03e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:46.052695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f1f697f-806f-442e-ba52-6fc0f8f5b03e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:46.053560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f1f697f-806f-442e-ba52-6fc0f8f5b03e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:46.054496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f1f697f-806f-442e-ba52-6fc0f8f5b03e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:46.055409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f1f697f-806f-442e-ba52-6fc0f8f5b03e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:46.056029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f1f697f-806f-442e-ba52-6fc0f8f5b03e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:46.321099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-115ef927-c58f-46da-a031-04f8111b79ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:46.327685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-115ef927-c58f-46da-a031-04f8111b79ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:46.337489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-115ef927-c58f-46da-a031-04f8111b79ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:46.343923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-115ef927-c58f-46da-a031-04f8111b79ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:46.347528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-115ef927-c58f-46da-a031-04f8111b79ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:46.349283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-115ef927-c58f-46da-a031-04f8111b79ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:46.350075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-115ef927-c58f-46da-a031-04f8111b79ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:46.362289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-115ef927-c58f-46da-a031-04f8111b79ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:46.435526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7f1f697f-806f-442e-ba52-6fc0f8f5b03e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:46.451365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7f1f697f-806f-442e-ba52-6fc0f8f5b03e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1211 microversion: 2.1 time: 0.415195 Sep 02 09:32:46.461749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 21/46] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:46 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1211 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:46.478082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-620f8575-c2d3-48ac-8740-b1bd86f63abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:46.479030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-620f8575-c2d3-48ac-8740-b1bd86f63abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:46.488921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620f8575-c2d3-48ac-8740-b1bd86f63abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:46.491000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620f8575-c2d3-48ac-8740-b1bd86f63abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:46.491622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620f8575-c2d3-48ac-8740-b1bd86f63abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:46.496149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620f8575-c2d3-48ac-8740-b1bd86f63abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:46.497057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620f8575-c2d3-48ac-8740-b1bd86f63abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:46.499405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-620f8575-c2d3-48ac-8740-b1bd86f63abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:46.711774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-115ef927-c58f-46da-a031-04f8111b79ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:46.736955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-115ef927-c58f-46da-a031-04f8111b79ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1231 microversion: 2.1 time: 0.420980 Sep 02 09:32:46.755742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 26/47] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:46 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1231 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:46.757779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-620f8575-c2d3-48ac-8740-b1bd86f63abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:46.767734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ce0a21eb-aee0-4483-9f1f-8de819cedbe4 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5c7bfe50>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:46.782147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-620f8575-c2d3-48ac-8740-b1bd86f63abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1226 microversion: 2.1 time: 0.308519 Sep 02 09:32:46.785025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 22/48] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:46 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1226 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:46.847773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-ce0a21eb-aee0-4483-9f1f-8de819cedbe4 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] HTTP exception thrown: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ce0a21eb-aee0-4483-9f1f-8de819cedbe4 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Request method failure captured: Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b HTTP/1.1 Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc2ppU9ZpsmxKFmu8E3lr-ezTd608wRkPf3UXGz0sMufGxK7I6nfZ5CfR1GHpvqvr_bAp0MwVgvCVMeJoe0wUQRA8F7g7RgGc3Ivp9se0sxpI9VbGbemjGEabhgywH8CM4pok-B2Y0qYNAdfVZlXvBNWyvwrB8zwYAeQu4Sq3GF0PO4 Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 2f0e11fc747c4619a370655d8b489cd4 Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:32:46.851869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2f0e11fc747c4619a370655d8b489cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 2f0e11fc747c4619a370655d8b489cd4 Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesSnapshotsTestJSON-1828127283-project Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 9d0680d3e3644bb4a52e140a12f5f54d Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1828127283-project Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '1cb6e12c-3e2b-4558-b873-a6bc4a00c50b'} Sep 02 09:32:46.853069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. (HTTP 404) (Request-ID: req-dc303310-b1f1-422b-82e4-6700c2c5a9d0) Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:46.853756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:32:46.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 09:32:46.856969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:46.859352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.863046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ce0a21eb-aee0-4483-9f1f-8de819cedbe4 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Returning 404 to user: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:32:46.864325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ce0a21eb-aee0-4483-9f1f-8de819cedbe4 tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b" status: 404 len: 109 microversion: 2.1 time: 0.104641 Sep 02 09:32:46.865912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 27/49] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:46 2022] GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:32:46.885913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a25e09d9-6aa7-4735-96cb-e6e481bf9e2d tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5c756940>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:46.967355 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-a25e09d9-6aa7-4735-96cb-e6e481bf9e2d tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] HTTP exception thrown: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a25e09d9-6aa7-4735-96cb-e6e481bf9e2d tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Request method failure captured: Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b HTTP/1.1 Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc2ppU9ZpsmxKFmu8E3lr-ezTd608wRkPf3UXGz0sMufGxK7I6nfZ5CfR1GHpvqvr_bAp0MwVgvCVMeJoe0wUQRA8F7g7RgGc3Ivp9se0sxpI9VbGbemjGEabhgywH8CM4pok-B2Y0qYNAdfVZlXvBNWyvwrB8zwYAeQu4Sq3GF0PO4 Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 2f0e11fc747c4619a370655d8b489cd4 Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:32:46.970471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2f0e11fc747c4619a370655d8b489cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 2f0e11fc747c4619a370655d8b489cd4 Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesSnapshotsTestJSON-1828127283-project Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 9d0680d3e3644bb4a52e140a12f5f54d Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1828127283-project Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '1cb6e12c-3e2b-4558-b873-a6bc4a00c50b'} Sep 02 09:32:46.972511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. (HTTP 404) (Request-ID: req-a02172de-1d54-43db-be8f-8b7a4e879fe1) Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:46.973357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 09:32:46.975143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 09:32:46.976286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:46.977799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:32:46.979514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a25e09d9-6aa7-4735-96cb-e6e481bf9e2d tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Returning 404 to user: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:32:46.980979 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a25e09d9-6aa7-4735-96cb-e6e481bf9e2d tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b" status: 404 len: 109 microversion: 2.1 time: 0.100649 Sep 02 09:32:46.982005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 23/50] 10.222.0.57 () {58 vars in 1248 bytes} [Fri Sep 2 09:32:46 2022] DELETE /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:32:46.990432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a5c4ebe7-72f1-4ee5-aa97-0ff05ee068cd tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Calling method '.version_select at 0x7f4e5c7bfa60>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:47.030865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-a5c4ebe7-72f1-4ee5-aa97-0ff05ee068cd tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] HTTP exception thrown: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a5c4ebe7-72f1-4ee5-aa97-0ff05ee068cd tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Request method failure captured: Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b HTTP/1.1 Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc2ppU9ZpsmxKFmu8E3lr-ezTd608wRkPf3UXGz0sMufGxK7I6nfZ5CfR1GHpvqvr_bAp0MwVgvCVMeJoe0wUQRA8F7g7RgGc3Ivp9se0sxpI9VbGbemjGEabhgywH8CM4pok-B2Y0qYNAdfVZlXvBNWyvwrB8zwYAeQu4Sq3GF0PO4 Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 2f0e11fc747c4619a370655d8b489cd4 Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:32:47.032968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2f0e11fc747c4619a370655d8b489cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2f0e11fc747c4619a370655d8b489cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 2f0e11fc747c4619a370655d8b489cd4 Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1828127283 Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesSnapshotsTestJSON-1828127283-project Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 9d0680d3e3644bb4a52e140a12f5f54d Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1828127283-project Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '1cb6e12c-3e2b-4558-b873-a6bc4a00c50b'} Sep 02 09:32:47.034127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. (HTTP 404) (Request-ID: req-54dfac8e-1bf1-48d8-b61a-78270492c123) Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:47.034897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 09:32:47.035816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 09:32:47.038676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a5c4ebe7-72f1-4ee5-aa97-0ff05ee068cd tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] Returning 404 to user: Volume 1cb6e12c-3e2b-4558-b873-a6bc4a00c50b could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a5c4ebe7-72f1-4ee5-aa97-0ff05ee068cd tempest-VolumesSnapshotsTestJSON-1828127283 tempest-VolumesSnapshotsTestJSON-1828127283-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b" status: 404 len: 109 microversion: 2.1 time: 0.048024 Sep 02 09:32:47.040180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 28/51] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 09:32:46 2022] GET /compute/v2.1/os-volumes/1cb6e12c-3e2b-4558-b873-a6bc4a00c50b => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:32:47.491027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-23b61171-9a19-4eb7-a1f8-e5c896d97432 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:47.491602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-23b61171-9a19-4eb7-a1f8-e5c896d97432 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:47.517980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23b61171-9a19-4eb7-a1f8-e5c896d97432 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:47.518728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23b61171-9a19-4eb7-a1f8-e5c896d97432 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:47.521538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23b61171-9a19-4eb7-a1f8-e5c896d97432 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:47.525108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23b61171-9a19-4eb7-a1f8-e5c896d97432 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:47.525824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23b61171-9a19-4eb7-a1f8-e5c896d97432 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:47.526450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23b61171-9a19-4eb7-a1f8-e5c896d97432 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:47.623116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-23b61171-9a19-4eb7-a1f8-e5c896d97432 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:47.644618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-23b61171-9a19-4eb7-a1f8-e5c896d97432 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1267 microversion: 2.1 time: 0.159003 Sep 02 09:32:47.645198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 24/52] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:47 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:47.795247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f9b404d2-a09e-4284-aabd-330bb95d55c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:47.797108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f9b404d2-a09e-4284-aabd-330bb95d55c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:47.811140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b404d2-a09e-4284-aabd-330bb95d55c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:47.815221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8843b570-bf0b-4d18-81bb-04792312c6c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:47.818849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8843b570-bf0b-4d18-81bb-04792312c6c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:47.822022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b404d2-a09e-4284-aabd-330bb95d55c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:47.822531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b404d2-a09e-4284-aabd-330bb95d55c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:47.823267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b404d2-a09e-4284-aabd-330bb95d55c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:47.823725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b404d2-a09e-4284-aabd-330bb95d55c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:47.824156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b404d2-a09e-4284-aabd-330bb95d55c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:47.842310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8843b570-bf0b-4d18-81bb-04792312c6c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:47.844204 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8843b570-bf0b-4d18-81bb-04792312c6c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:47.847547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8843b570-bf0b-4d18-81bb-04792312c6c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:47.851177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8843b570-bf0b-4d18-81bb-04792312c6c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:47.854410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8843b570-bf0b-4d18-81bb-04792312c6c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:47.855657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8843b570-bf0b-4d18-81bb-04792312c6c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:48.012650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f9b404d2-a09e-4284-aabd-330bb95d55c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:48.037047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f9b404d2-a09e-4284-aabd-330bb95d55c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1287 microversion: 2.1 time: 0.277172 Sep 02 09:32:48.038182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 29/53] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:47 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1287 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:48.103918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8843b570-bf0b-4d18-81bb-04792312c6c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:48.112103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8843b570-bf0b-4d18-81bb-04792312c6c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1218 microversion: 2.1 time: 0.307738 Sep 02 09:32:48.118099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 25/54] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:47 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:48.667889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c49c5015-395b-418d-b7ce-b98c5bf3e441 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:48.673046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c49c5015-395b-418d-b7ce-b98c5bf3e441 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:48.681142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c49c5015-395b-418d-b7ce-b98c5bf3e441 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:48.681650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c49c5015-395b-418d-b7ce-b98c5bf3e441 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:48.682092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c49c5015-395b-418d-b7ce-b98c5bf3e441 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:48.684150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c49c5015-395b-418d-b7ce-b98c5bf3e441 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:48.686946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c49c5015-395b-418d-b7ce-b98c5bf3e441 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:48.687599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c49c5015-395b-418d-b7ce-b98c5bf3e441 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:49.058074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1b490052-3bf1-43e1-8bb4-d45eab17eb1e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:49.058735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1b490052-3bf1-43e1-8bb4-d45eab17eb1e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:49.068100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b490052-3bf1-43e1-8bb4-d45eab17eb1e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:49.072970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b490052-3bf1-43e1-8bb4-d45eab17eb1e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:49.073435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b490052-3bf1-43e1-8bb4-d45eab17eb1e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:49.074181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b490052-3bf1-43e1-8bb4-d45eab17eb1e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:49.082912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b490052-3bf1-43e1-8bb4-d45eab17eb1e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:49.083872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b490052-3bf1-43e1-8bb4-d45eab17eb1e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:49.708801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1b490052-3bf1-43e1-8bb4-d45eab17eb1e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:49.721296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1b490052-3bf1-43e1-8bb4-d45eab17eb1e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1295 microversion: 2.1 time: 0.667084 Sep 02 09:32:49.723560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 26/55] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:49 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1295 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:49.730504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b61c3919-df59-4aee-98d6-d3616aac6475 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:49.731420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b61c3919-df59-4aee-98d6-d3616aac6475 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:49.742359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b61c3919-df59-4aee-98d6-d3616aac6475 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:49.743419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b61c3919-df59-4aee-98d6-d3616aac6475 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:49.744390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b61c3919-df59-4aee-98d6-d3616aac6475 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:49.745441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b61c3919-df59-4aee-98d6-d3616aac6475 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:49.746106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b61c3919-df59-4aee-98d6-d3616aac6475 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:49.746672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b61c3919-df59-4aee-98d6-d3616aac6475 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:49.776896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c49c5015-395b-418d-b7ce-b98c5bf3e441 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:49.787290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c49c5015-395b-418d-b7ce-b98c5bf3e441 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1273 microversion: 2.1 time: 1.124976 Sep 02 09:32:49.793790 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 30/56] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:48 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1273 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:49.920340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b61c3919-df59-4aee-98d6-d3616aac6475 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:49.932120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b61c3919-df59-4aee-98d6-d3616aac6475 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1282 microversion: 2.1 time: 0.207072 Sep 02 09:32:49.935647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 27/57] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:49 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1282 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:50.752775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d5bbc6fd-afa4-43a2-acce-6b0651094d53 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:50.753746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d5bbc6fd-afa4-43a2-acce-6b0651094d53 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:50.795326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5bbc6fd-afa4-43a2-acce-6b0651094d53 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:50.797776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5bbc6fd-afa4-43a2-acce-6b0651094d53 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:50.799782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5bbc6fd-afa4-43a2-acce-6b0651094d53 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:50.800732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5bbc6fd-afa4-43a2-acce-6b0651094d53 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:50.801212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5bbc6fd-afa4-43a2-acce-6b0651094d53 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:50.802515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5bbc6fd-afa4-43a2-acce-6b0651094d53 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:50.813592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5ffb65b6-75bb-4387-93a2-12ad9aeb1f62 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:50.814208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5ffb65b6-75bb-4387-93a2-12ad9aeb1f62 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:50.835335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ffb65b6-75bb-4387-93a2-12ad9aeb1f62 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:50.835921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ffb65b6-75bb-4387-93a2-12ad9aeb1f62 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:50.836264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ffb65b6-75bb-4387-93a2-12ad9aeb1f62 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:50.837010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ffb65b6-75bb-4387-93a2-12ad9aeb1f62 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:50.837468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ffb65b6-75bb-4387-93a2-12ad9aeb1f62 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:50.837896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ffb65b6-75bb-4387-93a2-12ad9aeb1f62 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:51.297146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d5bbc6fd-afa4-43a2-acce-6b0651094d53 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:51.323190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d5bbc6fd-afa4-43a2-acce-6b0651094d53 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1293 microversion: 2.1 time: 0.573159 Sep 02 09:32:51.339857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 31/58] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:50 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1293 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:51.367898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-64c40ae6-4f17-41c0-8834-c73a138713bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:51.368776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-64c40ae6-4f17-41c0-8834-c73a138713bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:51.414163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64c40ae6-4f17-41c0-8834-c73a138713bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:51.414163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64c40ae6-4f17-41c0-8834-c73a138713bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:51.414163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64c40ae6-4f17-41c0-8834-c73a138713bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:51.414163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64c40ae6-4f17-41c0-8834-c73a138713bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:51.414905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64c40ae6-4f17-41c0-8834-c73a138713bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:51.414905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64c40ae6-4f17-41c0-8834-c73a138713bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:51.718670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-64c40ae6-4f17-41c0-8834-c73a138713bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:51.748207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-64c40ae6-4f17-41c0-8834-c73a138713bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1280 microversion: 2.1 time: 0.406056 Sep 02 09:32:51.758373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 32/59] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:51 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1280 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:51.772336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5ffb65b6-75bb-4387-93a2-12ad9aeb1f62 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:51.782321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5ffb65b6-75bb-4387-93a2-12ad9aeb1f62 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.972924 Sep 02 09:32:51.783110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 28/60] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:50 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:32:52.348456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2bf9d6e7-35d3-4ff7-9a16-ee52bd865697 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:52.351201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2bf9d6e7-35d3-4ff7-9a16-ee52bd865697 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:52.381676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bf9d6e7-35d3-4ff7-9a16-ee52bd865697 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:52.388882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bf9d6e7-35d3-4ff7-9a16-ee52bd865697 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:52.389350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bf9d6e7-35d3-4ff7-9a16-ee52bd865697 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:52.390477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bf9d6e7-35d3-4ff7-9a16-ee52bd865697 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:52.390573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bf9d6e7-35d3-4ff7-9a16-ee52bd865697 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:52.390995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bf9d6e7-35d3-4ff7-9a16-ee52bd865697 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:52.787316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fa84670b-fc8c-4165-9ba3-f16022bc70c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:52.788911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fa84670b-fc8c-4165-9ba3-f16022bc70c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:52.812105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa84670b-fc8c-4165-9ba3-f16022bc70c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:52.817812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa84670b-fc8c-4165-9ba3-f16022bc70c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:52.817812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa84670b-fc8c-4165-9ba3-f16022bc70c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:52.817812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa84670b-fc8c-4165-9ba3-f16022bc70c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:52.817812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa84670b-fc8c-4165-9ba3-f16022bc70c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:52.819683 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa84670b-fc8c-4165-9ba3-f16022bc70c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:53.225032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2bf9d6e7-35d3-4ff7-9a16-ee52bd865697 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:53.246214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2bf9d6e7-35d3-4ff7-9a16-ee52bd865697 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.902702 Sep 02 09:32:53.247411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 33/61] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:52 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:53.283260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-eef223e5-caef-4847-b22c-7e1ae9f87c13 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:53.375187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-eef223e5-caef-4847-b22c-7e1ae9f87c13 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:53.375187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eef223e5-caef-4847-b22c-7e1ae9f87c13 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:53.375187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eef223e5-caef-4847-b22c-7e1ae9f87c13 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:53.375187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eef223e5-caef-4847-b22c-7e1ae9f87c13 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:53.377181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eef223e5-caef-4847-b22c-7e1ae9f87c13 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:53.377181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eef223e5-caef-4847-b22c-7e1ae9f87c13 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:53.377181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eef223e5-caef-4847-b22c-7e1ae9f87c13 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:53.377399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:53.454105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fa84670b-fc8c-4165-9ba3-f16022bc70c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:53.468613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fa84670b-fc8c-4165-9ba3-f16022bc70c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.687232 Sep 02 09:32:53.469883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 29/62] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:52 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:54.361485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eef223e5-caef-4847-b22c-7e1ae9f87c13 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:54.361485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-eef223e5-caef-4847-b22c-7e1ae9f87c13 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 1.112434 Sep 02 09:32:54.370267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b0c76566-8829-40f7-a8cc-02ed735b75a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:54.370942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b0c76566-8829-40f7-a8cc-02ed735b75a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:54.371524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 34/63] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:53 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:54.378283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0c76566-8829-40f7-a8cc-02ed735b75a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:54.390168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0c76566-8829-40f7-a8cc-02ed735b75a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:54.392238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0c76566-8829-40f7-a8cc-02ed735b75a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:54.393230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0c76566-8829-40f7-a8cc-02ed735b75a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:54.395753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0c76566-8829-40f7-a8cc-02ed735b75a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:54.398838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0c76566-8829-40f7-a8cc-02ed735b75a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:54.491900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b53b8da6-57ac-4f4f-b0e3-325347e1c3c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:54.493842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b53b8da6-57ac-4f4f-b0e3-325347e1c3c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:54.501211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b53b8da6-57ac-4f4f-b0e3-325347e1c3c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:54.501962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b53b8da6-57ac-4f4f-b0e3-325347e1c3c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:54.502578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b53b8da6-57ac-4f4f-b0e3-325347e1c3c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:54.503682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b53b8da6-57ac-4f4f-b0e3-325347e1c3c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:54.504542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b53b8da6-57ac-4f4f-b0e3-325347e1c3c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:54.505232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b53b8da6-57ac-4f4f-b0e3-325347e1c3c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:54.776822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=4 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:55.001266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=20 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:55.235349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b53b8da6-57ac-4f4f-b0e3-325347e1c3c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:55.239536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b53b8da6-57ac-4f4f-b0e3-325347e1c3c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.753109 Sep 02 09:32:55.240122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 35/64] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:54 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:32:55.303165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b0c76566-8829-40f7-a8cc-02ed735b75a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:55.303165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b0c76566-8829-40f7-a8cc-02ed735b75a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.912071 Sep 02 09:32:55.303165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 30/65] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:54 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:55.383690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6b9963ed-a4dd-4509-a9a9-e3c98263e262 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:55.385029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6b9963ed-a4dd-4509-a9a9-e3c98263e262 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:55.402626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b9963ed-a4dd-4509-a9a9-e3c98263e262 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:55.403160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b9963ed-a4dd-4509-a9a9-e3c98263e262 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:55.403631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b9963ed-a4dd-4509-a9a9-e3c98263e262 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:55.404462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b9963ed-a4dd-4509-a9a9-e3c98263e262 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:55.404813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b9963ed-a4dd-4509-a9a9-e3c98263e262 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:55.405444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6b9963ed-a4dd-4509-a9a9-e3c98263e262 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:55.451134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=20 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:32:55.626469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6b9963ed-a4dd-4509-a9a9-e3c98263e262 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:55.642306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6b9963ed-a4dd-4509-a9a9-e3c98263e262 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.262640 Sep 02 09:32:55.655039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 31/66] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:55 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:55.788780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-3ffe855d-cf80-4273-9031-948d3f05a4dd req-f49dba41-8b45-49dc-b702-a68eb559e575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae283fdc-e807-415c-a156-8ec24163c45f", "tag": "0277f0c4-2ab4-4648-b7be-e37876a5929e"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:55.809822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3ffe855d-cf80-4273-9031-948d3f05a4dd req-f49dba41-8b45-49dc-b702-a68eb559e575 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:55.809822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3ffe855d-cf80-4273-9031-948d3f05a4dd req-f49dba41-8b45-49dc-b702-a68eb559e575 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:55.809822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3ffe855d-cf80-4273-9031-948d3f05a4dd req-f49dba41-8b45-49dc-b702-a68eb559e575 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:55.836373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-3ffe855d-cf80-4273-9031-948d3f05a4dd req-f49dba41-8b45-49dc-b702-a68eb559e575 service nova] Creating event network-changed:0277f0c4-2ab4-4648-b7be-e37876a5929e for instance ae283fdc-e807-415c-a156-8ec24163c45f on hv-cinder-85083 Sep 02 09:32:55.838563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3ffe855d-cf80-4273-9031-948d3f05a4dd req-f49dba41-8b45-49dc-b702-a68eb559e575 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127533) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 02 09:32:55.838563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3ffe855d-cf80-4273-9031-948d3f05a4dd req-f49dba41-8b45-49dc-b702-a68eb559e575 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127533) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 02 09:32:55.840226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5aa3874-c9da-4a65-a92b-b309de6f67db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:55.841096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5aa3874-c9da-4a65-a92b-b309de6f67db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:55.842067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5aa3874-c9da-4a65-a92b-b309de6f67db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:55.843153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5aa3874-c9da-4a65-a92b-b309de6f67db None None] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:55.843908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5aa3874-c9da-4a65-a92b-b309de6f67db None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:55.844622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5aa3874-c9da-4a65-a92b-b309de6f67db None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:55.859009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.compute.rpcapi [None req-e5aa3874-c9da-4a65-a92b-b309de6f67db None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 02 09:32:55.861517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5aa3874-c9da-4a65-a92b-b309de6f67db None None] Releasing lock "compute-rpcapi-router" {{(pid=127533) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 02 09:32:55.886389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e5aa3874-c9da-4a65-a92b-b309de6f67db None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.527747 Sep 02 09:32:55.887402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 36/67] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:32:56.275203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2493298a-38a5-49f8-b6ce-e1abb55291c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:56.275992 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2493298a-38a5-49f8-b6ce-e1abb55291c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:56.288742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2493298a-38a5-49f8-b6ce-e1abb55291c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:56.289528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2493298a-38a5-49f8-b6ce-e1abb55291c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:56.290194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2493298a-38a5-49f8-b6ce-e1abb55291c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:56.297394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2493298a-38a5-49f8-b6ce-e1abb55291c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:56.297862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2493298a-38a5-49f8-b6ce-e1abb55291c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:56.298298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2493298a-38a5-49f8-b6ce-e1abb55291c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:56.308903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-29e1015c-5e69-4841-96bf-78b0196703fc req-607510bd-f5d8-4a7a-9a26-7c589c102983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d770bc-892d-4464-aa30-ded0926f7a13", "tag": "2dde1031-6e53-4864-957c-6a89464b2c48"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:56.322749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-29e1015c-5e69-4841-96bf-78b0196703fc req-607510bd-f5d8-4a7a-9a26-7c589c102983 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:56.323444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-29e1015c-5e69-4841-96bf-78b0196703fc req-607510bd-f5d8-4a7a-9a26-7c589c102983 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:56.324100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-29e1015c-5e69-4841-96bf-78b0196703fc req-607510bd-f5d8-4a7a-9a26-7c589c102983 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:56.369918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-29e1015c-5e69-4841-96bf-78b0196703fc req-607510bd-f5d8-4a7a-9a26-7c589c102983 service nova] Creating event network-changed:2dde1031-6e53-4864-957c-6a89464b2c48 for instance 95d770bc-892d-4464-aa30-ded0926f7a13 on hv-cinder-85083 Sep 02 09:32:56.370492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-29e1015c-5e69-4841-96bf-78b0196703fc req-607510bd-f5d8-4a7a-9a26-7c589c102983 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 02 09:32:56.370915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-29e1015c-5e69-4841-96bf-78b0196703fc req-607510bd-f5d8-4a7a-9a26-7c589c102983 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 02 09:32:56.372182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5416447c-f9df-401f-9dbf-16a2272d9dc8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:56.372786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5416447c-f9df-401f-9dbf-16a2272d9dc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:56.373366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5416447c-f9df-401f-9dbf-16a2272d9dc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:56.374527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5416447c-f9df-401f-9dbf-16a2272d9dc8 None None] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:56.375003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5416447c-f9df-401f-9dbf-16a2272d9dc8 None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:56.375571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5416447c-f9df-401f-9dbf-16a2272d9dc8 None None] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:56.386899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.compute.rpcapi [None req-5416447c-f9df-401f-9dbf-16a2272d9dc8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 02 09:32:56.388476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5416447c-f9df-401f-9dbf-16a2272d9dc8 None None] Releasing lock "compute-rpcapi-router" {{(pid=127531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 02 09:32:56.415614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5416447c-f9df-401f-9dbf-16a2272d9dc8 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237498 Sep 02 09:32:56.416483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 32/68] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:56.424064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-04813fc9-9704-439e-918c-72d14f7cfbd9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:56.426110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-04813fc9-9704-439e-918c-72d14f7cfbd9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:56.443995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04813fc9-9704-439e-918c-72d14f7cfbd9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:56.444614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04813fc9-9704-439e-918c-72d14f7cfbd9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:56.445680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04813fc9-9704-439e-918c-72d14f7cfbd9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:56.446505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04813fc9-9704-439e-918c-72d14f7cfbd9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:56.447090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04813fc9-9704-439e-918c-72d14f7cfbd9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:56.447918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04813fc9-9704-439e-918c-72d14f7cfbd9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:56.577703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2493298a-38a5-49f8-b6ce-e1abb55291c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:56.588516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2493298a-38a5-49f8-b6ce-e1abb55291c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.326446 Sep 02 09:32:56.592778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 37/69] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:56 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:56.665561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-947acb9a-6965-4b65-bd9a-79e0abbfac2e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:56.666655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-947acb9a-6965-4b65-bd9a-79e0abbfac2e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:56.673805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-947acb9a-6965-4b65-bd9a-79e0abbfac2e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:56.674507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-947acb9a-6965-4b65-bd9a-79e0abbfac2e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:56.675142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-947acb9a-6965-4b65-bd9a-79e0abbfac2e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:56.676596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-947acb9a-6965-4b65-bd9a-79e0abbfac2e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:56.677252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-947acb9a-6965-4b65-bd9a-79e0abbfac2e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:56.677846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-947acb9a-6965-4b65-bd9a-79e0abbfac2e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:56.873615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-947acb9a-6965-4b65-bd9a-79e0abbfac2e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:56.885096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-947acb9a-6965-4b65-bd9a-79e0abbfac2e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.224380 Sep 02 09:32:56.886304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 38/70] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:56 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:56.930262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-04813fc9-9704-439e-918c-72d14f7cfbd9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:56.951035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-04813fc9-9704-439e-918c-72d14f7cfbd9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.532544 Sep 02 09:32:56.953203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 33/71] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:56 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:57.616097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6e8b1889-c7a2-4725-a6c8-0606b8fe1094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:57.616707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6e8b1889-c7a2-4725-a6c8-0606b8fe1094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:57.623583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e8b1889-c7a2-4725-a6c8-0606b8fe1094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:57.624005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e8b1889-c7a2-4725-a6c8-0606b8fe1094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:57.624503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e8b1889-c7a2-4725-a6c8-0606b8fe1094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:57.625143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e8b1889-c7a2-4725-a6c8-0606b8fe1094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:57.625594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e8b1889-c7a2-4725-a6c8-0606b8fe1094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:57.626017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e8b1889-c7a2-4725-a6c8-0606b8fe1094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:57.833200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6e8b1889-c7a2-4725-a6c8-0606b8fe1094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:57.844372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6e8b1889-c7a2-4725-a6c8-0606b8fe1094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.232101 Sep 02 09:32:57.845448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 39/72] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:57 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:57.906233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-942508d5-5c61-433c-a92c-ad2fbaff4a31 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:57.908186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-942508d5-5c61-433c-a92c-ad2fbaff4a31 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:57.924015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-942508d5-5c61-433c-a92c-ad2fbaff4a31 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:57.924511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-942508d5-5c61-433c-a92c-ad2fbaff4a31 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:57.924948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-942508d5-5c61-433c-a92c-ad2fbaff4a31 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:57.925644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-942508d5-5c61-433c-a92c-ad2fbaff4a31 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:57.926091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-942508d5-5c61-433c-a92c-ad2fbaff4a31 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:57.927171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-942508d5-5c61-433c-a92c-ad2fbaff4a31 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:57.927960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-aec2c577-1992-4c9a-b3d1-25529a80948a req-783776e1-d9e1-474c-8aaa-4eaad0746b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a68cef6-8c2a-42a1-9943-63f884381755", "tag": "d8b74e21-08e3-4af5-9fc4-a78c1a42ff4c"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:57.938410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-aec2c577-1992-4c9a-b3d1-25529a80948a req-783776e1-d9e1-474c-8aaa-4eaad0746b59 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:57.944438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-aec2c577-1992-4c9a-b3d1-25529a80948a req-783776e1-d9e1-474c-8aaa-4eaad0746b59 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:57.944438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-aec2c577-1992-4c9a-b3d1-25529a80948a req-783776e1-d9e1-474c-8aaa-4eaad0746b59 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:57.960031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-aec2c577-1992-4c9a-b3d1-25529a80948a req-783776e1-d9e1-474c-8aaa-4eaad0746b59 service nova] Creating event network-changed:d8b74e21-08e3-4af5-9fc4-a78c1a42ff4c for instance 5a68cef6-8c2a-42a1-9943-63f884381755 on hv-cinder-85083 Sep 02 09:32:57.967268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-aec2c577-1992-4c9a-b3d1-25529a80948a req-783776e1-d9e1-474c-8aaa-4eaad0746b59 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045138 Sep 02 09:32:57.968414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 40/73] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:57.979563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-34a904d9-3fb3-4abd-b24f-af110b5adad1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:57.980931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-34a904d9-3fb3-4abd-b24f-af110b5adad1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:57.994388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34a904d9-3fb3-4abd-b24f-af110b5adad1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:57.995880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34a904d9-3fb3-4abd-b24f-af110b5adad1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:57.996586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34a904d9-3fb3-4abd-b24f-af110b5adad1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:57.999207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34a904d9-3fb3-4abd-b24f-af110b5adad1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:57.999846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34a904d9-3fb3-4abd-b24f-af110b5adad1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:58.013727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34a904d9-3fb3-4abd-b24f-af110b5adad1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:58.249398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-942508d5-5c61-433c-a92c-ad2fbaff4a31 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:58.262687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-942508d5-5c61-433c-a92c-ad2fbaff4a31 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.360281 Sep 02 09:32:58.269225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 34/74] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:57 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:58.348497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-34a904d9-3fb3-4abd-b24f-af110b5adad1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:58.357934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-34a904d9-3fb3-4abd-b24f-af110b5adad1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.382798 Sep 02 09:32:58.361727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 41/75] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:57 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:58.444502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-2ef658a6-e27e-4a25-bb82-bf0cfa24e178 req-3e27eb83-56ef-41b6-92a9-8df3797a5d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba2a7e8-15a8-4066-9554-49c48ea52a5e", "tag": "71a514a3-ca0b-42e8-b44f-cede338a5920"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:32:58.472700 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-2ef658a6-e27e-4a25-bb82-bf0cfa24e178 req-3e27eb83-56ef-41b6-92a9-8df3797a5d41 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:58.473280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-2ef658a6-e27e-4a25-bb82-bf0cfa24e178 req-3e27eb83-56ef-41b6-92a9-8df3797a5d41 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:58.473772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-2ef658a6-e27e-4a25-bb82-bf0cfa24e178 req-3e27eb83-56ef-41b6-92a9-8df3797a5d41 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:58.507140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-2ef658a6-e27e-4a25-bb82-bf0cfa24e178 req-3e27eb83-56ef-41b6-92a9-8df3797a5d41 service nova] Creating event network-changed:71a514a3-ca0b-42e8-b44f-cede338a5920 for instance 7ba2a7e8-15a8-4066-9554-49c48ea52a5e on hv-cinder-85083 Sep 02 09:32:58.514278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-2ef658a6-e27e-4a25-bb82-bf0cfa24e178 req-3e27eb83-56ef-41b6-92a9-8df3797a5d41 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073612 Sep 02 09:32:58.515490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 35/76] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:32:58.867206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9af3df5a-33ca-484a-8ddf-37efaff9b9a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:58.867828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9af3df5a-33ca-484a-8ddf-37efaff9b9a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:58.881441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9af3df5a-33ca-484a-8ddf-37efaff9b9a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:58.882258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9af3df5a-33ca-484a-8ddf-37efaff9b9a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:58.882726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9af3df5a-33ca-484a-8ddf-37efaff9b9a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:58.883457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9af3df5a-33ca-484a-8ddf-37efaff9b9a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:58.884116 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9af3df5a-33ca-484a-8ddf-37efaff9b9a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:58.884753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9af3df5a-33ca-484a-8ddf-37efaff9b9a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:59.045798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9af3df5a-33ca-484a-8ddf-37efaff9b9a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:59.054336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9af3df5a-33ca-484a-8ddf-37efaff9b9a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.191830 Sep 02 09:32:59.069059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 42/77] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:58 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:59.291792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-78d797e6-f545-4309-bf79-934d88824189 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:59.292477 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-78d797e6-f545-4309-bf79-934d88824189 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:59.298550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78d797e6-f545-4309-bf79-934d88824189 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:59.299065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78d797e6-f545-4309-bf79-934d88824189 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:59.299494 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78d797e6-f545-4309-bf79-934d88824189 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:59.300171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78d797e6-f545-4309-bf79-934d88824189 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:59.300627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78d797e6-f545-4309-bf79-934d88824189 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:59.301119 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78d797e6-f545-4309-bf79-934d88824189 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:59.386952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-534ad5c2-9dc8-499b-b502-aaef4b439954 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:32:59.388077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-534ad5c2-9dc8-499b-b502-aaef4b439954 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:32:59.397232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-534ad5c2-9dc8-499b-b502-aaef4b439954 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:59.398071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-534ad5c2-9dc8-499b-b502-aaef4b439954 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:59.398616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-534ad5c2-9dc8-499b-b502-aaef4b439954 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:59.399444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-534ad5c2-9dc8-499b-b502-aaef4b439954 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:32:59.399999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-534ad5c2-9dc8-499b-b502-aaef4b439954 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:32:59.400531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-534ad5c2-9dc8-499b-b502-aaef4b439954 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:32:59.444034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-78d797e6-f545-4309-bf79-934d88824189 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:59.451966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-78d797e6-f545-4309-bf79-934d88824189 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.164446 Sep 02 09:32:59.452553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 36/78] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:59 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:32:59.570691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-534ad5c2-9dc8-499b-b502-aaef4b439954 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:32:59.583350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-534ad5c2-9dc8-499b-b502-aaef4b439954 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.202512 Sep 02 09:32:59.584433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 43/79] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:32:59 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:00.076356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7ad51c14-b77c-4d65-81ac-329ff324e62c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:00.076964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7ad51c14-b77c-4d65-81ac-329ff324e62c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:00.085172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ad51c14-b77c-4d65-81ac-329ff324e62c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:00.089488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ad51c14-b77c-4d65-81ac-329ff324e62c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:00.089488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ad51c14-b77c-4d65-81ac-329ff324e62c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:00.090017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ad51c14-b77c-4d65-81ac-329ff324e62c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:00.090789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ad51c14-b77c-4d65-81ac-329ff324e62c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:00.091904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ad51c14-b77c-4d65-81ac-329ff324e62c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:00.244689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7ad51c14-b77c-4d65-81ac-329ff324e62c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:00.252503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7ad51c14-b77c-4d65-81ac-329ff324e62c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.180114 Sep 02 09:33:00.253066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 37/80] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:00 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:00.472764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fd4e98e5-6b1f-47a7-b4cb-08a07d3ab1b0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:00.474015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fd4e98e5-6b1f-47a7-b4cb-08a07d3ab1b0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:00.480072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd4e98e5-6b1f-47a7-b4cb-08a07d3ab1b0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:00.480616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd4e98e5-6b1f-47a7-b4cb-08a07d3ab1b0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:00.481055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd4e98e5-6b1f-47a7-b4cb-08a07d3ab1b0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:00.481743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd4e98e5-6b1f-47a7-b4cb-08a07d3ab1b0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:00.482198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd4e98e5-6b1f-47a7-b4cb-08a07d3ab1b0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:00.482627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd4e98e5-6b1f-47a7-b4cb-08a07d3ab1b0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:00.603568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-accc92ab-4190-449c-ba66-1fa81f16c545 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:00.604181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-accc92ab-4190-449c-ba66-1fa81f16c545 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:00.610927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-accc92ab-4190-449c-ba66-1fa81f16c545 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:00.611413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-accc92ab-4190-449c-ba66-1fa81f16c545 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:00.611849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-accc92ab-4190-449c-ba66-1fa81f16c545 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:00.612540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-accc92ab-4190-449c-ba66-1fa81f16c545 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:00.613124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-accc92ab-4190-449c-ba66-1fa81f16c545 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:00.613396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-accc92ab-4190-449c-ba66-1fa81f16c545 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:00.620926 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fd4e98e5-6b1f-47a7-b4cb-08a07d3ab1b0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:00.637691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:00.640441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fd4e98e5-6b1f-47a7-b4cb-08a07d3ab1b0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.171558 Sep 02 09:33:00.652446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 44/81] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:00 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:00.777697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-accc92ab-4190-449c-ba66-1fa81f16c545 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:00.781440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:00.786036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-accc92ab-4190-449c-ba66-1fa81f16c545 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.186395 Sep 02 09:33:00.786616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 38/82] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:00 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:01.274225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0df3e6dd-da07-4315-8018-1aa532238b9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:01.275390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0df3e6dd-da07-4315-8018-1aa532238b9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:01.281878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0df3e6dd-da07-4315-8018-1aa532238b9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:01.282734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0df3e6dd-da07-4315-8018-1aa532238b9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:01.283278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0df3e6dd-da07-4315-8018-1aa532238b9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:01.284056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0df3e6dd-da07-4315-8018-1aa532238b9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:01.284510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0df3e6dd-da07-4315-8018-1aa532238b9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:01.285259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0df3e6dd-da07-4315-8018-1aa532238b9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:01.514821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0df3e6dd-da07-4315-8018-1aa532238b9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:01.523388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0df3e6dd-da07-4315-8018-1aa532238b9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.253850 Sep 02 09:33:01.523945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 45/83] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:01 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:01.661701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb0b40d1-7c10-4008-aa0a-e08b6535067d tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:01.662251 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb0b40d1-7c10-4008-aa0a-e08b6535067d tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:01.668283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0b40d1-7c10-4008-aa0a-e08b6535067d tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:01.668769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0b40d1-7c10-4008-aa0a-e08b6535067d tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:01.669207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0b40d1-7c10-4008-aa0a-e08b6535067d tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:01.669883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0b40d1-7c10-4008-aa0a-e08b6535067d tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:01.670335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0b40d1-7c10-4008-aa0a-e08b6535067d tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:01.670786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0b40d1-7c10-4008-aa0a-e08b6535067d tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:01.807600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1d0835be-4343-478e-be07-96960c4e769f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:01.808578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1d0835be-4343-478e-be07-96960c4e769f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:01.815997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0835be-4343-478e-be07-96960c4e769f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:01.817321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0835be-4343-478e-be07-96960c4e769f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:01.817979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0835be-4343-478e-be07-96960c4e769f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:01.819019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0835be-4343-478e-be07-96960c4e769f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:01.819672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0835be-4343-478e-be07-96960c4e769f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:01.820283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0835be-4343-478e-be07-96960c4e769f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:01.821604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb0b40d1-7c10-4008-aa0a-e08b6535067d tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:01.830531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb0b40d1-7c10-4008-aa0a-e08b6535067d tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.172893 Sep 02 09:33:01.843335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 39/84] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:01 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:02.073906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1d0835be-4343-478e-be07-96960c4e769f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:02.084460 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1d0835be-4343-478e-be07-96960c4e769f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.281145 Sep 02 09:33:02.095823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 46/85] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:01 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:02.543743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b6f3818d-b9e7-460b-86c8-c9047d3dff37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:02.544366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b6f3818d-b9e7-460b-86c8-c9047d3dff37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:02.550760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6f3818d-b9e7-460b-86c8-c9047d3dff37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:02.551341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6f3818d-b9e7-460b-86c8-c9047d3dff37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:02.551858 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6f3818d-b9e7-460b-86c8-c9047d3dff37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:02.552626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6f3818d-b9e7-460b-86c8-c9047d3dff37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:02.553159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6f3818d-b9e7-460b-86c8-c9047d3dff37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:02.553703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6f3818d-b9e7-460b-86c8-c9047d3dff37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:02.718385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b6f3818d-b9e7-460b-86c8-c9047d3dff37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:02.726216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b6f3818d-b9e7-460b-86c8-c9047d3dff37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.186383 Sep 02 09:33:02.726798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 40/86] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:02 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:02.852185 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6ea39b5c-2ea9-4fd5-9bee-350609dd6bae tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:02.852788 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6ea39b5c-2ea9-4fd5-9bee-350609dd6bae tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:02.860413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea39b5c-2ea9-4fd5-9bee-350609dd6bae tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:02.860413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea39b5c-2ea9-4fd5-9bee-350609dd6bae tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:02.860813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea39b5c-2ea9-4fd5-9bee-350609dd6bae tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:02.861876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea39b5c-2ea9-4fd5-9bee-350609dd6bae tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:02.864040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea39b5c-2ea9-4fd5-9bee-350609dd6bae tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:02.864040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea39b5c-2ea9-4fd5-9bee-350609dd6bae tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:03.108014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a92eca54-3c33-4051-8ecd-9066672d04ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:03.109067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a92eca54-3c33-4051-8ecd-9066672d04ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:03.116446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a92eca54-3c33-4051-8ecd-9066672d04ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:03.118219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a92eca54-3c33-4051-8ecd-9066672d04ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:03.118219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a92eca54-3c33-4051-8ecd-9066672d04ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:03.119076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a92eca54-3c33-4051-8ecd-9066672d04ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:03.119663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a92eca54-3c33-4051-8ecd-9066672d04ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:03.120528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a92eca54-3c33-4051-8ecd-9066672d04ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:03.174390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6ea39b5c-2ea9-4fd5-9bee-350609dd6bae tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:03.184954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6ea39b5c-2ea9-4fd5-9bee-350609dd6bae tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.336480 Sep 02 09:33:03.185523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 47/87] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:02 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:03.449036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a92eca54-3c33-4051-8ecd-9066672d04ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:03.457992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a92eca54-3c33-4051-8ecd-9066672d04ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.354078 Sep 02 09:33:03.459835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 41/88] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:03 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:03.749946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-feaa537b-f874-4dac-814e-808f3e0daccf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:03.770433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-feaa537b-f874-4dac-814e-808f3e0daccf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:03.770433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feaa537b-f874-4dac-814e-808f3e0daccf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:03.770433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feaa537b-f874-4dac-814e-808f3e0daccf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:03.770433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feaa537b-f874-4dac-814e-808f3e0daccf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:03.770884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feaa537b-f874-4dac-814e-808f3e0daccf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:03.770884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feaa537b-f874-4dac-814e-808f3e0daccf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:03.770884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feaa537b-f874-4dac-814e-808f3e0daccf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:03.896301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-feaa537b-f874-4dac-814e-808f3e0daccf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:03.904901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-feaa537b-f874-4dac-814e-808f3e0daccf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.159187 Sep 02 09:33:03.905471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 48/89] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:03 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:04.212781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0ccbfefa-e1b1-4a82-bc00-e10736230739 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:04.214424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0ccbfefa-e1b1-4a82-bc00-e10736230739 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:04.221327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccbfefa-e1b1-4a82-bc00-e10736230739 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:04.221327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccbfefa-e1b1-4a82-bc00-e10736230739 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:04.221528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccbfefa-e1b1-4a82-bc00-e10736230739 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:04.222313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccbfefa-e1b1-4a82-bc00-e10736230739 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:04.222891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccbfefa-e1b1-4a82-bc00-e10736230739 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:04.223412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccbfefa-e1b1-4a82-bc00-e10736230739 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:04.354852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0ccbfefa-e1b1-4a82-bc00-e10736230739 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:04.362604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0ccbfefa-e1b1-4a82-bc00-e10736230739 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.154133 Sep 02 09:33:04.363204 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 42/90] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:04 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:04.479904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-15192cbf-dcb2-4385-b2c9-d02e247cd103 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:04.484444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-15192cbf-dcb2-4385-b2c9-d02e247cd103 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:04.487372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15192cbf-dcb2-4385-b2c9-d02e247cd103 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:04.487851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15192cbf-dcb2-4385-b2c9-d02e247cd103 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:04.488312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15192cbf-dcb2-4385-b2c9-d02e247cd103 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:04.489503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15192cbf-dcb2-4385-b2c9-d02e247cd103 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:04.489950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15192cbf-dcb2-4385-b2c9-d02e247cd103 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:04.490371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15192cbf-dcb2-4385-b2c9-d02e247cd103 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:04.619874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-15192cbf-dcb2-4385-b2c9-d02e247cd103 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:04.627653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-15192cbf-dcb2-4385-b2c9-d02e247cd103 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.152012 Sep 02 09:33:04.628306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 49/91] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:04 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:04.925409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-30d981bd-6c5a-4924-b788-f44c3bd799ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:04.926029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-30d981bd-6c5a-4924-b788-f44c3bd799ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:04.932025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30d981bd-6c5a-4924-b788-f44c3bd799ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:04.932701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30d981bd-6c5a-4924-b788-f44c3bd799ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:04.933323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30d981bd-6c5a-4924-b788-f44c3bd799ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:04.934012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30d981bd-6c5a-4924-b788-f44c3bd799ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:04.934475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30d981bd-6c5a-4924-b788-f44c3bd799ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:04.934927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30d981bd-6c5a-4924-b788-f44c3bd799ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:05.075267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-30d981bd-6c5a-4924-b788-f44c3bd799ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:05.085070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-30d981bd-6c5a-4924-b788-f44c3bd799ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.163442 Sep 02 09:33:05.085697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 43/92] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:04 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:05.385778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-66c23337-c38c-4973-a77b-7a65b807ac76 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:05.386975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-66c23337-c38c-4973-a77b-7a65b807ac76 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:05.396741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c23337-c38c-4973-a77b-7a65b807ac76 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:05.397567 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c23337-c38c-4973-a77b-7a65b807ac76 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:05.398199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c23337-c38c-4973-a77b-7a65b807ac76 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:05.399397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c23337-c38c-4973-a77b-7a65b807ac76 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:05.400113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c23337-c38c-4973-a77b-7a65b807ac76 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:05.400865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c23337-c38c-4973-a77b-7a65b807ac76 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:05.648834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-facfee02-b143-4054-8816-e83b2a481a24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:05.650444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-facfee02-b143-4054-8816-e83b2a481a24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:05.656714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:05.660246 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-facfee02-b143-4054-8816-e83b2a481a24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:05.661025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-facfee02-b143-4054-8816-e83b2a481a24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:05.661756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-facfee02-b143-4054-8816-e83b2a481a24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:05.662624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-facfee02-b143-4054-8816-e83b2a481a24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:05.663352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-facfee02-b143-4054-8816-e83b2a481a24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:05.663788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-facfee02-b143-4054-8816-e83b2a481a24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:05.750257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-66c23337-c38c-4973-a77b-7a65b807ac76 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:05.760072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-66c23337-c38c-4973-a77b-7a65b807ac76 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.379049 Sep 02 09:33:05.760731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 50/93] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:05 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:06.078843 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-facfee02-b143-4054-8816-e83b2a481a24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:06.086827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-facfee02-b143-4054-8816-e83b2a481a24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.442490 Sep 02 09:33:06.087399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 44/94] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:05 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:06.106978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cc338c37-5e6d-4be8-9e92-d4eef7c8d98a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:06.109913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cc338c37-5e6d-4be8-9e92-d4eef7c8d98a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:06.125580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:06.147414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc338c37-5e6d-4be8-9e92-d4eef7c8d98a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:06.148367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc338c37-5e6d-4be8-9e92-d4eef7c8d98a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:06.148820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc338c37-5e6d-4be8-9e92-d4eef7c8d98a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:06.149524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc338c37-5e6d-4be8-9e92-d4eef7c8d98a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:06.149986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc338c37-5e6d-4be8-9e92-d4eef7c8d98a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:06.150414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc338c37-5e6d-4be8-9e92-d4eef7c8d98a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:06.515805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:06.520371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cc338c37-5e6d-4be8-9e92-d4eef7c8d98a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:06.545622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cc338c37-5e6d-4be8-9e92-d4eef7c8d98a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.443398 Sep 02 09:33:06.546568 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 51/95] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:06 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:06.796706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb6522b1-3184-4549-969d-00cc15048568 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:06.796706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb6522b1-3184-4549-969d-00cc15048568 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:06.796706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:06.796706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb6522b1-3184-4549-969d-00cc15048568 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:06.796706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb6522b1-3184-4549-969d-00cc15048568 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:06.797617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb6522b1-3184-4549-969d-00cc15048568 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:06.797617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb6522b1-3184-4549-969d-00cc15048568 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:06.797617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb6522b1-3184-4549-969d-00cc15048568 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:06.797617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb6522b1-3184-4549-969d-00cc15048568 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:07.026857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb6522b1-3184-4549-969d-00cc15048568 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:07.041717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb6522b1-3184-4549-969d-00cc15048568 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.263859 Sep 02 09:33:07.044031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 45/96] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:06 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:07.109649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4e3c92d3-f69b-4d3b-a7e1-1a3b53102ba8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:07.112424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4e3c92d3-f69b-4d3b-a7e1-1a3b53102ba8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:07.125473 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e3c92d3-f69b-4d3b-a7e1-1a3b53102ba8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:07.126142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e3c92d3-f69b-4d3b-a7e1-1a3b53102ba8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:07.126853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e3c92d3-f69b-4d3b-a7e1-1a3b53102ba8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:07.128172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e3c92d3-f69b-4d3b-a7e1-1a3b53102ba8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:07.129623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e3c92d3-f69b-4d3b-a7e1-1a3b53102ba8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:07.130358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e3c92d3-f69b-4d3b-a7e1-1a3b53102ba8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:07.311171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4e3c92d3-f69b-4d3b-a7e1-1a3b53102ba8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:07.321881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4e3c92d3-f69b-4d3b-a7e1-1a3b53102ba8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.217222 Sep 02 09:33:07.323252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 52/97] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:07 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:07.566373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5c7d1a98-3e9a-4b28-9347-259d0e6de105 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:07.570008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5c7d1a98-3e9a-4b28-9347-259d0e6de105 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:07.573203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c7d1a98-3e9a-4b28-9347-259d0e6de105 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:07.573688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c7d1a98-3e9a-4b28-9347-259d0e6de105 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:07.574116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c7d1a98-3e9a-4b28-9347-259d0e6de105 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:07.574826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c7d1a98-3e9a-4b28-9347-259d0e6de105 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:07.575435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c7d1a98-3e9a-4b28-9347-259d0e6de105 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:07.575973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c7d1a98-3e9a-4b28-9347-259d0e6de105 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:07.705802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5c7d1a98-3e9a-4b28-9347-259d0e6de105 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:07.714818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5c7d1a98-3e9a-4b28-9347-259d0e6de105 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.152207 Sep 02 09:33:07.715721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 46/98] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:07 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:08.069081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bdb724d8-9c5c-4fe8-a92f-5aaffde1b9a0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:08.069686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bdb724d8-9c5c-4fe8-a92f-5aaffde1b9a0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:08.076031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdb724d8-9c5c-4fe8-a92f-5aaffde1b9a0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:08.076507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdb724d8-9c5c-4fe8-a92f-5aaffde1b9a0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:08.076946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdb724d8-9c5c-4fe8-a92f-5aaffde1b9a0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:08.077659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdb724d8-9c5c-4fe8-a92f-5aaffde1b9a0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:08.078110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdb724d8-9c5c-4fe8-a92f-5aaffde1b9a0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:08.078572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdb724d8-9c5c-4fe8-a92f-5aaffde1b9a0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:08.230619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bdb724d8-9c5c-4fe8-a92f-5aaffde1b9a0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:08.238087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bdb724d8-9c5c-4fe8-a92f-5aaffde1b9a0 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.173848 Sep 02 09:33:08.238665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 53/99] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:08 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:08.350349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b3885631-c155-4f61-a72d-35c0ef98cbbf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:08.350991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b3885631-c155-4f61-a72d-35c0ef98cbbf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:08.357557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3885631-c155-4f61-a72d-35c0ef98cbbf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:08.358446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3885631-c155-4f61-a72d-35c0ef98cbbf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:08.358446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3885631-c155-4f61-a72d-35c0ef98cbbf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:08.359153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3885631-c155-4f61-a72d-35c0ef98cbbf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:08.359607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3885631-c155-4f61-a72d-35c0ef98cbbf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:08.360032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3885631-c155-4f61-a72d-35c0ef98cbbf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:08.497246 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3885631-c155-4f61-a72d-35c0ef98cbbf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:08.505944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b3885631-c155-4f61-a72d-35c0ef98cbbf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.159700 Sep 02 09:33:08.506524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 47/100] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:08 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:08.735875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cebfe65f-7ed0-47de-a996-05e25d4cab13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:08.736621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cebfe65f-7ed0-47de-a996-05e25d4cab13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:08.743442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cebfe65f-7ed0-47de-a996-05e25d4cab13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:08.744056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cebfe65f-7ed0-47de-a996-05e25d4cab13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:08.744632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cebfe65f-7ed0-47de-a996-05e25d4cab13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:08.745468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cebfe65f-7ed0-47de-a996-05e25d4cab13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:08.746049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cebfe65f-7ed0-47de-a996-05e25d4cab13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:08.746579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cebfe65f-7ed0-47de-a996-05e25d4cab13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:08.879516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cebfe65f-7ed0-47de-a996-05e25d4cab13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:08.888309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cebfe65f-7ed0-47de-a996-05e25d4cab13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.156216 Sep 02 09:33:08.889089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 54/101] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:08 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:09.259380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-58b95636-297c-486b-a216-6782672723c7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:09.259995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-58b95636-297c-486b-a216-6782672723c7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:09.265890 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58b95636-297c-486b-a216-6782672723c7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:09.266376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58b95636-297c-486b-a216-6782672723c7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:09.266847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58b95636-297c-486b-a216-6782672723c7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:09.267542 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58b95636-297c-486b-a216-6782672723c7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:09.268001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58b95636-297c-486b-a216-6782672723c7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:09.268430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58b95636-297c-486b-a216-6782672723c7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:09.412397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-58b95636-297c-486b-a216-6782672723c7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:09.420254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-58b95636-297c-486b-a216-6782672723c7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.164970 Sep 02 09:33:09.421825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 48/102] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:09 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:09.526906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-eed2dcaa-0603-4eab-b1ca-c0bd5820b470 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:09.527550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-eed2dcaa-0603-4eab-b1ca-c0bd5820b470 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:09.542374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed2dcaa-0603-4eab-b1ca-c0bd5820b470 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:09.542374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed2dcaa-0603-4eab-b1ca-c0bd5820b470 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:09.542374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed2dcaa-0603-4eab-b1ca-c0bd5820b470 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:09.547450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed2dcaa-0603-4eab-b1ca-c0bd5820b470 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:09.547926 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed2dcaa-0603-4eab-b1ca-c0bd5820b470 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:09.548362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed2dcaa-0603-4eab-b1ca-c0bd5820b470 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:09.682926 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eed2dcaa-0603-4eab-b1ca-c0bd5820b470 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:09.694299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-eed2dcaa-0603-4eab-b1ca-c0bd5820b470 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.170867 Sep 02 09:33:09.695657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 55/103] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:09 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:09.909441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1dce034d-0137-4261-873e-5c8e73173b34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:09.910835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1dce034d-0137-4261-873e-5c8e73173b34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:09.916892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dce034d-0137-4261-873e-5c8e73173b34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:09.917383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dce034d-0137-4261-873e-5c8e73173b34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:09.917825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dce034d-0137-4261-873e-5c8e73173b34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:09.918556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dce034d-0137-4261-873e-5c8e73173b34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:09.919043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dce034d-0137-4261-873e-5c8e73173b34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:09.919475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1dce034d-0137-4261-873e-5c8e73173b34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:10.051173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1dce034d-0137-4261-873e-5c8e73173b34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:10.058958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1dce034d-0137-4261-873e-5c8e73173b34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.153367 Sep 02 09:33:10.059525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 49/104] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:09 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:10.441935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0f56b2be-3952-4f2f-becb-b939e42722cd tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:10.442637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0f56b2be-3952-4f2f-becb-b939e42722cd tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:10.448796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f56b2be-3952-4f2f-becb-b939e42722cd tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:10.449281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f56b2be-3952-4f2f-becb-b939e42722cd tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:10.449870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f56b2be-3952-4f2f-becb-b939e42722cd tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:10.450945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f56b2be-3952-4f2f-becb-b939e42722cd tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:10.451596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f56b2be-3952-4f2f-becb-b939e42722cd tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:10.452233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f56b2be-3952-4f2f-becb-b939e42722cd tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:10.621513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0f56b2be-3952-4f2f-becb-b939e42722cd tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:10.629669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0f56b2be-3952-4f2f-becb-b939e42722cd tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.191578 Sep 02 09:33:10.630744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 56/105] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:10 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:10.715839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-88ae7c12-ae0a-469b-8830-23542fcb4980 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:10.716435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-88ae7c12-ae0a-469b-8830-23542fcb4980 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:10.722336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88ae7c12-ae0a-469b-8830-23542fcb4980 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:10.722847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88ae7c12-ae0a-469b-8830-23542fcb4980 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:10.723282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88ae7c12-ae0a-469b-8830-23542fcb4980 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:10.723957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88ae7c12-ae0a-469b-8830-23542fcb4980 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:10.724417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88ae7c12-ae0a-469b-8830-23542fcb4980 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:10.724835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88ae7c12-ae0a-469b-8830-23542fcb4980 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:10.862830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-88ae7c12-ae0a-469b-8830-23542fcb4980 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:10.871003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-88ae7c12-ae0a-469b-8830-23542fcb4980 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.159063 Sep 02 09:33:10.871904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 50/106] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:10 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:11.080242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5edf6a1c-00cb-437c-b60d-d23f791f5bfe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:11.080855 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5edf6a1c-00cb-437c-b60d-d23f791f5bfe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:11.086898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5edf6a1c-00cb-437c-b60d-d23f791f5bfe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:11.088274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5edf6a1c-00cb-437c-b60d-d23f791f5bfe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:11.090226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5edf6a1c-00cb-437c-b60d-d23f791f5bfe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:11.091139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5edf6a1c-00cb-437c-b60d-d23f791f5bfe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:11.093928 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5edf6a1c-00cb-437c-b60d-d23f791f5bfe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:11.094391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5edf6a1c-00cb-437c-b60d-d23f791f5bfe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:11.237719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5edf6a1c-00cb-437c-b60d-d23f791f5bfe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:11.246059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5edf6a1c-00cb-437c-b60d-d23f791f5bfe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.169717 Sep 02 09:33:11.248677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 57/107] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:11 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:11.649561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f9974dff-c229-445f-a00c-806581f75e40 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:11.650111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f9974dff-c229-445f-a00c-806581f75e40 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:11.656151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9974dff-c229-445f-a00c-806581f75e40 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:11.656640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9974dff-c229-445f-a00c-806581f75e40 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:11.657078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9974dff-c229-445f-a00c-806581f75e40 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:11.657762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9974dff-c229-445f-a00c-806581f75e40 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:11.658217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9974dff-c229-445f-a00c-806581f75e40 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:11.658644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9974dff-c229-445f-a00c-806581f75e40 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:11.801494 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f9974dff-c229-445f-a00c-806581f75e40 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:11.810091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f9974dff-c229-445f-a00c-806581f75e40 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.164482 Sep 02 09:33:11.815537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 51/108] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:11 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:11.893272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-321b2d16-3f13-4960-b64f-f2c6fa9a8e36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:11.893919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-321b2d16-3f13-4960-b64f-f2c6fa9a8e36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:11.900006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-321b2d16-3f13-4960-b64f-f2c6fa9a8e36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:11.900840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-321b2d16-3f13-4960-b64f-f2c6fa9a8e36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:11.901573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-321b2d16-3f13-4960-b64f-f2c6fa9a8e36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:11.902887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-321b2d16-3f13-4960-b64f-f2c6fa9a8e36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:11.903737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-321b2d16-3f13-4960-b64f-f2c6fa9a8e36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:11.904160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-321b2d16-3f13-4960-b64f-f2c6fa9a8e36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:12.035537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-321b2d16-3f13-4960-b64f-f2c6fa9a8e36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:12.043191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-321b2d16-3f13-4960-b64f-f2c6fa9a8e36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.154733 Sep 02 09:33:12.043754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 58/109] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:11 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:12.267545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e6b433d6-f550-4034-9b1d-6a6e74e98e58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:12.270805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e6b433d6-f550-4034-9b1d-6a6e74e98e58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:12.274609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6b433d6-f550-4034-9b1d-6a6e74e98e58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:12.275140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6b433d6-f550-4034-9b1d-6a6e74e98e58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:12.275658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6b433d6-f550-4034-9b1d-6a6e74e98e58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:12.276528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6b433d6-f550-4034-9b1d-6a6e74e98e58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:12.276994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6b433d6-f550-4034-9b1d-6a6e74e98e58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:12.277700 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6b433d6-f550-4034-9b1d-6a6e74e98e58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:12.406726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e6b433d6-f550-4034-9b1d-6a6e74e98e58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:12.420956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e6b433d6-f550-4034-9b1d-6a6e74e98e58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.156943 Sep 02 09:33:12.421913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 52/110] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:12 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:12.831365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-06a50a5e-4e42-40f7-a47b-07fd1a07f2b7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:12.832756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-06a50a5e-4e42-40f7-a47b-07fd1a07f2b7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:12.839265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a50a5e-4e42-40f7-a47b-07fd1a07f2b7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:12.840993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a50a5e-4e42-40f7-a47b-07fd1a07f2b7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:12.841851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a50a5e-4e42-40f7-a47b-07fd1a07f2b7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:12.842867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a50a5e-4e42-40f7-a47b-07fd1a07f2b7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:12.843366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a50a5e-4e42-40f7-a47b-07fd1a07f2b7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:12.843798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a50a5e-4e42-40f7-a47b-07fd1a07f2b7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:12.994435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-06a50a5e-4e42-40f7-a47b-07fd1a07f2b7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:13.002563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-06a50a5e-4e42-40f7-a47b-07fd1a07f2b7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.175142 Sep 02 09:33:13.007141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 59/111] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:12 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:13.065599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-df29711f-472e-4691-ac6a-934154edbc9d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:13.066272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-df29711f-472e-4691-ac6a-934154edbc9d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:13.075073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df29711f-472e-4691-ac6a-934154edbc9d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:13.075503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df29711f-472e-4691-ac6a-934154edbc9d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:13.075939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df29711f-472e-4691-ac6a-934154edbc9d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:13.076688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df29711f-472e-4691-ac6a-934154edbc9d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:13.077141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df29711f-472e-4691-ac6a-934154edbc9d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:13.077642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df29711f-472e-4691-ac6a-934154edbc9d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:13.221294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-df29711f-472e-4691-ac6a-934154edbc9d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:13.229971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-df29711f-472e-4691-ac6a-934154edbc9d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.169337 Sep 02 09:33:13.230849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 53/112] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:13 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:13.450791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a1a9ef9d-3d52-4ef6-8224-823b59bef2f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:13.451662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a1a9ef9d-3d52-4ef6-8224-823b59bef2f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:13.461904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1a9ef9d-3d52-4ef6-8224-823b59bef2f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:13.462685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1a9ef9d-3d52-4ef6-8224-823b59bef2f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:13.463361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1a9ef9d-3d52-4ef6-8224-823b59bef2f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:13.464226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1a9ef9d-3d52-4ef6-8224-823b59bef2f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:13.464779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1a9ef9d-3d52-4ef6-8224-823b59bef2f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:13.465298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1a9ef9d-3d52-4ef6-8224-823b59bef2f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:13.624423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a1a9ef9d-3d52-4ef6-8224-823b59bef2f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:13.631237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a1a9ef9d-3d52-4ef6-8224-823b59bef2f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.186149 Sep 02 09:33:13.631796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 60/113] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:13 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:14.025091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-36d30488-08a9-462b-8b0e-501af70888c6 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:14.025695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-36d30488-08a9-462b-8b0e-501af70888c6 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:14.031935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36d30488-08a9-462b-8b0e-501af70888c6 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:14.032418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36d30488-08a9-462b-8b0e-501af70888c6 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:14.032850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36d30488-08a9-462b-8b0e-501af70888c6 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:14.037842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36d30488-08a9-462b-8b0e-501af70888c6 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:14.037842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36d30488-08a9-462b-8b0e-501af70888c6 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:14.037842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-36d30488-08a9-462b-8b0e-501af70888c6 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:14.169559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-36d30488-08a9-462b-8b0e-501af70888c6 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:14.178287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-36d30488-08a9-462b-8b0e-501af70888c6 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.156646 Sep 02 09:33:14.179000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 54/114] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:14 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:14.252262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-162c0d3e-b261-4630-a44b-7ab7e741b0d3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:14.252706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-162c0d3e-b261-4630-a44b-7ab7e741b0d3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:14.259201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-162c0d3e-b261-4630-a44b-7ab7e741b0d3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:14.259697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-162c0d3e-b261-4630-a44b-7ab7e741b0d3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:14.260136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-162c0d3e-b261-4630-a44b-7ab7e741b0d3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:14.260881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-162c0d3e-b261-4630-a44b-7ab7e741b0d3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:14.261608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-162c0d3e-b261-4630-a44b-7ab7e741b0d3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:14.262042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-162c0d3e-b261-4630-a44b-7ab7e741b0d3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:14.280397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:14.412365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-162c0d3e-b261-4630-a44b-7ab7e741b0d3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:14.420559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-162c0d3e-b261-4630-a44b-7ab7e741b0d3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.172222 Sep 02 09:33:14.421215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 61/115] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:14 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:14.651573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e98400dc-79c9-4cf0-a608-af04b818e3ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:14.652180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e98400dc-79c9-4cf0-a608-af04b818e3ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:14.658326 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e98400dc-79c9-4cf0-a608-af04b818e3ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:14.658847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e98400dc-79c9-4cf0-a608-af04b818e3ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:14.659281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e98400dc-79c9-4cf0-a608-af04b818e3ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:14.660611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e98400dc-79c9-4cf0-a608-af04b818e3ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:14.661066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e98400dc-79c9-4cf0-a608-af04b818e3ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:14.661488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e98400dc-79c9-4cf0-a608-af04b818e3ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:14.679688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:14.837347 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e98400dc-79c9-4cf0-a608-af04b818e3ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:14.845411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e98400dc-79c9-4cf0-a608-af04b818e3ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.197614 Sep 02 09:33:14.845981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 55/116] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:14 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:15.202259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-78e25226-a974-4399-8a08-5a353bdad558 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:15.203271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-78e25226-a974-4399-8a08-5a353bdad558 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:15.210862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78e25226-a974-4399-8a08-5a353bdad558 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:15.211723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78e25226-a974-4399-8a08-5a353bdad558 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:15.212395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78e25226-a974-4399-8a08-5a353bdad558 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:15.213101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78e25226-a974-4399-8a08-5a353bdad558 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:15.213553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78e25226-a974-4399-8a08-5a353bdad558 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:15.213978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78e25226-a974-4399-8a08-5a353bdad558 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:15.350185 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-78e25226-a974-4399-8a08-5a353bdad558 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:15.358765 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-78e25226-a974-4399-8a08-5a353bdad558 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.161889 Sep 02 09:33:15.359674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 62/117] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:15 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:15.440613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fa1b380e-ce86-4de6-b721-2937f326e61e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:15.441793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fa1b380e-ce86-4de6-b721-2937f326e61e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:15.447979 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa1b380e-ce86-4de6-b721-2937f326e61e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:15.448459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa1b380e-ce86-4de6-b721-2937f326e61e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:15.448890 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa1b380e-ce86-4de6-b721-2937f326e61e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:15.449562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa1b380e-ce86-4de6-b721-2937f326e61e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:15.450010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa1b380e-ce86-4de6-b721-2937f326e61e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:15.450426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa1b380e-ce86-4de6-b721-2937f326e61e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:15.655059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fa1b380e-ce86-4de6-b721-2937f326e61e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:15.658309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fa1b380e-ce86-4de6-b721-2937f326e61e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.221817 Sep 02 09:33:15.662776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 56/118] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:15 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:15.869058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1a5bd264-34f8-47ec-b6cb-b326422125a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:15.869677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1a5bd264-34f8-47ec-b6cb-b326422125a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:15.876571 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a5bd264-34f8-47ec-b6cb-b326422125a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:15.877432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a5bd264-34f8-47ec-b6cb-b326422125a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:15.878050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a5bd264-34f8-47ec-b6cb-b326422125a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:15.880201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a5bd264-34f8-47ec-b6cb-b326422125a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:15.880821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a5bd264-34f8-47ec-b6cb-b326422125a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:15.881469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a5bd264-34f8-47ec-b6cb-b326422125a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:16.060835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1a5bd264-34f8-47ec-b6cb-b326422125a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:16.071213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1a5bd264-34f8-47ec-b6cb-b326422125a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.208880 Sep 02 09:33:16.072682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 63/119] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:15 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:16.382501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7fab6849-3fc6-4faf-a5c6-06339be3d50a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:16.383189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7fab6849-3fc6-4faf-a5c6-06339be3d50a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:16.391723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fab6849-3fc6-4faf-a5c6-06339be3d50a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:16.392223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fab6849-3fc6-4faf-a5c6-06339be3d50a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:16.392794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fab6849-3fc6-4faf-a5c6-06339be3d50a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:16.393426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fab6849-3fc6-4faf-a5c6-06339be3d50a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:16.393881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fab6849-3fc6-4faf-a5c6-06339be3d50a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:16.394302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fab6849-3fc6-4faf-a5c6-06339be3d50a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:16.530358 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7fab6849-3fc6-4faf-a5c6-06339be3d50a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:16.539491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7fab6849-3fc6-4faf-a5c6-06339be3d50a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.163059 Sep 02 09:33:16.540068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 57/120] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:16 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:16.679725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-69a41e13-5e36-472d-a79b-10184b2e17e4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:16.680540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-69a41e13-5e36-472d-a79b-10184b2e17e4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:16.686927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a41e13-5e36-472d-a79b-10184b2e17e4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:16.687512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a41e13-5e36-472d-a79b-10184b2e17e4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:16.688172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a41e13-5e36-472d-a79b-10184b2e17e4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:16.689084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a41e13-5e36-472d-a79b-10184b2e17e4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:16.692308 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a41e13-5e36-472d-a79b-10184b2e17e4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:16.692833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a41e13-5e36-472d-a79b-10184b2e17e4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:16.843823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-69a41e13-5e36-472d-a79b-10184b2e17e4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:16.849067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-69a41e13-5e36-472d-a79b-10184b2e17e4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.173652 Sep 02 09:33:16.849987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 64/121] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:16 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:17.098507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-511f0a67-94b9-45ba-8415-ec5be4c3fb00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:17.099066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-511f0a67-94b9-45ba-8415-ec5be4c3fb00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:17.105160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-511f0a67-94b9-45ba-8415-ec5be4c3fb00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:17.105648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-511f0a67-94b9-45ba-8415-ec5be4c3fb00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:17.106086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-511f0a67-94b9-45ba-8415-ec5be4c3fb00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:17.106801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-511f0a67-94b9-45ba-8415-ec5be4c3fb00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:17.107920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-511f0a67-94b9-45ba-8415-ec5be4c3fb00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:17.107920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-511f0a67-94b9-45ba-8415-ec5be4c3fb00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:17.291424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-511f0a67-94b9-45ba-8415-ec5be4c3fb00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:17.300575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-511f0a67-94b9-45ba-8415-ec5be4c3fb00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.205615 Sep 02 09:33:17.302367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 58/122] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:17 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:17.560008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2cca9462-82f8-40ce-b1e8-e5858dc1362b tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:17.560734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2cca9462-82f8-40ce-b1e8-e5858dc1362b tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:17.568595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cca9462-82f8-40ce-b1e8-e5858dc1362b tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:17.569090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cca9462-82f8-40ce-b1e8-e5858dc1362b tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:17.569525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cca9462-82f8-40ce-b1e8-e5858dc1362b tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:17.570337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cca9462-82f8-40ce-b1e8-e5858dc1362b tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:17.570975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cca9462-82f8-40ce-b1e8-e5858dc1362b tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:17.571396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cca9462-82f8-40ce-b1e8-e5858dc1362b tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:17.741598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2cca9462-82f8-40ce-b1e8-e5858dc1362b tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:17.749531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2cca9462-82f8-40ce-b1e8-e5858dc1362b tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.193604 Sep 02 09:33:17.750176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 65/123] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:17 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:17.871611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6adc6c06-8649-4b9b-b8ed-695651a80ce1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:17.872225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6adc6c06-8649-4b9b-b8ed-695651a80ce1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:17.878379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6adc6c06-8649-4b9b-b8ed-695651a80ce1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:17.878965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6adc6c06-8649-4b9b-b8ed-695651a80ce1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:17.879661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6adc6c06-8649-4b9b-b8ed-695651a80ce1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:17.880350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6adc6c06-8649-4b9b-b8ed-695651a80ce1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:17.881002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6adc6c06-8649-4b9b-b8ed-695651a80ce1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:17.881485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6adc6c06-8649-4b9b-b8ed-695651a80ce1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:18.012761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6adc6c06-8649-4b9b-b8ed-695651a80ce1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:18.021646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6adc6c06-8649-4b9b-b8ed-695651a80ce1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.153878 Sep 02 09:33:18.022441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 59/124] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:17 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:18.329672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cd7e52df-f6f6-4d81-9489-f7daa5827321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:18.330432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cd7e52df-f6f6-4d81-9489-f7daa5827321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:18.339621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd7e52df-f6f6-4d81-9489-f7daa5827321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:18.340699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd7e52df-f6f6-4d81-9489-f7daa5827321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:18.341419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd7e52df-f6f6-4d81-9489-f7daa5827321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:18.342941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd7e52df-f6f6-4d81-9489-f7daa5827321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:18.343556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd7e52df-f6f6-4d81-9489-f7daa5827321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:18.344138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd7e52df-f6f6-4d81-9489-f7daa5827321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:18.537925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cd7e52df-f6f6-4d81-9489-f7daa5827321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:18.546907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cd7e52df-f6f6-4d81-9489-f7daa5827321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.220968 Sep 02 09:33:18.547503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 66/125] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:18 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:18.771508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-435180e4-90b7-4774-9b9d-69c50587d130 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:18.772493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-435180e4-90b7-4774-9b9d-69c50587d130 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:18.782668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-435180e4-90b7-4774-9b9d-69c50587d130 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:18.783391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-435180e4-90b7-4774-9b9d-69c50587d130 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:18.784617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-435180e4-90b7-4774-9b9d-69c50587d130 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:18.785649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-435180e4-90b7-4774-9b9d-69c50587d130 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:18.786438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-435180e4-90b7-4774-9b9d-69c50587d130 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:18.787457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-435180e4-90b7-4774-9b9d-69c50587d130 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:18.947855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-435180e4-90b7-4774-9b9d-69c50587d130 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:18.955946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-435180e4-90b7-4774-9b9d-69c50587d130 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.189235 Sep 02 09:33:18.956550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 60/126] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:18 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:19.046526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c9e67615-6f6c-4932-a379-2bd3be24569a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:19.047186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c9e67615-6f6c-4932-a379-2bd3be24569a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:19.053716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9e67615-6f6c-4932-a379-2bd3be24569a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:19.054194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9e67615-6f6c-4932-a379-2bd3be24569a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:19.054625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9e67615-6f6c-4932-a379-2bd3be24569a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:19.055355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9e67615-6f6c-4932-a379-2bd3be24569a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:19.055851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9e67615-6f6c-4932-a379-2bd3be24569a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:19.056269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9e67615-6f6c-4932-a379-2bd3be24569a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:19.187759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c9e67615-6f6c-4932-a379-2bd3be24569a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:19.195726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c9e67615-6f6c-4932-a379-2bd3be24569a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.155503 Sep 02 09:33:19.196473 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 67/127] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:19 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:19.568483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-96ef590f-4c95-465c-8fa5-f21eb80c92a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:19.569115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-96ef590f-4c95-465c-8fa5-f21eb80c92a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:19.574976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ef590f-4c95-465c-8fa5-f21eb80c92a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:19.575460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ef590f-4c95-465c-8fa5-f21eb80c92a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:19.575894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ef590f-4c95-465c-8fa5-f21eb80c92a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:19.576574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ef590f-4c95-465c-8fa5-f21eb80c92a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:19.577023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ef590f-4c95-465c-8fa5-f21eb80c92a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:19.577445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96ef590f-4c95-465c-8fa5-f21eb80c92a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:19.725534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-96ef590f-4c95-465c-8fa5-f21eb80c92a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:19.733675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-96ef590f-4c95-465c-8fa5-f21eb80c92a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.169166 Sep 02 09:33:19.734254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 61/128] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:19 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:19.976855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ce4cf8f1-8bd6-4d3f-a581-69f59bada6a3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:19.977783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ce4cf8f1-8bd6-4d3f-a581-69f59bada6a3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:19.994828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4cf8f1-8bd6-4d3f-a581-69f59bada6a3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:19.994828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4cf8f1-8bd6-4d3f-a581-69f59bada6a3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:19.994828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4cf8f1-8bd6-4d3f-a581-69f59bada6a3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:19.994828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4cf8f1-8bd6-4d3f-a581-69f59bada6a3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:19.995155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4cf8f1-8bd6-4d3f-a581-69f59bada6a3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:19.995155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4cf8f1-8bd6-4d3f-a581-69f59bada6a3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:20.017676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-94dcfa49-9642-4b8f-9ec8-9139148dd257 req-4fe48283-71ed-4d8b-b7a4-e7586ceb1638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba2a7e8-15a8-4066-9554-49c48ea52a5e", "name": "network-vif-plugged", "status": "completed", "tag": "71a514a3-ca0b-42e8-b44f-cede338a5920"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:33:20.028859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-94dcfa49-9642-4b8f-9ec8-9139148dd257 req-4fe48283-71ed-4d8b-b7a4-e7586ceb1638 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:20.029415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-94dcfa49-9642-4b8f-9ec8-9139148dd257 req-4fe48283-71ed-4d8b-b7a4-e7586ceb1638 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:20.029950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-94dcfa49-9642-4b8f-9ec8-9139148dd257 req-4fe48283-71ed-4d8b-b7a4-e7586ceb1638 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:20.042954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-94dcfa49-9642-4b8f-9ec8-9139148dd257 req-4fe48283-71ed-4d8b-b7a4-e7586ceb1638 service nova] Creating event network-vif-plugged:71a514a3-ca0b-42e8-b44f-cede338a5920 for instance 7ba2a7e8-15a8-4066-9554-49c48ea52a5e on hv-cinder-85083 Sep 02 09:33:20.048474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-94dcfa49-9642-4b8f-9ec8-9139148dd257 req-4fe48283-71ed-4d8b-b7a4-e7586ceb1638 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097194 Sep 02 09:33:20.049151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 68/129] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:33:20.134086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ce4cf8f1-8bd6-4d3f-a581-69f59bada6a3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:20.141708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ce4cf8f1-8bd6-4d3f-a581-69f59bada6a3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.169443 Sep 02 09:33:20.142285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 62/130] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:19 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:20.216889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-98648f62-4ab5-462d-92de-dd853d6a27ee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:20.217625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-98648f62-4ab5-462d-92de-dd853d6a27ee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:20.223857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98648f62-4ab5-462d-92de-dd853d6a27ee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:20.224378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98648f62-4ab5-462d-92de-dd853d6a27ee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:20.224809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98648f62-4ab5-462d-92de-dd853d6a27ee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:20.225474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98648f62-4ab5-462d-92de-dd853d6a27ee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:20.225924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98648f62-4ab5-462d-92de-dd853d6a27ee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:20.226337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98648f62-4ab5-462d-92de-dd853d6a27ee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:20.374394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-98648f62-4ab5-462d-92de-dd853d6a27ee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:20.386605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-98648f62-4ab5-462d-92de-dd853d6a27ee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.173838 Sep 02 09:33:20.387708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 69/131] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:20 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:20.755381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5dd0fb2e-8bd8-42fc-81c8-8be0a3870adb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:20.755993 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5dd0fb2e-8bd8-42fc-81c8-8be0a3870adb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:20.761967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb2e-8bd8-42fc-81c8-8be0a3870adb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:20.762443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb2e-8bd8-42fc-81c8-8be0a3870adb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:20.762984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb2e-8bd8-42fc-81c8-8be0a3870adb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:20.766614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb2e-8bd8-42fc-81c8-8be0a3870adb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:20.767118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb2e-8bd8-42fc-81c8-8be0a3870adb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:20.767555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb2e-8bd8-42fc-81c8-8be0a3870adb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:20.901610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5dd0fb2e-8bd8-42fc-81c8-8be0a3870adb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:20.909259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5dd0fb2e-8bd8-42fc-81c8-8be0a3870adb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.158359 Sep 02 09:33:20.909828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 63/132] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:20 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:21.163092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0e3aa087-e67f-4a69-b58f-65ee4ecd3503 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:21.163816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0e3aa087-e67f-4a69-b58f-65ee4ecd3503 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:21.169746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3aa087-e67f-4a69-b58f-65ee4ecd3503 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:21.170353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3aa087-e67f-4a69-b58f-65ee4ecd3503 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:21.170815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3aa087-e67f-4a69-b58f-65ee4ecd3503 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:21.171492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3aa087-e67f-4a69-b58f-65ee4ecd3503 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:21.171941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3aa087-e67f-4a69-b58f-65ee4ecd3503 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:21.172358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3aa087-e67f-4a69-b58f-65ee4ecd3503 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:21.309489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0e3aa087-e67f-4a69-b58f-65ee4ecd3503 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:21.317119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0e3aa087-e67f-4a69-b58f-65ee4ecd3503 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.158651 Sep 02 09:33:21.317724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 70/133] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:21 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:21.409538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-56aead31-e761-471b-93f1-da84b0115c11 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:21.410612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-56aead31-e761-471b-93f1-da84b0115c11 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:21.417063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56aead31-e761-471b-93f1-da84b0115c11 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:21.417668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56aead31-e761-471b-93f1-da84b0115c11 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:21.418108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56aead31-e761-471b-93f1-da84b0115c11 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:21.418825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56aead31-e761-471b-93f1-da84b0115c11 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:21.419334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56aead31-e761-471b-93f1-da84b0115c11 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:21.419756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56aead31-e761-471b-93f1-da84b0115c11 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:21.584215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-56aead31-e761-471b-93f1-da84b0115c11 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:21.593735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-56aead31-e761-471b-93f1-da84b0115c11 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.188155 Sep 02 09:33:21.594765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 64/134] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:21 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:21.929384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f922d761-5d4c-4576-a2d9-f4e2244607ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:21.930032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f922d761-5d4c-4576-a2d9-f4e2244607ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:21.936084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f922d761-5d4c-4576-a2d9-f4e2244607ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:21.936658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f922d761-5d4c-4576-a2d9-f4e2244607ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:21.937157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f922d761-5d4c-4576-a2d9-f4e2244607ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:21.937900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f922d761-5d4c-4576-a2d9-f4e2244607ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:21.938411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f922d761-5d4c-4576-a2d9-f4e2244607ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:21.939659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f922d761-5d4c-4576-a2d9-f4e2244607ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:22.080571 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f922d761-5d4c-4576-a2d9-f4e2244607ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:22.089319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f922d761-5d4c-4576-a2d9-f4e2244607ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.163815 Sep 02 09:33:22.090077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 71/135] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:21 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:22.337463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fce611b7-d60a-4d6c-bc8d-97c477b3e764 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:22.338428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fce611b7-d60a-4d6c-bc8d-97c477b3e764 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:22.346213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fce611b7-d60a-4d6c-bc8d-97c477b3e764 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:22.346829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fce611b7-d60a-4d6c-bc8d-97c477b3e764 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:22.347357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fce611b7-d60a-4d6c-bc8d-97c477b3e764 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:22.348119 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fce611b7-d60a-4d6c-bc8d-97c477b3e764 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:22.348606 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fce611b7-d60a-4d6c-bc8d-97c477b3e764 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:22.349036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fce611b7-d60a-4d6c-bc8d-97c477b3e764 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:22.479531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fce611b7-d60a-4d6c-bc8d-97c477b3e764 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:22.500514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fce611b7-d60a-4d6c-bc8d-97c477b3e764 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.166834 Sep 02 09:33:22.501728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 65/136] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:22 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:22.617349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-eea8194a-f0c5-4f98-8ae3-f9db6c357623 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:22.617951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-eea8194a-f0c5-4f98-8ae3-f9db6c357623 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:22.623934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eea8194a-f0c5-4f98-8ae3-f9db6c357623 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:22.624409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eea8194a-f0c5-4f98-8ae3-f9db6c357623 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:22.624840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eea8194a-f0c5-4f98-8ae3-f9db6c357623 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:22.630442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eea8194a-f0c5-4f98-8ae3-f9db6c357623 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:22.630442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eea8194a-f0c5-4f98-8ae3-f9db6c357623 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:22.630442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eea8194a-f0c5-4f98-8ae3-f9db6c357623 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:22.793015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eea8194a-f0c5-4f98-8ae3-f9db6c357623 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:22.801690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-eea8194a-f0c5-4f98-8ae3-f9db6c357623 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.188104 Sep 02 09:33:22.802272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 72/137] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:22 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:23.113872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-970abd51-b048-4133-aac7-d58edd76ecf8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:23.114480 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-970abd51-b048-4133-aac7-d58edd76ecf8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:23.120484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-970abd51-b048-4133-aac7-d58edd76ecf8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:23.120975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-970abd51-b048-4133-aac7-d58edd76ecf8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:23.121408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-970abd51-b048-4133-aac7-d58edd76ecf8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:23.122080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-970abd51-b048-4133-aac7-d58edd76ecf8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:23.122527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-970abd51-b048-4133-aac7-d58edd76ecf8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:23.122973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-970abd51-b048-4133-aac7-d58edd76ecf8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:23.265860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-970abd51-b048-4133-aac7-d58edd76ecf8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:23.273814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-970abd51-b048-4133-aac7-d58edd76ecf8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.164240 Sep 02 09:33:23.274446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 66/138] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:23 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:23.521883 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7c9a4698-d909-49d4-b4f4-4ff357b2f5bc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:23.522495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7c9a4698-d909-49d4-b4f4-4ff357b2f5bc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:23.528692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c9a4698-d909-49d4-b4f4-4ff357b2f5bc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:23.529177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c9a4698-d909-49d4-b4f4-4ff357b2f5bc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:23.529905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c9a4698-d909-49d4-b4f4-4ff357b2f5bc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:23.541242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c9a4698-d909-49d4-b4f4-4ff357b2f5bc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:23.541444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c9a4698-d909-49d4-b4f4-4ff357b2f5bc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:23.541879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c9a4698-d909-49d4-b4f4-4ff357b2f5bc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:23.742601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7c9a4698-d909-49d4-b4f4-4ff357b2f5bc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:23.755340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7c9a4698-d909-49d4-b4f4-4ff357b2f5bc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.237370 Sep 02 09:33:23.756289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 73/139] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:23 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:23.821545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f1d82a50-eff5-4ae3-905c-719a303f33f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:23.822146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f1d82a50-eff5-4ae3-905c-719a303f33f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:23.828250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1d82a50-eff5-4ae3-905c-719a303f33f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:23.828749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1d82a50-eff5-4ae3-905c-719a303f33f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:23.829266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1d82a50-eff5-4ae3-905c-719a303f33f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:23.829876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1d82a50-eff5-4ae3-905c-719a303f33f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:23.830356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1d82a50-eff5-4ae3-905c-719a303f33f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:23.830729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1d82a50-eff5-4ae3-905c-719a303f33f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:23.865058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-62fa0696-4031-46df-a162-53dc16f69491 req-6ade5a8e-b86f-417e-913d-2365770e7bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d770bc-892d-4464-aa30-ded0926f7a13", "name": "network-vif-plugged", "status": "completed", "tag": "2dde1031-6e53-4864-957c-6a89464b2c48"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:33:23.879615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-62fa0696-4031-46df-a162-53dc16f69491 req-6ade5a8e-b86f-417e-913d-2365770e7bd9 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:23.882482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-62fa0696-4031-46df-a162-53dc16f69491 req-6ade5a8e-b86f-417e-913d-2365770e7bd9 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:23.882482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-62fa0696-4031-46df-a162-53dc16f69491 req-6ade5a8e-b86f-417e-913d-2365770e7bd9 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:23.891676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-62fa0696-4031-46df-a162-53dc16f69491 req-6ade5a8e-b86f-417e-913d-2365770e7bd9 service nova] Creating event network-vif-plugged:2dde1031-6e53-4864-957c-6a89464b2c48 for instance 95d770bc-892d-4464-aa30-ded0926f7a13 on hv-cinder-85083 Sep 02 09:33:23.896550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-62fa0696-4031-46df-a162-53dc16f69491 req-6ade5a8e-b86f-417e-913d-2365770e7bd9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035668 Sep 02 09:33:23.897132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 74/140] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:33:23.983240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f1d82a50-eff5-4ae3-905c-719a303f33f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:23.991273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f1d82a50-eff5-4ae3-905c-719a303f33f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.173708 Sep 02 09:33:23.992419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 67/141] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:23 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:24.298533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4e21ec7d-db7d-465b-ae2d-f32d1827f370 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:24.299236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4e21ec7d-db7d-465b-ae2d-f32d1827f370 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:24.307585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e21ec7d-db7d-465b-ae2d-f32d1827f370 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:24.308076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e21ec7d-db7d-465b-ae2d-f32d1827f370 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:24.308513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e21ec7d-db7d-465b-ae2d-f32d1827f370 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:24.309199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e21ec7d-db7d-465b-ae2d-f32d1827f370 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:24.309646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e21ec7d-db7d-465b-ae2d-f32d1827f370 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:24.310081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e21ec7d-db7d-465b-ae2d-f32d1827f370 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:24.461468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4e21ec7d-db7d-465b-ae2d-f32d1827f370 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:24.469224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4e21ec7d-db7d-465b-ae2d-f32d1827f370 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.174943 Sep 02 09:33:24.469842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 75/142] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:24 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:24.776515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-13851190-7d45-42cd-ac92-915325566271 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:24.777257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-13851190-7d45-42cd-ac92-915325566271 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:24.783497 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13851190-7d45-42cd-ac92-915325566271 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:24.784024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13851190-7d45-42cd-ac92-915325566271 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:24.784462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13851190-7d45-42cd-ac92-915325566271 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:24.785832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13851190-7d45-42cd-ac92-915325566271 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:24.786318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13851190-7d45-42cd-ac92-915325566271 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:24.786764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13851190-7d45-42cd-ac92-915325566271 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:24.925501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-13851190-7d45-42cd-ac92-915325566271 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:24.934272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-13851190-7d45-42cd-ac92-915325566271 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.161680 Sep 02 09:33:24.934910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 68/143] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:24 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:25.105347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-16659c79-aad1-47b2-ae3c-92c63990abb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:25.105347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-16659c79-aad1-47b2-ae3c-92c63990abb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:25.105347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-16659c79-aad1-47b2-ae3c-92c63990abb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:25.105347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-16659c79-aad1-47b2-ae3c-92c63990abb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:25.107293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-16659c79-aad1-47b2-ae3c-92c63990abb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:25.107293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-16659c79-aad1-47b2-ae3c-92c63990abb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:25.107293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-16659c79-aad1-47b2-ae3c-92c63990abb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:25.107293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-16659c79-aad1-47b2-ae3c-92c63990abb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:25.149988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-16659c79-aad1-47b2-ae3c-92c63990abb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:25.157938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-16659c79-aad1-47b2-ae3c-92c63990abb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.148906 Sep 02 09:33:25.158560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 76/144] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:25.490675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-309de2c7-4e37-42f5-a8f4-6696b25f9055 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:25.491409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-309de2c7-4e37-42f5-a8f4-6696b25f9055 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:25.497492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-309de2c7-4e37-42f5-a8f4-6696b25f9055 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:25.498070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-309de2c7-4e37-42f5-a8f4-6696b25f9055 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:25.498577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-309de2c7-4e37-42f5-a8f4-6696b25f9055 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:25.499336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-309de2c7-4e37-42f5-a8f4-6696b25f9055 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:25.499790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-309de2c7-4e37-42f5-a8f4-6696b25f9055 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:25.500214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-309de2c7-4e37-42f5-a8f4-6696b25f9055 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:25.892219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-309de2c7-4e37-42f5-a8f4-6696b25f9055 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:25.903364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-309de2c7-4e37-42f5-a8f4-6696b25f9055 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.416436 Sep 02 09:33:25.907767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 69/145] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:25 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:25.955728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-85691c5b-7c14-448c-8501-df116bf5d058 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:25.961687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-85691c5b-7c14-448c-8501-df116bf5d058 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:25.966365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85691c5b-7c14-448c-8501-df116bf5d058 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:25.966929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85691c5b-7c14-448c-8501-df116bf5d058 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:25.967693 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85691c5b-7c14-448c-8501-df116bf5d058 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:25.968395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85691c5b-7c14-448c-8501-df116bf5d058 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:25.968998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85691c5b-7c14-448c-8501-df116bf5d058 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:25.969623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85691c5b-7c14-448c-8501-df116bf5d058 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:26.180619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3e719d5f-b152-4e04-92eb-fa86506ada3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:26.181859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3e719d5f-b152-4e04-92eb-fa86506ada3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:26.189016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e719d5f-b152-4e04-92eb-fa86506ada3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:26.189681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e719d5f-b152-4e04-92eb-fa86506ada3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:26.190275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e719d5f-b152-4e04-92eb-fa86506ada3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:26.191166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e719d5f-b152-4e04-92eb-fa86506ada3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:26.191770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e719d5f-b152-4e04-92eb-fa86506ada3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:26.192395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3e719d5f-b152-4e04-92eb-fa86506ada3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:26.604054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-85691c5b-7c14-448c-8501-df116bf5d058 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:26.614525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-85691c5b-7c14-448c-8501-df116bf5d058 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.662228 Sep 02 09:33:26.628526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 77/146] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:25 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:26.629174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3e719d5f-b152-4e04-92eb-fa86506ada3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:26.636217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3e719d5f-b152-4e04-92eb-fa86506ada3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.460171 Sep 02 09:33:26.646108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 70/147] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:26 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:26.926032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4a1fc80f-6163-4d5f-99da-aab720dc3415 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:26.926822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4a1fc80f-6163-4d5f-99da-aab720dc3415 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:26.933378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a1fc80f-6163-4d5f-99da-aab720dc3415 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:26.933863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a1fc80f-6163-4d5f-99da-aab720dc3415 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:26.934300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a1fc80f-6163-4d5f-99da-aab720dc3415 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:26.935101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a1fc80f-6163-4d5f-99da-aab720dc3415 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:26.935557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a1fc80f-6163-4d5f-99da-aab720dc3415 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:26.935981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a1fc80f-6163-4d5f-99da-aab720dc3415 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:27.075855 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4a1fc80f-6163-4d5f-99da-aab720dc3415 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:27.085881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4a1fc80f-6163-4d5f-99da-aab720dc3415 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.163573 Sep 02 09:33:27.086490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 78/148] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:26 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:27.636176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b8a03406-381c-4349-8595-4f9be47dcfe8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:27.636779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b8a03406-381c-4349-8595-4f9be47dcfe8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:27.647016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8a03406-381c-4349-8595-4f9be47dcfe8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:27.647016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8a03406-381c-4349-8595-4f9be47dcfe8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:27.647016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8a03406-381c-4349-8595-4f9be47dcfe8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:27.647016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8a03406-381c-4349-8595-4f9be47dcfe8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:27.647333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8a03406-381c-4349-8595-4f9be47dcfe8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:27.647333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8a03406-381c-4349-8595-4f9be47dcfe8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:27.657417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a8302f83-54b9-4ab7-9ca3-9470b799681a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:27.658165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a8302f83-54b9-4ab7-9ca3-9470b799681a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:27.665668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8302f83-54b9-4ab7-9ca3-9470b799681a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:27.666435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8302f83-54b9-4ab7-9ca3-9470b799681a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:27.667051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8302f83-54b9-4ab7-9ca3-9470b799681a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:27.667751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8302f83-54b9-4ab7-9ca3-9470b799681a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:27.668210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8302f83-54b9-4ab7-9ca3-9470b799681a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:27.668700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8302f83-54b9-4ab7-9ca3-9470b799681a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:27.688121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:27.807847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a8302f83-54b9-4ab7-9ca3-9470b799681a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:27.815538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a8302f83-54b9-4ab7-9ca3-9470b799681a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.162057 Sep 02 09:33:27.816116 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 79/149] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:27 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:27.816482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b8a03406-381c-4349-8595-4f9be47dcfe8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:27.832403 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b8a03406-381c-4349-8595-4f9be47dcfe8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.200488 Sep 02 09:33:27.834836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 71/150] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:27 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:28.122330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b92d4257-c3b2-461e-9d63-07feb35ba2bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:28.122330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b92d4257-c3b2-461e-9d63-07feb35ba2bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:28.122330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b92d4257-c3b2-461e-9d63-07feb35ba2bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:28.122330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b92d4257-c3b2-461e-9d63-07feb35ba2bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:28.122697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b92d4257-c3b2-461e-9d63-07feb35ba2bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:28.122697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b92d4257-c3b2-461e-9d63-07feb35ba2bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:28.122697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b92d4257-c3b2-461e-9d63-07feb35ba2bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:28.123329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b92d4257-c3b2-461e-9d63-07feb35ba2bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:28.258568 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b92d4257-c3b2-461e-9d63-07feb35ba2bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:28.266284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b92d4257-c3b2-461e-9d63-07feb35ba2bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.157877 Sep 02 09:33:28.266880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 80/151] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:28 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:28.835665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-57466630-c2a1-47d6-8973-ee4c143e1742 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:28.836894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-57466630-c2a1-47d6-8973-ee4c143e1742 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:28.842920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57466630-c2a1-47d6-8973-ee4c143e1742 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:28.847696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57466630-c2a1-47d6-8973-ee4c143e1742 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:28.847696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57466630-c2a1-47d6-8973-ee4c143e1742 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:28.847696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57466630-c2a1-47d6-8973-ee4c143e1742 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:28.847696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57466630-c2a1-47d6-8973-ee4c143e1742 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:28.848721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57466630-c2a1-47d6-8973-ee4c143e1742 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:28.850909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:28.854206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0d45aab3-d623-48c5-8cd1-e1185b5499e3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:28.854849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0d45aab3-d623-48c5-8cd1-e1185b5499e3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:28.860966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d45aab3-d623-48c5-8cd1-e1185b5499e3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:28.861692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d45aab3-d623-48c5-8cd1-e1185b5499e3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:28.862125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d45aab3-d623-48c5-8cd1-e1185b5499e3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:28.862828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d45aab3-d623-48c5-8cd1-e1185b5499e3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:28.863437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d45aab3-d623-48c5-8cd1-e1185b5499e3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:28.864071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d45aab3-d623-48c5-8cd1-e1185b5499e3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:29.013628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-57466630-c2a1-47d6-8973-ee4c143e1742 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:29.014239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0d45aab3-d623-48c5-8cd1-e1185b5499e3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:29.021599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-57466630-c2a1-47d6-8973-ee4c143e1742 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.189913 Sep 02 09:33:29.022170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 72/152] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:28 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:29.022353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0d45aab3-d623-48c5-8cd1-e1185b5499e3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.172107 Sep 02 09:33:29.022965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 81/153] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:28 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:29.287421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f612a9bc-936c-40ef-856d-8e491a6773be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:29.288037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f612a9bc-936c-40ef-856d-8e491a6773be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:29.294762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f612a9bc-936c-40ef-856d-8e491a6773be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:29.295290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f612a9bc-936c-40ef-856d-8e491a6773be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:29.295717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f612a9bc-936c-40ef-856d-8e491a6773be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:29.296391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f612a9bc-936c-40ef-856d-8e491a6773be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:29.296836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f612a9bc-936c-40ef-856d-8e491a6773be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:29.297253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f612a9bc-936c-40ef-856d-8e491a6773be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:29.424063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f612a9bc-936c-40ef-856d-8e491a6773be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:29.432419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f612a9bc-936c-40ef-856d-8e491a6773be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.148882 Sep 02 09:33:29.433083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 73/154] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:29 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:30.046015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-88da4514-e1eb-4e29-82c5-0152497e75da tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:30.046532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-245a1875-fd6b-4ee5-bbc1-6f37a20f9709 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:30.046910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-88da4514-e1eb-4e29-82c5-0152497e75da tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:30.047000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-245a1875-fd6b-4ee5-bbc1-6f37a20f9709 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:30.052674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-245a1875-fd6b-4ee5-bbc1-6f37a20f9709 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:30.052800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-88da4514-e1eb-4e29-82c5-0152497e75da tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:30.053046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-245a1875-fd6b-4ee5-bbc1-6f37a20f9709 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:30.053140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-88da4514-e1eb-4e29-82c5-0152497e75da tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:30.053473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-245a1875-fd6b-4ee5-bbc1-6f37a20f9709 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:30.053588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-88da4514-e1eb-4e29-82c5-0152497e75da tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:30.054145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-245a1875-fd6b-4ee5-bbc1-6f37a20f9709 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:30.054245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-88da4514-e1eb-4e29-82c5-0152497e75da tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:30.054647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-245a1875-fd6b-4ee5-bbc1-6f37a20f9709 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:30.054773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-88da4514-e1eb-4e29-82c5-0152497e75da tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:30.055094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-245a1875-fd6b-4ee5-bbc1-6f37a20f9709 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:30.055200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-88da4514-e1eb-4e29-82c5-0152497e75da tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:30.186661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-245a1875-fd6b-4ee5-bbc1-6f37a20f9709 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:30.187318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-88da4514-e1eb-4e29-82c5-0152497e75da tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:30.195783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-245a1875-fd6b-4ee5-bbc1-6f37a20f9709 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.152982 Sep 02 09:33:30.197220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-88da4514-e1eb-4e29-82c5-0152497e75da tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.155052 Sep 02 09:33:30.198280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 82/155] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:30 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:30.207318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 74/156] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:30 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:30.452874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0cbf957f-1740-4fce-ac1c-a3ccde01790c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:30.453410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0cbf957f-1740-4fce-ac1c-a3ccde01790c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:30.459298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0cbf957f-1740-4fce-ac1c-a3ccde01790c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:30.459777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0cbf957f-1740-4fce-ac1c-a3ccde01790c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:30.463048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0cbf957f-1740-4fce-ac1c-a3ccde01790c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:30.463048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0cbf957f-1740-4fce-ac1c-a3ccde01790c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:30.463048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0cbf957f-1740-4fce-ac1c-a3ccde01790c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:30.463048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0cbf957f-1740-4fce-ac1c-a3ccde01790c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:30.633621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0cbf957f-1740-4fce-ac1c-a3ccde01790c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:30.642233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0cbf957f-1740-4fce-ac1c-a3ccde01790c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.193364 Sep 02 09:33:30.643794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 83/157] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:30 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:31.217896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c8501f65-600a-4a2e-b3e9-ee5dbc5b9bb3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:31.218516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c8501f65-600a-4a2e-b3e9-ee5dbc5b9bb3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:31.221750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fd01c770-289c-4679-ab7c-fac230943ff1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:31.222154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fd01c770-289c-4679-ab7c-fac230943ff1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:31.224723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8501f65-600a-4a2e-b3e9-ee5dbc5b9bb3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:31.225403 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8501f65-600a-4a2e-b3e9-ee5dbc5b9bb3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:31.225964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8501f65-600a-4a2e-b3e9-ee5dbc5b9bb3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:31.231253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8501f65-600a-4a2e-b3e9-ee5dbc5b9bb3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:31.231253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8501f65-600a-4a2e-b3e9-ee5dbc5b9bb3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:31.231253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8501f65-600a-4a2e-b3e9-ee5dbc5b9bb3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:31.231514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd01c770-289c-4679-ab7c-fac230943ff1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:31.231514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd01c770-289c-4679-ab7c-fac230943ff1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:31.231514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd01c770-289c-4679-ab7c-fac230943ff1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:31.231514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd01c770-289c-4679-ab7c-fac230943ff1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:31.231981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd01c770-289c-4679-ab7c-fac230943ff1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:31.231981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd01c770-289c-4679-ab7c-fac230943ff1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:31.403327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c8501f65-600a-4a2e-b3e9-ee5dbc5b9bb3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:31.411120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c8501f65-600a-4a2e-b3e9-ee5dbc5b9bb3 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.197444 Sep 02 09:33:31.424312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 75/158] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:31 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:31.446276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fd01c770-289c-4679-ab7c-fac230943ff1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:31.455714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fd01c770-289c-4679-ab7c-fac230943ff1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.237670 Sep 02 09:33:31.456393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 84/159] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:31 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:31.667281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e03303a8-e312-49ab-a2f0-a8089a45d87e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:31.667915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e03303a8-e312-49ab-a2f0-a8089a45d87e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:31.673841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e03303a8-e312-49ab-a2f0-a8089a45d87e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:31.674323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e03303a8-e312-49ab-a2f0-a8089a45d87e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:31.674785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e03303a8-e312-49ab-a2f0-a8089a45d87e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:31.675461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e03303a8-e312-49ab-a2f0-a8089a45d87e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:31.675910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e03303a8-e312-49ab-a2f0-a8089a45d87e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:31.676331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e03303a8-e312-49ab-a2f0-a8089a45d87e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:31.815456 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e03303a8-e312-49ab-a2f0-a8089a45d87e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:31.824346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e03303a8-e312-49ab-a2f0-a8089a45d87e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1322 microversion: 2.1 time: 0.161419 Sep 02 09:33:31.825051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 76/160] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:31 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:32.431896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d8db2664-7ab9-4ce9-9d43-2f60435b6f85 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:32.432510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d8db2664-7ab9-4ce9-9d43-2f60435b6f85 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:32.438408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8db2664-7ab9-4ce9-9d43-2f60435b6f85 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:32.438944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8db2664-7ab9-4ce9-9d43-2f60435b6f85 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:32.439360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8db2664-7ab9-4ce9-9d43-2f60435b6f85 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:32.440039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8db2664-7ab9-4ce9-9d43-2f60435b6f85 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:32.440487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8db2664-7ab9-4ce9-9d43-2f60435b6f85 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:32.440911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8db2664-7ab9-4ce9-9d43-2f60435b6f85 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:32.479157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b73ec15c-b387-4a23-8919-c8e60c7694d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:32.479722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b73ec15c-b387-4a23-8919-c8e60c7694d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:32.486077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b73ec15c-b387-4a23-8919-c8e60c7694d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:32.486627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b73ec15c-b387-4a23-8919-c8e60c7694d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:32.487258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b73ec15c-b387-4a23-8919-c8e60c7694d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:32.488617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b73ec15c-b387-4a23-8919-c8e60c7694d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:32.489070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b73ec15c-b387-4a23-8919-c8e60c7694d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:32.489682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b73ec15c-b387-4a23-8919-c8e60c7694d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:32.619463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d8db2664-7ab9-4ce9-9d43-2f60435b6f85 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:32.627937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d8db2664-7ab9-4ce9-9d43-2f60435b6f85 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1315 microversion: 2.1 time: 0.199975 Sep 02 09:33:32.642321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 85/161] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:32 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:32.659397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b73ec15c-b387-4a23-8919-c8e60c7694d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:32.667371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b73ec15c-b387-4a23-8919-c8e60c7694d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.191832 Sep 02 09:33:32.667953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 77/162] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:32 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:32.845492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9e9cebde-a5b3-4c10-9c26-25381112892c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:32.846100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9e9cebde-a5b3-4c10-9c26-25381112892c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:32.852107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e9cebde-a5b3-4c10-9c26-25381112892c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:32.852576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e9cebde-a5b3-4c10-9c26-25381112892c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:32.853008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e9cebde-a5b3-4c10-9c26-25381112892c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:32.853696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e9cebde-a5b3-4c10-9c26-25381112892c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:32.854163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e9cebde-a5b3-4c10-9c26-25381112892c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:32.854568 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e9cebde-a5b3-4c10-9c26-25381112892c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:32.981219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9e9cebde-a5b3-4c10-9c26-25381112892c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:32.989042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9e9cebde-a5b3-4c10-9c26-25381112892c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1517 microversion: 2.1 time: 0.147593 Sep 02 09:33:32.989601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 86/163] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:32 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:33.011358 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b5aa2978-1f3b-45d8-aff4-ced5c3777b14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:33:33.013832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b5aa2978-1f3b-45d8-aff4-ced5c3777b14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:33.019889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5aa2978-1f3b-45d8-aff4-ced5c3777b14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:33.020916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5aa2978-1f3b-45d8-aff4-ced5c3777b14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:33.021546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5aa2978-1f3b-45d8-aff4-ced5c3777b14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:33.022754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5aa2978-1f3b-45d8-aff4-ced5c3777b14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:33.022754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5aa2978-1f3b-45d8-aff4-ced5c3777b14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:33.023125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5aa2978-1f3b-45d8-aff4-ced5c3777b14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:33.084167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-b5aa2978-1f3b-45d8-aff4-ced5c3777b14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'flavor' on Instance uuid 7ba2a7e8-15a8-4066-9554-49c48ea52a5e {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:33:33.368681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b5aa2978-1f3b-45d8-aff4-ced5c3777b14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e/action" status: 200 len: 32 microversion: 2.1 time: 0.361297 Sep 02 09:33:33.369771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 78/164] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 09:33:33 2022] POST /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 09:33:33.379684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6137baf1-e688-43d5-b66b-c138bce5dbdf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:33.380294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6137baf1-e688-43d5-b66b-c138bce5dbdf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:33.396161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6137baf1-e688-43d5-b66b-c138bce5dbdf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:33.398622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6137baf1-e688-43d5-b66b-c138bce5dbdf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:33.398622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6137baf1-e688-43d5-b66b-c138bce5dbdf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:33.398622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6137baf1-e688-43d5-b66b-c138bce5dbdf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:33.401430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6137baf1-e688-43d5-b66b-c138bce5dbdf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:33.402051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6137baf1-e688-43d5-b66b-c138bce5dbdf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:33.479268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-92498d2e-dfc4-4349-af26-387c842e46e4 req-32b2489e-191d-4bc3-8214-7e8ac9e34e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae283fdc-e807-415c-a156-8ec24163c45f", "name": "network-vif-plugged", "status": "completed", "tag": "0277f0c4-2ab4-4648-b7be-e37876a5929e"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:33:33.489787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-92498d2e-dfc4-4349-af26-387c842e46e4 req-32b2489e-191d-4bc3-8214-7e8ac9e34e75 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:33.490599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-92498d2e-dfc4-4349-af26-387c842e46e4 req-32b2489e-191d-4bc3-8214-7e8ac9e34e75 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:33.491155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-92498d2e-dfc4-4349-af26-387c842e46e4 req-32b2489e-191d-4bc3-8214-7e8ac9e34e75 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:33.506501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-92498d2e-dfc4-4349-af26-387c842e46e4 req-32b2489e-191d-4bc3-8214-7e8ac9e34e75 service nova] Creating event network-vif-plugged:0277f0c4-2ab4-4648-b7be-e37876a5929e for instance ae283fdc-e807-415c-a156-8ec24163c45f on hv-cinder-85083 Sep 02 09:33:33.512940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-92498d2e-dfc4-4349-af26-387c842e46e4 req-32b2489e-191d-4bc3-8214-7e8ac9e34e75 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038342 Sep 02 09:33:33.513741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 79/165] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:33:33.553887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6137baf1-e688-43d5-b66b-c138bce5dbdf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:33.564784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6137baf1-e688-43d5-b66b-c138bce5dbdf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.188931 Sep 02 09:33:33.566087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 87/166] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:33 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:33.650048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c1854320-e66a-4255-b4b7-e5be6321b524 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:33.651262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c1854320-e66a-4255-b4b7-e5be6321b524 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:33.659184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1854320-e66a-4255-b4b7-e5be6321b524 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:33.659184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1854320-e66a-4255-b4b7-e5be6321b524 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:33.659184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1854320-e66a-4255-b4b7-e5be6321b524 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:33.662464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1854320-e66a-4255-b4b7-e5be6321b524 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:33.662464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1854320-e66a-4255-b4b7-e5be6321b524 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:33.662464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1854320-e66a-4255-b4b7-e5be6321b524 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:33.699223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-eb696352-e172-43e1-976f-84875e7282ab tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:33.700098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-eb696352-e172-43e1-976f-84875e7282ab tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:33.707288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb696352-e172-43e1-976f-84875e7282ab tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:33.707778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb696352-e172-43e1-976f-84875e7282ab tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:33.708210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb696352-e172-43e1-976f-84875e7282ab tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:33.708923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb696352-e172-43e1-976f-84875e7282ab tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:33.709370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb696352-e172-43e1-976f-84875e7282ab tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:33.709787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb696352-e172-43e1-976f-84875e7282ab tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:33.853967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eb696352-e172-43e1-976f-84875e7282ab tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:33.862593 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-eb696352-e172-43e1-976f-84875e7282ab tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.168561 Sep 02 09:33:33.863510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 88/167] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:33 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:33.886290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c1854320-e66a-4255-b4b7-e5be6321b524 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:33.909883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c1854320-e66a-4255-b4b7-e5be6321b524 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1502 microversion: 2.1 time: 0.263848 Sep 02 09:33:33.911359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 80/168] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:33 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:34.587742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a607570d-3800-4a4d-b301-0097d248d805 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:34.588343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a607570d-3800-4a4d-b301-0097d248d805 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:34.594598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a607570d-3800-4a4d-b301-0097d248d805 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:34.598784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a607570d-3800-4a4d-b301-0097d248d805 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:34.598784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a607570d-3800-4a4d-b301-0097d248d805 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:34.598784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a607570d-3800-4a4d-b301-0097d248d805 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:34.598784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a607570d-3800-4a4d-b301-0097d248d805 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:34.599141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a607570d-3800-4a4d-b301-0097d248d805 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:34.771838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a607570d-3800-4a4d-b301-0097d248d805 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:34.780684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a607570d-3800-4a4d-b301-0097d248d805 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.197762 Sep 02 09:33:34.781233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 89/169] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:34 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:34.886007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1ab2dbe1-6f7e-4f43-8bf5-f17607460a5d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:34.887088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1ab2dbe1-6f7e-4f43-8bf5-f17607460a5d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:34.892526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ab2dbe1-6f7e-4f43-8bf5-f17607460a5d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:34.893650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ab2dbe1-6f7e-4f43-8bf5-f17607460a5d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:34.894590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ab2dbe1-6f7e-4f43-8bf5-f17607460a5d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:34.895797 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ab2dbe1-6f7e-4f43-8bf5-f17607460a5d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:34.896637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ab2dbe1-6f7e-4f43-8bf5-f17607460a5d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:34.897064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ab2dbe1-6f7e-4f43-8bf5-f17607460a5d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:35.051008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1ab2dbe1-6f7e-4f43-8bf5-f17607460a5d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:35.065119 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1ab2dbe1-6f7e-4f43-8bf5-f17607460a5d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.183500 Sep 02 09:33:35.065744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 81/170] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:34 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:35.528203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-3d370181-0bf9-4d06-bdd1-5d12a754565a req-c44aafa0-b053-4133-917d-42dec997a2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a68cef6-8c2a-42a1-9943-63f884381755", "name": "network-vif-plugged", "status": "completed", "tag": "d8b74e21-08e3-4af5-9fc4-a78c1a42ff4c"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:33:35.537671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3d370181-0bf9-4d06-bdd1-5d12a754565a req-c44aafa0-b053-4133-917d-42dec997a2f4 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:35.538147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3d370181-0bf9-4d06-bdd1-5d12a754565a req-c44aafa0-b053-4133-917d-42dec997a2f4 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:35.539100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3d370181-0bf9-4d06-bdd1-5d12a754565a req-c44aafa0-b053-4133-917d-42dec997a2f4 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:35.549720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-3d370181-0bf9-4d06-bdd1-5d12a754565a req-c44aafa0-b053-4133-917d-42dec997a2f4 service nova] Creating event network-vif-plugged:d8b74e21-08e3-4af5-9fc4-a78c1a42ff4c for instance 5a68cef6-8c2a-42a1-9943-63f884381755 on hv-cinder-85083 Sep 02 09:33:35.555528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-3d370181-0bf9-4d06-bdd1-5d12a754565a req-c44aafa0-b053-4133-917d-42dec997a2f4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031232 Sep 02 09:33:35.556093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 90/171] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:33:35.805408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6552089f-c096-450a-b4fb-6edde802be8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:35.806967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6552089f-c096-450a-b4fb-6edde802be8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:35.813752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6552089f-c096-450a-b4fb-6edde802be8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:35.814280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6552089f-c096-450a-b4fb-6edde802be8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:35.814764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6552089f-c096-450a-b4fb-6edde802be8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:35.815471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6552089f-c096-450a-b4fb-6edde802be8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:35.815930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6552089f-c096-450a-b4fb-6edde802be8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:35.816354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6552089f-c096-450a-b4fb-6edde802be8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:35.963476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6552089f-c096-450a-b4fb-6edde802be8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:35.972566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6552089f-c096-450a-b4fb-6edde802be8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.172447 Sep 02 09:33:35.973142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 82/172] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:35 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:36.088295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-eb759439-b508-4500-9a60-75751ddab2f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:36.089111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-eb759439-b508-4500-9a60-75751ddab2f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:36.095331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb759439-b508-4500-9a60-75751ddab2f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:36.095817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb759439-b508-4500-9a60-75751ddab2f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:36.096252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb759439-b508-4500-9a60-75751ddab2f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:36.096932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb759439-b508-4500-9a60-75751ddab2f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:36.097383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb759439-b508-4500-9a60-75751ddab2f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:36.097847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb759439-b508-4500-9a60-75751ddab2f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:36.252837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eb759439-b508-4500-9a60-75751ddab2f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:36.261680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-eb759439-b508-4500-9a60-75751ddab2f3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1361 microversion: 2.1 time: 0.177526 Sep 02 09:33:36.271166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 91/173] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:36 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:36.993384 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9b39457c-4cd5-4737-b5a2-6acc089cd472 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:36.996860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9b39457c-4cd5-4737-b5a2-6acc089cd472 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:37.021417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b39457c-4cd5-4737-b5a2-6acc089cd472 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:37.021912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b39457c-4cd5-4737-b5a2-6acc089cd472 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:37.022353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b39457c-4cd5-4737-b5a2-6acc089cd472 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:37.033324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b39457c-4cd5-4737-b5a2-6acc089cd472 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:37.033909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b39457c-4cd5-4737-b5a2-6acc089cd472 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:37.034311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b39457c-4cd5-4737-b5a2-6acc089cd472 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:37.225531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9b39457c-4cd5-4737-b5a2-6acc089cd472 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:37.234567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9b39457c-4cd5-4737-b5a2-6acc089cd472 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.245040 Sep 02 09:33:37.235167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 83/174] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:36 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:37.263149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a02b2888-73c4-4531-aca2-9e280d9a17c9 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e511c4f8-d137-47fc-9e57-89717313735f"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:33:37.263149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a02b2888-73c4-4531-aca2-9e280d9a17c9 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:37.269942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a02b2888-73c4-4531-aca2-9e280d9a17c9 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:37.270447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a02b2888-73c4-4531-aca2-9e280d9a17c9 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:37.271430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a02b2888-73c4-4531-aca2-9e280d9a17c9 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:37.271588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a02b2888-73c4-4531-aca2-9e280d9a17c9 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:37.272244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a02b2888-73c4-4531-aca2-9e280d9a17c9 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:37.272734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a02b2888-73c4-4531-aca2-9e280d9a17c9 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:37.285635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-606e6ee7-c79e-4f12-bbda-7096c2e67688 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:37.286268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-606e6ee7-c79e-4f12-bbda-7096c2e67688 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:37.297029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-606e6ee7-c79e-4f12-bbda-7096c2e67688 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:37.297527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-606e6ee7-c79e-4f12-bbda-7096c2e67688 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:37.297962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-606e6ee7-c79e-4f12-bbda-7096c2e67688 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:37.302100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-606e6ee7-c79e-4f12-bbda-7096c2e67688 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:37.302742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-606e6ee7-c79e-4f12-bbda-7096c2e67688 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:37.303033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-606e6ee7-c79e-4f12-bbda-7096c2e67688 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:37.467959 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-606e6ee7-c79e-4f12-bbda-7096c2e67688 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:37.475987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-606e6ee7-c79e-4f12-bbda-7096c2e67688 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1546 microversion: 2.1 time: 0.197273 Sep 02 09:33:37.476585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 84/175] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:37 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1546 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:37.496780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6be39c28-bfb4-44f7-9dcf-1c2a41942cba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:37.497272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6be39c28-bfb4-44f7-9dcf-1c2a41942cba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:37.503344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6be39c28-bfb4-44f7-9dcf-1c2a41942cba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:37.503814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6be39c28-bfb4-44f7-9dcf-1c2a41942cba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:37.504271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6be39c28-bfb4-44f7-9dcf-1c2a41942cba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:37.504963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6be39c28-bfb4-44f7-9dcf-1c2a41942cba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:37.505433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6be39c28-bfb4-44f7-9dcf-1c2a41942cba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:37.505937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6be39c28-bfb4-44f7-9dcf-1c2a41942cba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:37.635769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6be39c28-bfb4-44f7-9dcf-1c2a41942cba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142499 Sep 02 09:33:37.636548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 85/176] 10.222.0.57 () {58 vars in 1275 bytes} [Fri Sep 2 09:33:37 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:33:38.255969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e4f6f66-1f21-4028-97a0-e7325b4e59b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:38.257901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e4f6f66-1f21-4028-97a0-e7325b4e59b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:38.274299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f6f66-1f21-4028-97a0-e7325b4e59b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:38.274822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f6f66-1f21-4028-97a0-e7325b4e59b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:38.275264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f6f66-1f21-4028-97a0-e7325b4e59b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:38.275963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f6f66-1f21-4028-97a0-e7325b4e59b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:38.276729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f6f66-1f21-4028-97a0-e7325b4e59b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:38.277156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4f6f66-1f21-4028-97a0-e7325b4e59b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:38.723091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1e4f6f66-1f21-4028-97a0-e7325b4e59b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:38.738076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e4f6f66-1f21-4028-97a0-e7325b4e59b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.486114 Sep 02 09:33:38.743203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 86/177] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:38 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:39.026067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a02b2888-73c4-4531-aca2-9e280d9a17c9 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "POST /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.775356 Sep 02 09:33:39.039116 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 92/178] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 09:33:37 2022] POST /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13/os-volume_attachments => generated 194 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:33:39.455500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-67b90b62-97ad-4363-96ee-8e1c42a5b7e1 req-140a1b97-4304-4255-8b4b-328857bb96e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae283fdc-e807-415c-a156-8ec24163c45f", "tag": "0277f0c4-2ab4-4648-b7be-e37876a5929e"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:33:39.460695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=86 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:39.466755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-67b90b62-97ad-4363-96ee-8e1c42a5b7e1 req-140a1b97-4304-4255-8b4b-328857bb96e7 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:39.470188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-67b90b62-97ad-4363-96ee-8e1c42a5b7e1 req-140a1b97-4304-4255-8b4b-328857bb96e7 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:39.470188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-67b90b62-97ad-4363-96ee-8e1c42a5b7e1 req-140a1b97-4304-4255-8b4b-328857bb96e7 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:39.481901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-67b90b62-97ad-4363-96ee-8e1c42a5b7e1 req-140a1b97-4304-4255-8b4b-328857bb96e7 service nova] Creating event network-changed:0277f0c4-2ab4-4648-b7be-e37876a5929e for instance ae283fdc-e807-415c-a156-8ec24163c45f on hv-cinder-85083 Sep 02 09:33:39.487200 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-67b90b62-97ad-4363-96ee-8e1c42a5b7e1 req-140a1b97-4304-4255-8b4b-328857bb96e7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036722 Sep 02 09:33:39.487872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 87/179] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:33:39.775062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c62d1255-9fe2-48eb-99d3-38ab37603e47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:39.775743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c62d1255-9fe2-48eb-99d3-38ab37603e47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:39.778228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=84 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:39.785205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c62d1255-9fe2-48eb-99d3-38ab37603e47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:39.785749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c62d1255-9fe2-48eb-99d3-38ab37603e47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:39.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c62d1255-9fe2-48eb-99d3-38ab37603e47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:39.787018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c62d1255-9fe2-48eb-99d3-38ab37603e47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:39.787466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c62d1255-9fe2-48eb-99d3-38ab37603e47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:39.787887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c62d1255-9fe2-48eb-99d3-38ab37603e47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:40.022503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c62d1255-9fe2-48eb-99d3-38ab37603e47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:40.030377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c62d1255-9fe2-48eb-99d3-38ab37603e47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.260619 Sep 02 09:33:40.036492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 93/180] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:39 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:41.065220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d4d71d1-f05e-4795-bff7-3d3899fd6323 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:41.065909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6d4d71d1-f05e-4795-bff7-3d3899fd6323 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:41.073552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d4d71d1-f05e-4795-bff7-3d3899fd6323 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:41.074050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d4d71d1-f05e-4795-bff7-3d3899fd6323 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:41.074458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d4d71d1-f05e-4795-bff7-3d3899fd6323 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:41.075410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d4d71d1-f05e-4795-bff7-3d3899fd6323 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:41.075862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d4d71d1-f05e-4795-bff7-3d3899fd6323 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:41.077249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d4d71d1-f05e-4795-bff7-3d3899fd6323 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:41.096375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:41.245722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6d4d71d1-f05e-4795-bff7-3d3899fd6323 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:41.254083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6d4d71d1-f05e-4795-bff7-3d3899fd6323 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.193678 Sep 02 09:33:41.254654 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 88/181] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:41 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:42.277206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9bdf8d3e-e26a-4787-925d-7a5557f2679c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:42.278512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9bdf8d3e-e26a-4787-925d-7a5557f2679c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:42.285213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bdf8d3e-e26a-4787-925d-7a5557f2679c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:42.285710 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bdf8d3e-e26a-4787-925d-7a5557f2679c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:42.286153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bdf8d3e-e26a-4787-925d-7a5557f2679c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:42.286903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bdf8d3e-e26a-4787-925d-7a5557f2679c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:42.287364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bdf8d3e-e26a-4787-925d-7a5557f2679c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:42.287792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bdf8d3e-e26a-4787-925d-7a5557f2679c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:42.436940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9bdf8d3e-e26a-4787-925d-7a5557f2679c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:42.447463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9bdf8d3e-e26a-4787-925d-7a5557f2679c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.175141 Sep 02 09:33:42.448037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 94/182] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:42 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:43.469317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0e690d03-70a1-4415-93bc-3a1a646b1b94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:43.469996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0e690d03-70a1-4415-93bc-3a1a646b1b94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:43.477338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e690d03-70a1-4415-93bc-3a1a646b1b94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:43.477816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e690d03-70a1-4415-93bc-3a1a646b1b94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:43.478245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e690d03-70a1-4415-93bc-3a1a646b1b94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:43.478947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e690d03-70a1-4415-93bc-3a1a646b1b94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:43.479394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e690d03-70a1-4415-93bc-3a1a646b1b94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:43.479811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0e690d03-70a1-4415-93bc-3a1a646b1b94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:43.613109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0e690d03-70a1-4415-93bc-3a1a646b1b94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:43.620781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0e690d03-70a1-4415-93bc-3a1a646b1b94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.155265 Sep 02 09:33:43.621352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 89/183] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:43 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:44.643890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-47314ec2-92a1-4dba-97d3-8459c13cb27f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:44.644536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-47314ec2-92a1-4dba-97d3-8459c13cb27f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:44.651673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47314ec2-92a1-4dba-97d3-8459c13cb27f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:44.652159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47314ec2-92a1-4dba-97d3-8459c13cb27f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:44.652643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47314ec2-92a1-4dba-97d3-8459c13cb27f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:44.653470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47314ec2-92a1-4dba-97d3-8459c13cb27f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:44.653917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47314ec2-92a1-4dba-97d3-8459c13cb27f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:44.654337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47314ec2-92a1-4dba-97d3-8459c13cb27f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:44.673905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:33:44.793134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-47314ec2-92a1-4dba-97d3-8459c13cb27f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:44.801337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-47314ec2-92a1-4dba-97d3-8459c13cb27f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.161489 Sep 02 09:33:44.801897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 95/184] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:44 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:45.821912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-611a0f65-d43f-42d9-b55a-e13e47db65bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:45.823186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-611a0f65-d43f-42d9-b55a-e13e47db65bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:45.830159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-611a0f65-d43f-42d9-b55a-e13e47db65bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:45.831070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-611a0f65-d43f-42d9-b55a-e13e47db65bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:45.831715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-611a0f65-d43f-42d9-b55a-e13e47db65bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:45.832432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-611a0f65-d43f-42d9-b55a-e13e47db65bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:45.832891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-611a0f65-d43f-42d9-b55a-e13e47db65bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:45.833328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-611a0f65-d43f-42d9-b55a-e13e47db65bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:46.009390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-611a0f65-d43f-42d9-b55a-e13e47db65bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:46.018056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-611a0f65-d43f-42d9-b55a-e13e47db65bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.199923 Sep 02 09:33:46.018903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 90/185] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:45 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:47.039023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-efd087ea-d77c-4ad8-9d66-1932e3ae242d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:47.039652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-efd087ea-d77c-4ad8-9d66-1932e3ae242d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:47.046257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd087ea-d77c-4ad8-9d66-1932e3ae242d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:47.046750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd087ea-d77c-4ad8-9d66-1932e3ae242d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:47.047959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd087ea-d77c-4ad8-9d66-1932e3ae242d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:47.047959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd087ea-d77c-4ad8-9d66-1932e3ae242d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:47.048281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd087ea-d77c-4ad8-9d66-1932e3ae242d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:47.048696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd087ea-d77c-4ad8-9d66-1932e3ae242d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:47.186427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-efd087ea-d77c-4ad8-9d66-1932e3ae242d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:47.203960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-efd087ea-d77c-4ad8-9d66-1932e3ae242d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.168440 Sep 02 09:33:47.204569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 96/186] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:47 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:48.231319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f8bac580-2d2e-4024-9b56-0ce9e5903f6e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:48.232316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f8bac580-2d2e-4024-9b56-0ce9e5903f6e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:48.239013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8bac580-2d2e-4024-9b56-0ce9e5903f6e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:48.239501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8bac580-2d2e-4024-9b56-0ce9e5903f6e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:48.239932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8bac580-2d2e-4024-9b56-0ce9e5903f6e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:48.240615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8bac580-2d2e-4024-9b56-0ce9e5903f6e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:48.241065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8bac580-2d2e-4024-9b56-0ce9e5903f6e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:48.241481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8bac580-2d2e-4024-9b56-0ce9e5903f6e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:48.378078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f8bac580-2d2e-4024-9b56-0ce9e5903f6e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:48.386187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f8bac580-2d2e-4024-9b56-0ce9e5903f6e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.158729 Sep 02 09:33:48.386770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 91/187] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:48 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:49.407300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-aa7714fb-4637-4c56-8505-38f0d61592c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:49.407900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-aa7714fb-4637-4c56-8505-38f0d61592c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:49.415124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa7714fb-4637-4c56-8505-38f0d61592c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:49.415607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa7714fb-4637-4c56-8505-38f0d61592c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:49.416031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa7714fb-4637-4c56-8505-38f0d61592c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:49.420530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa7714fb-4637-4c56-8505-38f0d61592c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:49.420530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa7714fb-4637-4c56-8505-38f0d61592c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:49.420530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa7714fb-4637-4c56-8505-38f0d61592c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:49.546342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-aa7714fb-4637-4c56-8505-38f0d61592c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:49.554833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-aa7714fb-4637-4c56-8505-38f0d61592c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.151109 Sep 02 09:33:49.555393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 97/188] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:49 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:50.576544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c5ebac97-fa32-4b23-9057-de12e65f713a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:50.579992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c5ebac97-fa32-4b23-9057-de12e65f713a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:50.585334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5ebac97-fa32-4b23-9057-de12e65f713a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:50.586048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5ebac97-fa32-4b23-9057-de12e65f713a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:50.586491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5ebac97-fa32-4b23-9057-de12e65f713a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:50.587554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5ebac97-fa32-4b23-9057-de12e65f713a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:50.588288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5ebac97-fa32-4b23-9057-de12e65f713a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:50.588713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5ebac97-fa32-4b23-9057-de12e65f713a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:50.737255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c5ebac97-fa32-4b23-9057-de12e65f713a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:50.749342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c5ebac97-fa32-4b23-9057-de12e65f713a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.176745 Sep 02 09:33:50.752758 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 92/189] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:50 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:51.778444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-751bc6e1-4e34-4c39-8772-2cb465c58bf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:51.779520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-751bc6e1-4e34-4c39-8772-2cb465c58bf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:51.790149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-751bc6e1-4e34-4c39-8772-2cb465c58bf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:51.790893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-751bc6e1-4e34-4c39-8772-2cb465c58bf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:51.791586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-751bc6e1-4e34-4c39-8772-2cb465c58bf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:51.792727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-751bc6e1-4e34-4c39-8772-2cb465c58bf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:51.793425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-751bc6e1-4e34-4c39-8772-2cb465c58bf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:51.794182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-751bc6e1-4e34-4c39-8772-2cb465c58bf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:51.943177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-751bc6e1-4e34-4c39-8772-2cb465c58bf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:51.950950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-751bc6e1-4e34-4c39-8772-2cb465c58bf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.182654 Sep 02 09:33:51.951543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 98/190] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:51 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:52.971073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c099c282-b18c-4af7-8241-7d88fb0ba530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:52.971753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c099c282-b18c-4af7-8241-7d88fb0ba530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:52.978292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c099c282-b18c-4af7-8241-7d88fb0ba530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:52.978802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c099c282-b18c-4af7-8241-7d88fb0ba530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:52.979239 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c099c282-b18c-4af7-8241-7d88fb0ba530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:52.979919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c099c282-b18c-4af7-8241-7d88fb0ba530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:52.980372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c099c282-b18c-4af7-8241-7d88fb0ba530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:52.980790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c099c282-b18c-4af7-8241-7d88fb0ba530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:53.124137 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c099c282-b18c-4af7-8241-7d88fb0ba530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:53.131967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c099c282-b18c-4af7-8241-7d88fb0ba530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.164724 Sep 02 09:33:53.132737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 93/191] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:52 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:54.153018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4cc0974e-e13e-4564-b558-d9592592ebc4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:54.153713 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4cc0974e-e13e-4564-b558-d9592592ebc4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:54.160318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cc0974e-e13e-4564-b558-d9592592ebc4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:54.160820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cc0974e-e13e-4564-b558-d9592592ebc4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:54.161258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cc0974e-e13e-4564-b558-d9592592ebc4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:54.161986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cc0974e-e13e-4564-b558-d9592592ebc4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:54.162466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cc0974e-e13e-4564-b558-d9592592ebc4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:54.163414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cc0974e-e13e-4564-b558-d9592592ebc4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:54.296187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4cc0974e-e13e-4564-b558-d9592592ebc4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:54.304453 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4cc0974e-e13e-4564-b558-d9592592ebc4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.155377 Sep 02 09:33:54.313876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 99/192] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:54 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:55.325681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9fcc79df-1be4-43ee-9183-590c1ab19bf5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:55.326288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9fcc79df-1be4-43ee-9183-590c1ab19bf5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:55.332544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc79df-1be4-43ee-9183-590c1ab19bf5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:55.333065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc79df-1be4-43ee-9183-590c1ab19bf5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:55.333526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc79df-1be4-43ee-9183-590c1ab19bf5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:55.334226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc79df-1be4-43ee-9183-590c1ab19bf5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:55.335387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc79df-1be4-43ee-9183-590c1ab19bf5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:55.335764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc79df-1be4-43ee-9183-590c1ab19bf5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:55.478480 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9fcc79df-1be4-43ee-9183-590c1ab19bf5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:55.486250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9fcc79df-1be4-43ee-9183-590c1ab19bf5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.164667 Sep 02 09:33:55.487655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 94/193] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:55 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:56.508659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1d755d48-2852-4e63-813d-423adfa4bd9a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:56.509275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1d755d48-2852-4e63-813d-423adfa4bd9a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:56.515759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d755d48-2852-4e63-813d-423adfa4bd9a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:56.516248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d755d48-2852-4e63-813d-423adfa4bd9a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:56.516689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d755d48-2852-4e63-813d-423adfa4bd9a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:56.517377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d755d48-2852-4e63-813d-423adfa4bd9a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:56.517832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d755d48-2852-4e63-813d-423adfa4bd9a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:56.518260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d755d48-2852-4e63-813d-423adfa4bd9a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:56.652480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1d755d48-2852-4e63-813d-423adfa4bd9a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:56.660181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1d755d48-2852-4e63-813d-423adfa4bd9a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.155506 Sep 02 09:33:56.660849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 100/194] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:56 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:57.683174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4e351597-a75f-4a76-9ddb-3ba230793fa7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:57.683801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4e351597-a75f-4a76-9ddb-3ba230793fa7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:57.691656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e351597-a75f-4a76-9ddb-3ba230793fa7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:57.692582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e351597-a75f-4a76-9ddb-3ba230793fa7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:57.693241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e351597-a75f-4a76-9ddb-3ba230793fa7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:57.694185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e351597-a75f-4a76-9ddb-3ba230793fa7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:57.695090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e351597-a75f-4a76-9ddb-3ba230793fa7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:57.695669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e351597-a75f-4a76-9ddb-3ba230793fa7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:57.835874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4e351597-a75f-4a76-9ddb-3ba230793fa7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:57.843706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4e351597-a75f-4a76-9ddb-3ba230793fa7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.165367 Sep 02 09:33:57.849311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 95/195] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:57 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:33:58.873256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5b3ed3a5-2dcc-4dce-a450-823403ab72be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:58.873922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5b3ed3a5-2dcc-4dce-a450-823403ab72be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:58.883287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b3ed3a5-2dcc-4dce-a450-823403ab72be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:58.883798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b3ed3a5-2dcc-4dce-a450-823403ab72be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:58.884231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b3ed3a5-2dcc-4dce-a450-823403ab72be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:58.884919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b3ed3a5-2dcc-4dce-a450-823403ab72be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:58.885380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b3ed3a5-2dcc-4dce-a450-823403ab72be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:58.885783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b3ed3a5-2dcc-4dce-a450-823403ab72be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:59.206889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5b3ed3a5-2dcc-4dce-a450-823403ab72be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:33:59.215360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5b3ed3a5-2dcc-4dce-a450-823403ab72be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.346424 Sep 02 09:33:59.215946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 101/196] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:58 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:33:59.392360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a1cb7668-3fa2-44c4-abbd-374e6398e9a7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:59.393394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a1cb7668-3fa2-44c4-abbd-374e6398e9a7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:59.400941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1cb7668-3fa2-44c4-abbd-374e6398e9a7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:59.401629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1cb7668-3fa2-44c4-abbd-374e6398e9a7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:59.402242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1cb7668-3fa2-44c4-abbd-374e6398e9a7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:59.403135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1cb7668-3fa2-44c4-abbd-374e6398e9a7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:59.403766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1cb7668-3fa2-44c4-abbd-374e6398e9a7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:59.404365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1cb7668-3fa2-44c4-abbd-374e6398e9a7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:59.454532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a1cb7668-3fa2-44c4-abbd-374e6398e9a7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:33:59.821457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a1cb7668-3fa2-44c4-abbd-374e6398e9a7 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "DELETE /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 204 len: 0 microversion: 2.1 time: 0.433510 Sep 02 09:33:59.822049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 96/197] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:33:59 2022] DELETE /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:33:59.830031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7f26498e-1f24-497f-8ee6-aee888eb4066 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:33:59.830639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7f26498e-1f24-497f-8ee6-aee888eb4066 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:33:59.836654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f26498e-1f24-497f-8ee6-aee888eb4066 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:59.837135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f26498e-1f24-497f-8ee6-aee888eb4066 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:59.837572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f26498e-1f24-497f-8ee6-aee888eb4066 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:33:59.838270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f26498e-1f24-497f-8ee6-aee888eb4066 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:33:59.838727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f26498e-1f24-497f-8ee6-aee888eb4066 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:33:59.839151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f26498e-1f24-497f-8ee6-aee888eb4066 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:00.013322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7f26498e-1f24-497f-8ee6-aee888eb4066 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:00.013322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7f26498e-1f24-497f-8ee6-aee888eb4066 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1554 microversion: 2.1 time: 0.184180 Sep 02 09:34:00.013322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 102/198] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:33:59 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:00.238273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7394bd50-6911-4162-987b-0a998e3334aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:00.238991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7394bd50-6911-4162-987b-0a998e3334aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:00.245461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7394bd50-6911-4162-987b-0a998e3334aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:00.246134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7394bd50-6911-4162-987b-0a998e3334aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:00.246581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7394bd50-6911-4162-987b-0a998e3334aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:00.247314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7394bd50-6911-4162-987b-0a998e3334aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:00.247749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7394bd50-6911-4162-987b-0a998e3334aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:00.248196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7394bd50-6911-4162-987b-0a998e3334aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:00.414353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7394bd50-6911-4162-987b-0a998e3334aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:00.423882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7394bd50-6911-4162-987b-0a998e3334aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.189749 Sep 02 09:34:00.424846 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 97/199] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:00 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:01.031433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7da9fcbe-d164-4265-962f-abbb922e25df tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:01.032045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7da9fcbe-d164-4265-962f-abbb922e25df tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:01.041294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7da9fcbe-d164-4265-962f-abbb922e25df tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:01.041294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7da9fcbe-d164-4265-962f-abbb922e25df tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:01.041294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7da9fcbe-d164-4265-962f-abbb922e25df tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:01.041294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7da9fcbe-d164-4265-962f-abbb922e25df tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:01.041682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7da9fcbe-d164-4265-962f-abbb922e25df tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:01.041682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7da9fcbe-d164-4265-962f-abbb922e25df tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:01.188504 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7da9fcbe-d164-4265-962f-abbb922e25df tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:01.197254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7da9fcbe-d164-4265-962f-abbb922e25df tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1554 microversion: 2.1 time: 0.169824 Sep 02 09:34:01.198039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 103/200] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:01 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:01.445723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e66dd244-229e-48b6-935d-ef523cde1b95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:01.446324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e66dd244-229e-48b6-935d-ef523cde1b95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:01.452307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e66dd244-229e-48b6-935d-ef523cde1b95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:01.452783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e66dd244-229e-48b6-935d-ef523cde1b95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:01.453213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e66dd244-229e-48b6-935d-ef523cde1b95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:01.453889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e66dd244-229e-48b6-935d-ef523cde1b95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:01.454337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e66dd244-229e-48b6-935d-ef523cde1b95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:01.454777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e66dd244-229e-48b6-935d-ef523cde1b95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:01.611146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e66dd244-229e-48b6-935d-ef523cde1b95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:01.614648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e66dd244-229e-48b6-935d-ef523cde1b95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.173451 Sep 02 09:34:01.615488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 98/201] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:01 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:02.217757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-69a942b9-c09f-4b2a-9412-f5e59a366a2a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:02.218524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-69a942b9-c09f-4b2a-9412-f5e59a366a2a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:02.225167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a942b9-c09f-4b2a-9412-f5e59a366a2a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:02.226229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a942b9-c09f-4b2a-9412-f5e59a366a2a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:02.226663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a942b9-c09f-4b2a-9412-f5e59a366a2a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:02.227393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a942b9-c09f-4b2a-9412-f5e59a366a2a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:02.227863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a942b9-c09f-4b2a-9412-f5e59a366a2a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:02.228255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69a942b9-c09f-4b2a-9412-f5e59a366a2a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:02.362411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-69a942b9-c09f-4b2a-9412-f5e59a366a2a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:02.371310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-69a942b9-c09f-4b2a-9412-f5e59a366a2a tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1554 microversion: 2.1 time: 0.157605 Sep 02 09:34:02.371882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 104/202] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:02 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:02.637761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-44c1de2c-19e7-4f91-998a-0117fff57c51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:02.639241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-44c1de2c-19e7-4f91-998a-0117fff57c51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:02.645716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44c1de2c-19e7-4f91-998a-0117fff57c51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:02.646240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44c1de2c-19e7-4f91-998a-0117fff57c51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:02.648244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44c1de2c-19e7-4f91-998a-0117fff57c51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:02.648244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44c1de2c-19e7-4f91-998a-0117fff57c51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:02.648523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44c1de2c-19e7-4f91-998a-0117fff57c51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:02.649280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44c1de2c-19e7-4f91-998a-0117fff57c51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:02.787904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-44c1de2c-19e7-4f91-998a-0117fff57c51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:02.796081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-44c1de2c-19e7-4f91-998a-0117fff57c51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.162331 Sep 02 09:34:02.796777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 99/203] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:02 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:03.396836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0fc7c7cb-ffce-4062-99b3-36f6a96f7475 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:03.398034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0fc7c7cb-ffce-4062-99b3-36f6a96f7475 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:03.404855 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fc7c7cb-ffce-4062-99b3-36f6a96f7475 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:03.405418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fc7c7cb-ffce-4062-99b3-36f6a96f7475 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:03.405975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fc7c7cb-ffce-4062-99b3-36f6a96f7475 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:03.406806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fc7c7cb-ffce-4062-99b3-36f6a96f7475 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:03.407364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fc7c7cb-ffce-4062-99b3-36f6a96f7475 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:03.407969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fc7c7cb-ffce-4062-99b3-36f6a96f7475 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:03.659239 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-2c80facd-db4a-40f0-a132-92609205aab8 req-58828f38-9b7d-40f0-aa35-db6c33668dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d770bc-892d-4464-aa30-ded0926f7a13", "name": "network-vif-deleted", "tag": "2dde1031-6e53-4864-957c-6a89464b2c48"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:34:03.672384 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-2c80facd-db4a-40f0-a132-92609205aab8 req-58828f38-9b7d-40f0-aa35-db6c33668dd1 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:03.675240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-2c80facd-db4a-40f0-a132-92609205aab8 req-58828f38-9b7d-40f0-aa35-db6c33668dd1 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:03.675935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-2c80facd-db4a-40f0-a132-92609205aab8 req-58828f38-9b7d-40f0-aa35-db6c33668dd1 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:03.688785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-2c80facd-db4a-40f0-a132-92609205aab8 req-58828f38-9b7d-40f0-aa35-db6c33668dd1 service nova] Creating event network-vif-deleted:2dde1031-6e53-4864-957c-6a89464b2c48 for instance 95d770bc-892d-4464-aa30-ded0926f7a13 on hv-cinder-85083 Sep 02 09:34:03.697015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-2c80facd-db4a-40f0-a132-92609205aab8 req-58828f38-9b7d-40f0-aa35-db6c33668dd1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041413 Sep 02 09:34:03.698157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 100/204] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:34:03.714611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0fc7c7cb-ffce-4062-99b3-36f6a96f7475 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:03.723524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0fc7c7cb-ffce-4062-99b3-36f6a96f7475 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1554 microversion: 2.1 time: 0.334087 Sep 02 09:34:03.724475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 105/205] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:03 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1554 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:34:03.818214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ee126d41-ba62-49c9-b01c-e9d9f4e3f2c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:03.819822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ee126d41-ba62-49c9-b01c-e9d9f4e3f2c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:03.826891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee126d41-ba62-49c9-b01c-e9d9f4e3f2c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:03.827638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee126d41-ba62-49c9-b01c-e9d9f4e3f2c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:03.828388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee126d41-ba62-49c9-b01c-e9d9f4e3f2c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:03.829395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee126d41-ba62-49c9-b01c-e9d9f4e3f2c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:03.829883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee126d41-ba62-49c9-b01c-e9d9f4e3f2c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:03.830373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee126d41-ba62-49c9-b01c-e9d9f4e3f2c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:04.011894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ee126d41-ba62-49c9-b01c-e9d9f4e3f2c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:04.026582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ee126d41-ba62-49c9-b01c-e9d9f4e3f2c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.212898 Sep 02 09:34:04.027550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 101/206] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:03 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:04.746050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:04.747553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:04.754264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:04.755633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:04.756171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:04.757526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:04.758305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:04.758915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:04.804830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:04.805127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:04.805545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:04.806181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lazy-loading 'fault' on Instance uuid 95d770bc-892d-4464-aa30-ded0926f7a13 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:34:04.863323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d4f092761d44a2a30f0e1d044888b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e553fe4257cc4983ac82027b05a53e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:04.872607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-883e36b9-037c-4fb0-90ee-388c8130fa0e tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 200 len: 1351 microversion: 2.1 time: 0.131860 Sep 02 09:34:04.887007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 106/207] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:04 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:05.047514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-12d1afd2-ad0a-44ec-bf53-095108a1858a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:05.048189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-12d1afd2-ad0a-44ec-bf53-095108a1858a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:05.057167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d1afd2-ad0a-44ec-bf53-095108a1858a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:05.061289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d1afd2-ad0a-44ec-bf53-095108a1858a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:05.061289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d1afd2-ad0a-44ec-bf53-095108a1858a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:05.061289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d1afd2-ad0a-44ec-bf53-095108a1858a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:05.061289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d1afd2-ad0a-44ec-bf53-095108a1858a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:05.062012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d1afd2-ad0a-44ec-bf53-095108a1858a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:05.198781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-12d1afd2-ad0a-44ec-bf53-095108a1858a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:05.206949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-12d1afd2-ad0a-44ec-bf53-095108a1858a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.163347 Sep 02 09:34:05.207512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 102/208] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:05 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:05.895959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:05.896606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:05.903647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:05.911706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:05.911706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:05.911706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:05.911706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:05.913650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:05.926753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] HTTP exception thrown: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Request method failure captured: Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 HTTP/1.1 Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc2482RJPjNEgbC6I69eT3zLaUL2FbfTBwDJWmD6EgOce8eMfJMuZK_4_3kTA34WFjz-OAchYDiuaPSVKGPaAsHC47xYLtDF4Xp2qlCE2dtUs3S4woe28Q8G8ngv4vmL9xErU1OPlSsZgeAAIqlhx9nNc2IQ4WMRaSvyTpHiuAP_XHI Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: e553fe4257cc4983ac82027b05a53e65 Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:34:05.932059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e553fe4257cc4983ac82027b05a53e65", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: e553fe4257cc4983ac82027b05a53e65 Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-DeleteServersTestJSON-1886952054-project Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: d4d4f092761d44a2a30f0e1d044888b6 Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-DeleteServersTestJSON-1886952054-project Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:05.941143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '95d770bc-892d-4464-aa30-ded0926f7a13'} Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:34:05.942592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:05.944173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:34:05.946159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Returning 404 to user: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:34:05.946159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b8c311a5-f57e-4c8a-9ff7-81dcafaa6711 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 404 len: 111 microversion: 2.1 time: 0.041754 Sep 02 09:34:05.946159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 107/209] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:05 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:34:06.075668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:06.077989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:06.084201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:06.085351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:06.085845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:06.086688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:06.087260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:06.087765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:06.104254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] HTTP exception thrown: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Request method failure captured: Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13/os-volume_attachments HTTP/1.1 Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc2482RJPjNEgbC6I69eT3zLaUL2FbfTBwDJWmD6EgOce8eMfJMuZK_4_3kTA34WFjz-OAchYDiuaPSVKGPaAsHC47xYLtDF4Xp2qlCE2dtUs3S4woe28Q8G8ngv4vmL9xErU1OPlSsZgeAAIqlhx9nNc2IQ4WMRaSvyTpHiuAP_XHI Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: e553fe4257cc4983ac82027b05a53e65 Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:34:06.108837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e553fe4257cc4983ac82027b05a53e65", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: e553fe4257cc4983ac82027b05a53e65 Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-DeleteServersTestJSON-1886952054-project Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: d4d4f092761d44a2a30f0e1d044888b6 Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-DeleteServersTestJSON-1886952054-project Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:06.110015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'server_id': '95d770bc-892d-4464-aa30-ded0926f7a13'} Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:34:06.111489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:06.112559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:06.114241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Returning 404 to user: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:34:06.114241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f2be7cb3-06bc-45a1-91de-0ad1916f9ba8 tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038641 Sep 02 09:34:06.114241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 103/210] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:34:06 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:34:06.227861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-70062dd6-8e92-4552-9685-4ea3097de682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:06.228464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-70062dd6-8e92-4552-9685-4ea3097de682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:06.234587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70062dd6-8e92-4552-9685-4ea3097de682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:06.235092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70062dd6-8e92-4552-9685-4ea3097de682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:06.235526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70062dd6-8e92-4552-9685-4ea3097de682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:06.236197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70062dd6-8e92-4552-9685-4ea3097de682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:06.236645 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70062dd6-8e92-4552-9685-4ea3097de682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:06.237068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70062dd6-8e92-4552-9685-4ea3097de682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:06.373098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-70062dd6-8e92-4552-9685-4ea3097de682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:06.383755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-70062dd6-8e92-4552-9685-4ea3097de682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.159405 Sep 02 09:34:06.398667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 108/211] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:06 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:07.405652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0ce158b1-62ad-4a03-95f8-708aeb58a3db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:07.406225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0ce158b1-62ad-4a03-95f8-708aeb58a3db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:07.412280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ce158b1-62ad-4a03-95f8-708aeb58a3db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:07.413411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ce158b1-62ad-4a03-95f8-708aeb58a3db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:07.413844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ce158b1-62ad-4a03-95f8-708aeb58a3db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:07.414521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ce158b1-62ad-4a03-95f8-708aeb58a3db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:07.415008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ce158b1-62ad-4a03-95f8-708aeb58a3db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:07.415425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ce158b1-62ad-4a03-95f8-708aeb58a3db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:07.552741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0ce158b1-62ad-4a03-95f8-708aeb58a3db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:07.555606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:07.556107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:07.556237 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:07.561130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0ce158b1-62ad-4a03-95f8-708aeb58a3db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.159318 Sep 02 09:34:07.561700 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 104/212] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:07 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:34:07.574866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:07.574866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:07.574866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:07.574866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:07.575237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:07.575237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:07.581302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] HTTP exception thrown: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Request method failure captured: Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: DELETE /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 HTTP/1.1 Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc2482RJPjNEgbC6I69eT3zLaUL2FbfTBwDJWmD6EgOce8eMfJMuZK_4_3kTA34WFjz-OAchYDiuaPSVKGPaAsHC47xYLtDF4Xp2qlCE2dtUs3S4woe28Q8G8ngv4vmL9xErU1OPlSsZgeAAIqlhx9nNc2IQ4WMRaSvyTpHiuAP_XHI Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: e553fe4257cc4983ac82027b05a53e65 Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:34:07.582873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e553fe4257cc4983ac82027b05a53e65", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: e553fe4257cc4983ac82027b05a53e65 Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-DeleteServersTestJSON-1886952054-project Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: d4d4f092761d44a2a30f0e1d044888b6 Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-DeleteServersTestJSON-1886952054-project Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:07.585042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '95d770bc-892d-4464-aa30-ded0926f7a13'} Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:34:07.585778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:07.587138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:34:07.588428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Returning 404 to user: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:34:07.588428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f73e78b6-b23d-4ca7-bc5b-b295754a3eba tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "DELETE /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 404 len: 111 microversion: 2.1 time: 0.033363 Sep 02 09:34:07.589036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 109/213] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:34:07 2022] DELETE /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:34:07.594002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:07.594602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] [instance: 95d770bc-892d-4464-aa30-ded0926f7a13] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:07.600566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:07.601048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:07.601478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:07.602156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:07.602602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:07.603046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:07.616350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] HTTP exception thrown: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Request method failure captured: Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 HTTP/1.1 Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc2482RJPjNEgbC6I69eT3zLaUL2FbfTBwDJWmD6EgOce8eMfJMuZK_4_3kTA34WFjz-OAchYDiuaPSVKGPaAsHC47xYLtDF4Xp2qlCE2dtUs3S4woe28Q8G8ngv4vmL9xErU1OPlSsZgeAAIqlhx9nNc2IQ4WMRaSvyTpHiuAP_XHI Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: e553fe4257cc4983ac82027b05a53e65 Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:34:07.618527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e553fe4257cc4983ac82027b05a53e65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e553fe4257cc4983ac82027b05a53e65", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: e553fe4257cc4983ac82027b05a53e65 Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-DeleteServersTestJSON-1886952054 Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-DeleteServersTestJSON-1886952054-project Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: d4d4f092761d44a2a30f0e1d044888b6 Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-DeleteServersTestJSON-1886952054-project Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:07.619881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '95d770bc-892d-4464-aa30-ded0926f7a13'} Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:34:07.620590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. Sep 02 09:34:07.621935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:07.622952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] Returning 404 to user: Instance 95d770bc-892d-4464-aa30-ded0926f7a13 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:34:07.622952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-55119c32-49d9-4cfe-b357-d8527ce55bbc tempest-DeleteServersTestJSON-1886952054 tempest-DeleteServersTestJSON-1886952054-project] 10.222.0.57 "GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13" status: 404 len: 111 microversion: 2.1 time: 0.029862 Sep 02 09:34:07.622952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 105/214] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:07 2022] GET /compute/v2.1/servers/95d770bc-892d-4464-aa30-ded0926f7a13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:34:08.583518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3af4e78e-a296-4dc2-a98f-a98cf736fa1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:08.584132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3af4e78e-a296-4dc2-a98f-a98cf736fa1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:08.590777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3af4e78e-a296-4dc2-a98f-a98cf736fa1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:08.591266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3af4e78e-a296-4dc2-a98f-a98cf736fa1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:08.591827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3af4e78e-a296-4dc2-a98f-a98cf736fa1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:08.592519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3af4e78e-a296-4dc2-a98f-a98cf736fa1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:08.592970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3af4e78e-a296-4dc2-a98f-a98cf736fa1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:08.593391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3af4e78e-a296-4dc2-a98f-a98cf736fa1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:08.853812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3af4e78e-a296-4dc2-a98f-a98cf736fa1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:08.861927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3af4e78e-a296-4dc2-a98f-a98cf736fa1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.282120 Sep 02 09:34:08.862856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 110/215] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:08 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:09.885520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f9106f42-8856-4666-98cc-6af72385510e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:09.886840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f9106f42-8856-4666-98cc-6af72385510e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:09.894571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9106f42-8856-4666-98cc-6af72385510e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:09.895377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9106f42-8856-4666-98cc-6af72385510e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:09.896190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9106f42-8856-4666-98cc-6af72385510e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:09.897917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9106f42-8856-4666-98cc-6af72385510e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:09.898606 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9106f42-8856-4666-98cc-6af72385510e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:09.899289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9106f42-8856-4666-98cc-6af72385510e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:10.109488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f9106f42-8856-4666-98cc-6af72385510e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:10.117871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f9106f42-8856-4666-98cc-6af72385510e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.237382 Sep 02 09:34:10.118495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 106/216] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:09 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:11.141006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b1305da7-16cb-4222-a4d5-889884924eb4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:11.141688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b1305da7-16cb-4222-a4d5-889884924eb4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:11.151840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1305da7-16cb-4222-a4d5-889884924eb4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:11.152799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1305da7-16cb-4222-a4d5-889884924eb4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:11.153278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1305da7-16cb-4222-a4d5-889884924eb4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:11.154209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1305da7-16cb-4222-a4d5-889884924eb4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:11.154740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1305da7-16cb-4222-a4d5-889884924eb4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:11.155519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1305da7-16cb-4222-a4d5-889884924eb4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:11.349179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b1305da7-16cb-4222-a4d5-889884924eb4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:11.358529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b1305da7-16cb-4222-a4d5-889884924eb4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.221537 Sep 02 09:34:11.359379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 111/217] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:11 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:12.381745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3a3713b6-0ab1-446f-b96f-36fe4bcd465a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:12.382347 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3a3713b6-0ab1-446f-b96f-36fe4bcd465a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:12.384666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:12.389548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a3713b6-0ab1-446f-b96f-36fe4bcd465a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:12.390048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a3713b6-0ab1-446f-b96f-36fe4bcd465a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:12.390482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a3713b6-0ab1-446f-b96f-36fe4bcd465a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:12.391195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a3713b6-0ab1-446f-b96f-36fe4bcd465a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:12.391654 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a3713b6-0ab1-446f-b96f-36fe4bcd465a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:12.392091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a3713b6-0ab1-446f-b96f-36fe4bcd465a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:12.520245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3a3713b6-0ab1-446f-b96f-36fe4bcd465a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:12.528276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3a3713b6-0ab1-446f-b96f-36fe4bcd465a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.150545 Sep 02 09:34:12.529109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 107/218] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:12 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:13.549754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c654bffb-37ee-4bdd-83a8-aa89876f78cc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:13.550361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c654bffb-37ee-4bdd-83a8-aa89876f78cc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:13.553344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=40 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:13.557980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c654bffb-37ee-4bdd-83a8-aa89876f78cc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:13.558462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c654bffb-37ee-4bdd-83a8-aa89876f78cc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:13.558929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c654bffb-37ee-4bdd-83a8-aa89876f78cc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:13.559609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c654bffb-37ee-4bdd-83a8-aa89876f78cc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:13.560111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c654bffb-37ee-4bdd-83a8-aa89876f78cc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:13.560481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c654bffb-37ee-4bdd-83a8-aa89876f78cc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:13.692495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c654bffb-37ee-4bdd-83a8-aa89876f78cc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:13.700310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c654bffb-37ee-4bdd-83a8-aa89876f78cc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.154343 Sep 02 09:34:13.700869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 112/219] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:13 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:14.721201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e8dc6697-d3c5-4b4d-9d47-85641e400790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:14.721839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e8dc6697-d3c5-4b4d-9d47-85641e400790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:14.727804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dc6697-d3c5-4b4d-9d47-85641e400790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:14.728359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dc6697-d3c5-4b4d-9d47-85641e400790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:14.728790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dc6697-d3c5-4b4d-9d47-85641e400790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:14.729472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dc6697-d3c5-4b4d-9d47-85641e400790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:14.729925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dc6697-d3c5-4b4d-9d47-85641e400790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:14.730340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dc6697-d3c5-4b4d-9d47-85641e400790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:14.860801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e8dc6697-d3c5-4b4d-9d47-85641e400790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:14.869285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e8dc6697-d3c5-4b4d-9d47-85641e400790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.152280 Sep 02 09:34:14.869888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 108/220] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:14 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:15.891255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7b33681b-3c4c-4991-b315-ee79ac447530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:15.891858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7b33681b-3c4c-4991-b315-ee79ac447530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:15.898996 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b33681b-3c4c-4991-b315-ee79ac447530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:15.899480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b33681b-3c4c-4991-b315-ee79ac447530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:15.899913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b33681b-3c4c-4991-b315-ee79ac447530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:15.900593 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b33681b-3c4c-4991-b315-ee79ac447530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:15.901045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b33681b-3c4c-4991-b315-ee79ac447530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:15.901470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b33681b-3c4c-4991-b315-ee79ac447530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:15.905335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:16.032963 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7b33681b-3c4c-4991-b315-ee79ac447530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:16.040431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7b33681b-3c4c-4991-b315-ee79ac447530 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.152989 Sep 02 09:34:16.040989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 113/221] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:15 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:17.061208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8838804e-1728-4d41-89fd-c80eed286848 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:17.061915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8838804e-1728-4d41-89fd-c80eed286848 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:17.068286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8838804e-1728-4d41-89fd-c80eed286848 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:17.068762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8838804e-1728-4d41-89fd-c80eed286848 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:17.069189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8838804e-1728-4d41-89fd-c80eed286848 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:17.069861 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8838804e-1728-4d41-89fd-c80eed286848 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:17.070305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8838804e-1728-4d41-89fd-c80eed286848 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:17.070743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8838804e-1728-4d41-89fd-c80eed286848 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:17.194314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8838804e-1728-4d41-89fd-c80eed286848 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:17.202137 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8838804e-1728-4d41-89fd-c80eed286848 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.144764 Sep 02 09:34:17.202694 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 109/222] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:17 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:18.224065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6f3f7d1f-41ce-427e-bc1f-c1e8f3033de8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:18.225512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6f3f7d1f-41ce-427e-bc1f-c1e8f3033de8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:18.232194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f3f7d1f-41ce-427e-bc1f-c1e8f3033de8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:18.232684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f3f7d1f-41ce-427e-bc1f-c1e8f3033de8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:18.236768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f3f7d1f-41ce-427e-bc1f-c1e8f3033de8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:18.236768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f3f7d1f-41ce-427e-bc1f-c1e8f3033de8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:18.236768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f3f7d1f-41ce-427e-bc1f-c1e8f3033de8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:18.236768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f3f7d1f-41ce-427e-bc1f-c1e8f3033de8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:18.364740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6f3f7d1f-41ce-427e-bc1f-c1e8f3033de8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:18.373641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6f3f7d1f-41ce-427e-bc1f-c1e8f3033de8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.153791 Sep 02 09:34:18.374209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 114/223] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:18 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:19.394534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5b3a1f1c-ec69-45b1-879a-831864afd0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:19.395149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5b3a1f1c-ec69-45b1-879a-831864afd0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:19.401296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b3a1f1c-ec69-45b1-879a-831864afd0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:19.401768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b3a1f1c-ec69-45b1-879a-831864afd0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:19.402192 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b3a1f1c-ec69-45b1-879a-831864afd0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:19.403557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b3a1f1c-ec69-45b1-879a-831864afd0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:19.404173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b3a1f1c-ec69-45b1-879a-831864afd0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:19.404483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b3a1f1c-ec69-45b1-879a-831864afd0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:19.545188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5b3a1f1c-ec69-45b1-879a-831864afd0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:19.555461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5b3a1f1c-ec69-45b1-879a-831864afd0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.164649 Sep 02 09:34:19.556543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 110/224] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:19 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:20.575995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ff4269bf-f892-4eeb-9572-f2c7e2cdc96a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:20.578060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ff4269bf-f892-4eeb-9572-f2c7e2cdc96a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:20.586250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff4269bf-f892-4eeb-9572-f2c7e2cdc96a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:20.586778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff4269bf-f892-4eeb-9572-f2c7e2cdc96a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:20.587612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff4269bf-f892-4eeb-9572-f2c7e2cdc96a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:20.587908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff4269bf-f892-4eeb-9572-f2c7e2cdc96a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:20.588354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff4269bf-f892-4eeb-9572-f2c7e2cdc96a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:20.588775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff4269bf-f892-4eeb-9572-f2c7e2cdc96a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:20.754778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ff4269bf-f892-4eeb-9572-f2c7e2cdc96a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:20.762984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ff4269bf-f892-4eeb-9572-f2c7e2cdc96a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.190746 Sep 02 09:34:20.763628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 115/225] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:20 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:34:21.784677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b5965b9b-74b3-42ed-b790-8f662d310318 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:21.785281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b5965b9b-74b3-42ed-b790-8f662d310318 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:21.791929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5965b9b-74b3-42ed-b790-8f662d310318 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:21.792407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5965b9b-74b3-42ed-b790-8f662d310318 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:21.792838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5965b9b-74b3-42ed-b790-8f662d310318 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:21.793510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5965b9b-74b3-42ed-b790-8f662d310318 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:21.794035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5965b9b-74b3-42ed-b790-8f662d310318 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:21.794452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5965b9b-74b3-42ed-b790-8f662d310318 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:21.940727 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5965b9b-74b3-42ed-b790-8f662d310318 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:21.951345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b5965b9b-74b3-42ed-b790-8f662d310318 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1523 microversion: 2.1 time: 0.170444 Sep 02 09:34:21.951919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 111/226] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:21 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:22.981292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e4f5e9c4-b3b0-496e-a374-7e7f4bd3b08e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:22.981896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e4f5e9c4-b3b0-496e-a374-7e7f4bd3b08e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:22.988810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f5e9c4-b3b0-496e-a374-7e7f4bd3b08e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:22.989288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f5e9c4-b3b0-496e-a374-7e7f4bd3b08e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:22.989772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f5e9c4-b3b0-496e-a374-7e7f4bd3b08e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:22.990413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f5e9c4-b3b0-496e-a374-7e7f4bd3b08e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:22.995893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f5e9c4-b3b0-496e-a374-7e7f4bd3b08e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:22.995893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f5e9c4-b3b0-496e-a374-7e7f4bd3b08e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:23.128363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e4f5e9c4-b3b0-496e-a374-7e7f4bd3b08e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:23.136461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e4f5e9c4-b3b0-496e-a374-7e7f4bd3b08e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1503 microversion: 2.1 time: 0.158943 Sep 02 09:34:23.137133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 116/227] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:22 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:23.162790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-017133e6-670e-4a2c-a36c-12b9450ed59c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:23.164021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-017133e6-670e-4a2c-a36c-12b9450ed59c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:23.170447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-017133e6-670e-4a2c-a36c-12b9450ed59c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:23.170968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-017133e6-670e-4a2c-a36c-12b9450ed59c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:23.171408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-017133e6-670e-4a2c-a36c-12b9450ed59c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:23.172091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-017133e6-670e-4a2c-a36c-12b9450ed59c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:23.172560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-017133e6-670e-4a2c-a36c-12b9450ed59c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:23.172984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-017133e6-670e-4a2c-a36c-12b9450ed59c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:23.309277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-017133e6-670e-4a2c-a36c-12b9450ed59c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:23.317281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-017133e6-670e-4a2c-a36c-12b9450ed59c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1517 microversion: 2.1 time: 0.158342 Sep 02 09:34:23.322922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 112/228] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:23 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:29.236975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-019d7210-f16b-4860-a4db-5581c6ab7e3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:34:29.239497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-019d7210-f16b-4860-a4db-5581c6ab7e3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:29.246653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-019d7210-f16b-4860-a4db-5581c6ab7e3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:29.247164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-019d7210-f16b-4860-a4db-5581c6ab7e3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:29.247785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-019d7210-f16b-4860-a4db-5581c6ab7e3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:29.248662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-019d7210-f16b-4860-a4db-5581c6ab7e3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:29.249124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-019d7210-f16b-4860-a4db-5581c6ab7e3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:29.249554 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-019d7210-f16b-4860-a4db-5581c6ab7e3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:29.276048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-019d7210-f16b-4860-a4db-5581c6ab7e3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'flavor' on Instance uuid 5a68cef6-8c2a-42a1-9943-63f884381755 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:34:29.656472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-019d7210-f16b-4860-a4db-5581c6ab7e3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755/action" status: 200 len: 32 microversion: 2.1 time: 0.423324 Sep 02 09:34:29.657135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 117/229] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 09:34:29 2022] POST /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755/action => generated 32 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 09:34:29.672884 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3145bf12-e053-4756-adef-a7dff26dd5a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:29.673504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3145bf12-e053-4756-adef-a7dff26dd5a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:29.683888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3145bf12-e053-4756-adef-a7dff26dd5a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:29.685485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3145bf12-e053-4756-adef-a7dff26dd5a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:29.686112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3145bf12-e053-4756-adef-a7dff26dd5a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:29.686850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3145bf12-e053-4756-adef-a7dff26dd5a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:29.687302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3145bf12-e053-4756-adef-a7dff26dd5a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:29.687723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3145bf12-e053-4756-adef-a7dff26dd5a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:29.827506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3145bf12-e053-4756-adef-a7dff26dd5a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:29.838962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3145bf12-e053-4756-adef-a7dff26dd5a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.173305 Sep 02 09:34:29.838962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 113/230] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:29 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:30.858215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-17de4cc4-7ae9-4b4d-b0cd-67eaec53d1d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:30.859098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-17de4cc4-7ae9-4b4d-b0cd-67eaec53d1d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:30.870737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17de4cc4-7ae9-4b4d-b0cd-67eaec53d1d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:30.871278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17de4cc4-7ae9-4b4d-b0cd-67eaec53d1d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:30.871962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17de4cc4-7ae9-4b4d-b0cd-67eaec53d1d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:30.872670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17de4cc4-7ae9-4b4d-b0cd-67eaec53d1d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:30.873196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17de4cc4-7ae9-4b4d-b0cd-67eaec53d1d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:30.874086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17de4cc4-7ae9-4b4d-b0cd-67eaec53d1d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:31.016307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-17de4cc4-7ae9-4b4d-b0cd-67eaec53d1d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:31.028028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-17de4cc4-7ae9-4b4d-b0cd-67eaec53d1d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.174489 Sep 02 09:34:31.046305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 118/231] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:30 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:32.049468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2588e8f3-a3fb-44c8-9445-8c57e86332ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:32.050077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2588e8f3-a3fb-44c8-9445-8c57e86332ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:32.061066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2588e8f3-a3fb-44c8-9445-8c57e86332ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:32.061066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2588e8f3-a3fb-44c8-9445-8c57e86332ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:32.061066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2588e8f3-a3fb-44c8-9445-8c57e86332ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:32.061066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2588e8f3-a3fb-44c8-9445-8c57e86332ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:32.066598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2588e8f3-a3fb-44c8-9445-8c57e86332ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:32.066598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2588e8f3-a3fb-44c8-9445-8c57e86332ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:32.189416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2588e8f3-a3fb-44c8-9445-8c57e86332ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:32.197284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2588e8f3-a3fb-44c8-9445-8c57e86332ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.151746 Sep 02 09:34:32.197855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 114/232] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:32 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:33.219043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-76e0077d-3c5c-48da-86a9-60e1bb1d2d87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:33.219658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-76e0077d-3c5c-48da-86a9-60e1bb1d2d87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:33.226575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76e0077d-3c5c-48da-86a9-60e1bb1d2d87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:33.227085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76e0077d-3c5c-48da-86a9-60e1bb1d2d87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:33.228014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76e0077d-3c5c-48da-86a9-60e1bb1d2d87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:33.228701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76e0077d-3c5c-48da-86a9-60e1bb1d2d87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:33.229147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76e0077d-3c5c-48da-86a9-60e1bb1d2d87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:33.229566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76e0077d-3c5c-48da-86a9-60e1bb1d2d87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:33.424977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-76e0077d-3c5c-48da-86a9-60e1bb1d2d87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:33.434329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-76e0077d-3c5c-48da-86a9-60e1bb1d2d87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.219093 Sep 02 09:34:33.435171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 119/233] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:33 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:34.464991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6ea5d4df-4549-4f06-9432-e4109a69aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:34.466466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6ea5d4df-4549-4f06-9432-e4109a69aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:34.479561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ea5d4df-4549-4f06-9432-e4109a69aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:34.480142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ea5d4df-4549-4f06-9432-e4109a69aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:34.480666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ea5d4df-4549-4f06-9432-e4109a69aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:34.481415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ea5d4df-4549-4f06-9432-e4109a69aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:34.482273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ea5d4df-4549-4f06-9432-e4109a69aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:34.483030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ea5d4df-4549-4f06-9432-e4109a69aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:34.652731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6ea5d4df-4549-4f06-9432-e4109a69aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:34.662962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6ea5d4df-4549-4f06-9432-e4109a69aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.206646 Sep 02 09:34:34.663709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 115/234] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:34 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:35.685758 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-059a24f3-2436-4fa9-8d1c-b40c49d9c497 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:35.686367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-059a24f3-2436-4fa9-8d1c-b40c49d9c497 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:35.692765 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-059a24f3-2436-4fa9-8d1c-b40c49d9c497 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:35.693251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-059a24f3-2436-4fa9-8d1c-b40c49d9c497 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:35.693686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-059a24f3-2436-4fa9-8d1c-b40c49d9c497 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:35.694398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-059a24f3-2436-4fa9-8d1c-b40c49d9c497 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:35.694883 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-059a24f3-2436-4fa9-8d1c-b40c49d9c497 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:35.695309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-059a24f3-2436-4fa9-8d1c-b40c49d9c497 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:35.891473 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-059a24f3-2436-4fa9-8d1c-b40c49d9c497 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:35.899665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-059a24f3-2436-4fa9-8d1c-b40c49d9c497 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.218731 Sep 02 09:34:35.900243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 120/235] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:35 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:36.920855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bb6f94bc-cb1d-49a5-82db-40eb17fd4be9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:36.922225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bb6f94bc-cb1d-49a5-82db-40eb17fd4be9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:36.928431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6f94bc-cb1d-49a5-82db-40eb17fd4be9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:36.928920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6f94bc-cb1d-49a5-82db-40eb17fd4be9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:36.929348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6f94bc-cb1d-49a5-82db-40eb17fd4be9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:36.930076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6f94bc-cb1d-49a5-82db-40eb17fd4be9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:36.930555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6f94bc-cb1d-49a5-82db-40eb17fd4be9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:36.931088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb6f94bc-cb1d-49a5-82db-40eb17fd4be9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:37.102780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb6f94bc-cb1d-49a5-82db-40eb17fd4be9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:37.111802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bb6f94bc-cb1d-49a5-82db-40eb17fd4be9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.194890 Sep 02 09:34:37.113044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 116/236] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:36 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:38.134041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d51ad600-1f73-4e3b-9f7f-19279d71f17a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:38.134663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d51ad600-1f73-4e3b-9f7f-19279d71f17a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:38.143634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ad600-1f73-4e3b-9f7f-19279d71f17a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:38.143634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ad600-1f73-4e3b-9f7f-19279d71f17a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:38.143634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ad600-1f73-4e3b-9f7f-19279d71f17a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:38.143634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ad600-1f73-4e3b-9f7f-19279d71f17a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:38.144010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ad600-1f73-4e3b-9f7f-19279d71f17a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:38.144010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ad600-1f73-4e3b-9f7f-19279d71f17a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:38.320071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d51ad600-1f73-4e3b-9f7f-19279d71f17a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:38.341114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d51ad600-1f73-4e3b-9f7f-19279d71f17a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.211330 Sep 02 09:34:38.355339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 121/237] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:38 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:39.367575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-56c481e4-a0fa-4681-8212-e081eeee7edd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:39.368986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-56c481e4-a0fa-4681-8212-e081eeee7edd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:39.377317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56c481e4-a0fa-4681-8212-e081eeee7edd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:39.378717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56c481e4-a0fa-4681-8212-e081eeee7edd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:39.379862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56c481e4-a0fa-4681-8212-e081eeee7edd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:39.381295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56c481e4-a0fa-4681-8212-e081eeee7edd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:39.382058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56c481e4-a0fa-4681-8212-e081eeee7edd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:39.383116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-56c481e4-a0fa-4681-8212-e081eeee7edd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:39.533469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-56c481e4-a0fa-4681-8212-e081eeee7edd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:39.542028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-56c481e4-a0fa-4681-8212-e081eeee7edd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.178777 Sep 02 09:34:39.542879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 117/238] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:39 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:40.564487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cf6321f5-be00-4bbe-b6fc-0d659d64a532 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:40.565241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cf6321f5-be00-4bbe-b6fc-0d659d64a532 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:40.573201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf6321f5-be00-4bbe-b6fc-0d659d64a532 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:40.574387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf6321f5-be00-4bbe-b6fc-0d659d64a532 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:40.575143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf6321f5-be00-4bbe-b6fc-0d659d64a532 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:40.575924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf6321f5-be00-4bbe-b6fc-0d659d64a532 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:40.576447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf6321f5-be00-4bbe-b6fc-0d659d64a532 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:40.576945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf6321f5-be00-4bbe-b6fc-0d659d64a532 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:40.761386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cf6321f5-be00-4bbe-b6fc-0d659d64a532 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:40.788034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cf6321f5-be00-4bbe-b6fc-0d659d64a532 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.227286 Sep 02 09:34:40.801249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 122/239] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:40 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:41.808909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-01260e7c-cba2-42ab-bd9b-bd815c4dc589 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:41.809514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-01260e7c-cba2-42ab-bd9b-bd815c4dc589 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:41.815468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01260e7c-cba2-42ab-bd9b-bd815c4dc589 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:41.815942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01260e7c-cba2-42ab-bd9b-bd815c4dc589 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:41.816369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01260e7c-cba2-42ab-bd9b-bd815c4dc589 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:41.817041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01260e7c-cba2-42ab-bd9b-bd815c4dc589 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:41.817486 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01260e7c-cba2-42ab-bd9b-bd815c4dc589 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:41.817965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-01260e7c-cba2-42ab-bd9b-bd815c4dc589 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:41.968003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-01260e7c-cba2-42ab-bd9b-bd815c4dc589 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:41.977575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-01260e7c-cba2-42ab-bd9b-bd815c4dc589 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.171827 Sep 02 09:34:41.979830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 118/240] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:41 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:43.000455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7e8a8e86-57ab-4084-abf2-4d49f13f4833 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:43.001062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7e8a8e86-57ab-4084-abf2-4d49f13f4833 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:43.007441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e8a8e86-57ab-4084-abf2-4d49f13f4833 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:43.007962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e8a8e86-57ab-4084-abf2-4d49f13f4833 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:43.008400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e8a8e86-57ab-4084-abf2-4d49f13f4833 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:43.009086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e8a8e86-57ab-4084-abf2-4d49f13f4833 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:43.009538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e8a8e86-57ab-4084-abf2-4d49f13f4833 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:43.009959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e8a8e86-57ab-4084-abf2-4d49f13f4833 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:43.182542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7e8a8e86-57ab-4084-abf2-4d49f13f4833 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:43.192491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7e8a8e86-57ab-4084-abf2-4d49f13f4833 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.195911 Sep 02 09:34:43.212014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 123/241] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:42 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:34:44.238002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-39c80ec1-f94d-4754-874b-59c6052a460d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:44.238002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-39c80ec1-f94d-4754-874b-59c6052a460d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:44.247157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39c80ec1-f94d-4754-874b-59c6052a460d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:44.247711 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39c80ec1-f94d-4754-874b-59c6052a460d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:44.248433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39c80ec1-f94d-4754-874b-59c6052a460d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:44.253758 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39c80ec1-f94d-4754-874b-59c6052a460d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:44.255350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39c80ec1-f94d-4754-874b-59c6052a460d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:44.256000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39c80ec1-f94d-4754-874b-59c6052a460d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:44.268479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=81 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:44.484271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-39c80ec1-f94d-4754-874b-59c6052a460d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:44.493139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-39c80ec1-f94d-4754-874b-59c6052a460d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.262585 Sep 02 09:34:44.493725 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 119/242] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:44 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:45.518972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d3f41bfd-137e-47e7-addf-3295b4507892 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:45.518972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d3f41bfd-137e-47e7-addf-3295b4507892 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:45.523926 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=24 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:45.525765 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3f41bfd-137e-47e7-addf-3295b4507892 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:45.526261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3f41bfd-137e-47e7-addf-3295b4507892 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:45.526874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3f41bfd-137e-47e7-addf-3295b4507892 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:45.527574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3f41bfd-137e-47e7-addf-3295b4507892 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:45.528024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3f41bfd-137e-47e7-addf-3295b4507892 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:45.528445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3f41bfd-137e-47e7-addf-3295b4507892 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:45.709540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d3f41bfd-137e-47e7-addf-3295b4507892 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:45.718498 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d3f41bfd-137e-47e7-addf-3295b4507892 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.205897 Sep 02 09:34:45.719232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 124/243] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:45 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:46.740561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a5a0e9df-591a-4611-bc59-e80f087540e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:46.741986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a5a0e9df-591a-4611-bc59-e80f087540e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:46.744505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=26 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:46.749655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5a0e9df-591a-4611-bc59-e80f087540e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:46.750157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5a0e9df-591a-4611-bc59-e80f087540e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:46.750592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5a0e9df-591a-4611-bc59-e80f087540e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:46.751335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5a0e9df-591a-4611-bc59-e80f087540e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:46.751917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5a0e9df-591a-4611-bc59-e80f087540e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:46.752357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5a0e9df-591a-4611-bc59-e80f087540e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:46.897691 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a5a0e9df-591a-4611-bc59-e80f087540e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:46.907080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a5a0e9df-591a-4611-bc59-e80f087540e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.171004 Sep 02 09:34:46.921648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 120/244] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:46 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:47.929049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2adb88c8-1a93-4acc-a114-4e0d468dd2f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:47.929741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2adb88c8-1a93-4acc-a114-4e0d468dd2f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:47.937727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2adb88c8-1a93-4acc-a114-4e0d468dd2f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:47.938465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2adb88c8-1a93-4acc-a114-4e0d468dd2f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:47.939110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2adb88c8-1a93-4acc-a114-4e0d468dd2f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:47.939991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2adb88c8-1a93-4acc-a114-4e0d468dd2f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:47.940624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2adb88c8-1a93-4acc-a114-4e0d468dd2f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:47.941083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2adb88c8-1a93-4acc-a114-4e0d468dd2f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:47.946383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:48.099059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2adb88c8-1a93-4acc-a114-4e0d468dd2f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:48.107962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2adb88c8-1a93-4acc-a114-4e0d468dd2f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.182943 Sep 02 09:34:48.119547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 125/245] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:47 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:48.885270 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e0abc98f-3e20-4869-ba65-afd471a29959 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Action: 'create', calling method: .version_select at 0x7f4e5c4a2af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-199031911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJgOOxEM8OBQyvJCjmckD29ETe347KI0Sw5joUoTedVQ9yygum+DH5nr1ho3rPo+DWmKvz/TV3CQgINkssluyWYRsy726m2CdcvIlzG12XA+f5817wSzFsOgnoC+YRr8A=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:34:48.901462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-e0abc98f-3e20-4869-ba65-afd471a29959 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Getting quotas for project 2c5938d62e2d40969d096b66e14edd75. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:34:48.905340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-e0abc98f-3e20-4869-ba65-afd471a29959 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Getting quotas for user d935a4a30e4d44e0a392596452a5c1b6 and project 2c5938d62e2d40969d096b66e14edd75. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:34:49.007987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e0abc98f-3e20-4869-ba65-afd471a29959 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.347764 Sep 02 09:34:49.008830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 121/246] 10.222.0.57 () {60 vars in 1159 bytes} [Fri Sep 2 09:34:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:34:49.130024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ca5110d1-bd68-4233-8f0b-e186c292d4d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:49.130606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ca5110d1-bd68-4233-8f0b-e186c292d4d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:49.142797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5110d1-bd68-4233-8f0b-e186c292d4d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:49.143271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5110d1-bd68-4233-8f0b-e186c292d4d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:49.143708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5110d1-bd68-4233-8f0b-e186c292d4d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:49.144415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5110d1-bd68-4233-8f0b-e186c292d4d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:49.144877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5110d1-bd68-4233-8f0b-e186c292d4d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:49.145285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5110d1-bd68-4233-8f0b-e186c292d4d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:49.310375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ca5110d1-bd68-4233-8f0b-e186c292d4d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:49.318287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ca5110d1-bd68-4233-8f0b-e186c292d4d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.192342 Sep 02 09:34:49.332977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 126/247] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:49 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:50.347492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d0a3cdea-fa62-4fed-956c-21d070e1e3ec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:50.350428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d0a3cdea-fa62-4fed-956c-21d070e1e3ec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:50.361489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0a3cdea-fa62-4fed-956c-21d070e1e3ec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:50.362012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0a3cdea-fa62-4fed-956c-21d070e1e3ec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:50.362475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0a3cdea-fa62-4fed-956c-21d070e1e3ec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:50.363265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0a3cdea-fa62-4fed-956c-21d070e1e3ec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:50.363715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0a3cdea-fa62-4fed-956c-21d070e1e3ec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:50.364134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0a3cdea-fa62-4fed-956c-21d070e1e3ec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:50.535261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d0a3cdea-fa62-4fed-956c-21d070e1e3ec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:50.544084 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d0a3cdea-fa62-4fed-956c-21d070e1e3ec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.207802 Sep 02 09:34:50.544715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 122/248] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:50 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:51.567159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1b964ffe-aef1-4d42-a1f4-ab23012bd0a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:51.567914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1b964ffe-aef1-4d42-a1f4-ab23012bd0a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:51.575150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b964ffe-aef1-4d42-a1f4-ab23012bd0a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:51.575693 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b964ffe-aef1-4d42-a1f4-ab23012bd0a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:51.576139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b964ffe-aef1-4d42-a1f4-ab23012bd0a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:51.576910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b964ffe-aef1-4d42-a1f4-ab23012bd0a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:51.577377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b964ffe-aef1-4d42-a1f4-ab23012bd0a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:51.577801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b964ffe-aef1-4d42-a1f4-ab23012bd0a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:51.724114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1b964ffe-aef1-4d42-a1f4-ab23012bd0a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:51.737073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1b964ffe-aef1-4d42-a1f4-ab23012bd0a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1503 microversion: 2.1 time: 0.174087 Sep 02 09:34:51.737657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 127/249] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:51 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:51.765943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87da3f07-b26f-4c18-87b8-d6ae042a9e11"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:34:51.777085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:51.788267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:51.793799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:51.794249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:51.795296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:51.795462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:51.795892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:51.830047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Cannot 'attach_volume' instance 5a68cef6-8c2a-42a1-9943-63f884381755 while it is in vm_state rescued Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: POST /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755/os-volume_attachments HTTP/1.1 Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 74 Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:34:51.832514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {"volumeAttachment": {"volumeId": "87da3f07-b26f-4c18-87b8-d6ae042a9e11"}} Sep 02 09:34:51.834111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Cannot 'attach_volume' instance 5a68cef6-8c2a-42a1-9943-63f884381755 while it is in vm_state rescued Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'server_id': '5a68cef6-8c2a-42a1-9943-63f884381755', 'body': {'volumeAttachment': {'volumeId': '87da3f07-b26f-4c18-87b8-d6ae042a9e11'}}} Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a68cef6-8c2a-42a1-9943-63f884381755 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:34:51.835099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5a68cef6-8c2a-42a1-9943-63f884381755 while it is in vm_state rescued Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:34:51.836564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:34:51.837909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:34:51.837909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:34:51.837909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5a68cef6-8c2a-42a1-9943-63f884381755 while it is in vm_state rescued Sep 02 09:34:51.837909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:34:51.837909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 409 to user: Cannot 'attach_volume' instance 5a68cef6-8c2a-42a1-9943-63f884381755 while it is in vm_state rescued {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:34:51.837909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6d6c420d-ffff-45c3-8881-b1a2af8098a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.078392 Sep 02 09:34:51.843220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 123/250] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 09:34:51 2022] POST /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755/os-volume_attachments => generated 152 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 09:34:51.848415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-83f922c9-4403-49e5-971b-45301437605e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:34:51.849284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-83f922c9-4403-49e5-971b-45301437605e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:51.864323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83f922c9-4403-49e5-971b-45301437605e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:51.864823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83f922c9-4403-49e5-971b-45301437605e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:51.865350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83f922c9-4403-49e5-971b-45301437605e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:51.866560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83f922c9-4403-49e5-971b-45301437605e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:51.868600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83f922c9-4403-49e5-971b-45301437605e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:51.869201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83f922c9-4403-49e5-971b-45301437605e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:52.210214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-83f922c9-4403-49e5-971b-45301437605e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755/action" status: 202 len: 0 microversion: 2.1 time: 0.370247 Sep 02 09:34:52.215131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 128/251] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 09:34:51 2022] POST /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:34:52.221682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb959a2d-1805-4e1d-ab6a-b0a9a256da4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:52.221682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb959a2d-1805-4e1d-ab6a-b0a9a256da4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:52.228533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb959a2d-1805-4e1d-ab6a-b0a9a256da4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:52.229018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb959a2d-1805-4e1d-ab6a-b0a9a256da4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:52.229448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb959a2d-1805-4e1d-ab6a-b0a9a256da4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:52.230137 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb959a2d-1805-4e1d-ab6a-b0a9a256da4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:52.230584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb959a2d-1805-4e1d-ab6a-b0a9a256da4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:52.231034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb959a2d-1805-4e1d-ab6a-b0a9a256da4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:52.368550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb959a2d-1805-4e1d-ab6a-b0a9a256da4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:52.378104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb959a2d-1805-4e1d-ab6a-b0a9a256da4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1511 microversion: 2.1 time: 0.161455 Sep 02 09:34:52.391215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 124/252] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:52 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:53.407287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2869fa2f-81f9-4616-99ac-4fb5fa01a560 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:53.408309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2869fa2f-81f9-4616-99ac-4fb5fa01a560 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:53.416011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2869fa2f-81f9-4616-99ac-4fb5fa01a560 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:53.416502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2869fa2f-81f9-4616-99ac-4fb5fa01a560 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:53.416949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2869fa2f-81f9-4616-99ac-4fb5fa01a560 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:53.417648 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2869fa2f-81f9-4616-99ac-4fb5fa01a560 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:53.418136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2869fa2f-81f9-4616-99ac-4fb5fa01a560 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:53.418565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2869fa2f-81f9-4616-99ac-4fb5fa01a560 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:53.785950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2869fa2f-81f9-4616-99ac-4fb5fa01a560 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:53.793907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2869fa2f-81f9-4616-99ac-4fb5fa01a560 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1511 microversion: 2.1 time: 0.392343 Sep 02 09:34:53.794555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 129/253] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:53 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:54.816167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cb1981aa-bb9b-4e88-b90c-96833e1508a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:54.816739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cb1981aa-bb9b-4e88-b90c-96833e1508a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:54.823976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1981aa-bb9b-4e88-b90c-96833e1508a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:54.829375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1981aa-bb9b-4e88-b90c-96833e1508a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:54.829375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1981aa-bb9b-4e88-b90c-96833e1508a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:54.829375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1981aa-bb9b-4e88-b90c-96833e1508a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:54.829375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1981aa-bb9b-4e88-b90c-96833e1508a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:54.829772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1981aa-bb9b-4e88-b90c-96833e1508a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:54.974891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cb1981aa-bb9b-4e88-b90c-96833e1508a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:54.984911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cb1981aa-bb9b-4e88-b90c-96833e1508a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1511 microversion: 2.1 time: 0.172796 Sep 02 09:34:54.998915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 125/254] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:54 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:56.008530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9292745b-fee4-4ae8-a119-48c41f843c05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:56.009138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9292745b-fee4-4ae8-a119-48c41f843c05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:56.015885 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9292745b-fee4-4ae8-a119-48c41f843c05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:56.016376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9292745b-fee4-4ae8-a119-48c41f843c05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:56.016814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9292745b-fee4-4ae8-a119-48c41f843c05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:56.017501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9292745b-fee4-4ae8-a119-48c41f843c05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:56.018130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9292745b-fee4-4ae8-a119-48c41f843c05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:56.018648 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9292745b-fee4-4ae8-a119-48c41f843c05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:56.182554 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9292745b-fee4-4ae8-a119-48c41f843c05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:56.190423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9292745b-fee4-4ae8-a119-48c41f843c05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1511 microversion: 2.1 time: 0.186383 Sep 02 09:34:56.191033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 130/255] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:56 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:57.213145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6a0c2716-9cb9-49b4-9f58-271b7dc3b865 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:57.213800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6a0c2716-9cb9-49b4-9f58-271b7dc3b865 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:57.225139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a0c2716-9cb9-49b4-9f58-271b7dc3b865 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:57.233834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a0c2716-9cb9-49b4-9f58-271b7dc3b865 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:57.233834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a0c2716-9cb9-49b4-9f58-271b7dc3b865 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:57.233834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a0c2716-9cb9-49b4-9f58-271b7dc3b865 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:57.233834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a0c2716-9cb9-49b4-9f58-271b7dc3b865 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:57.234175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a0c2716-9cb9-49b4-9f58-271b7dc3b865 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:57.385113 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6a0c2716-9cb9-49b4-9f58-271b7dc3b865 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:57.393418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6a0c2716-9cb9-49b4-9f58-271b7dc3b865 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1511 microversion: 2.1 time: 0.184888 Sep 02 09:34:57.394012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 126/256] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:57 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:58.414721 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4df91805-3d79-4538-9c2f-ec13ba692d28 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:34:58.415591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4df91805-3d79-4538-9c2f-ec13ba692d28 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:34:58.430603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4df91805-3d79-4538-9c2f-ec13ba692d28 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:58.431135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4df91805-3d79-4538-9c2f-ec13ba692d28 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:58.431579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4df91805-3d79-4538-9c2f-ec13ba692d28 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:58.432346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4df91805-3d79-4538-9c2f-ec13ba692d28 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:34:58.432810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4df91805-3d79-4538-9c2f-ec13ba692d28 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:34:58.433275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4df91805-3d79-4538-9c2f-ec13ba692d28 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:34:58.580450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4df91805-3d79-4538-9c2f-ec13ba692d28 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:34:58.589197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4df91805-3d79-4538-9c2f-ec13ba692d28 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1517 microversion: 2.1 time: 0.178348 Sep 02 09:34:58.589853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 131/257] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:34:58 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:34:59.675466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-862078207", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:34:59.683095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:34:59.729744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] validate_networks() for None {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:35:00.038236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:35:00.038626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:35:00.039350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:35:00.040306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:35:00.041585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:35:00.055909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:00.055909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:00.055909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:00.055909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:00.056391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:00.056391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:00.071552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Getting quotas for project f81d6a5715cf497fbda2b68647c0a5a2. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:35:00.077061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Getting quotas for user d304395e2a0a49ceae4c4d9166ca92e2 and project f81d6a5715cf497fbda2b68647c0a5a2. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:35:00.089487 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:35:00.091967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:35:00.246275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-13962a94-1931-42bd-bcbe-a38c88098162 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574564 Sep 02 09:35:00.247225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 127/258] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 09:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 09:35:00.258337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-91d0820d-0146-4fd6-a746-8ceb01509cb7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:00.259258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-91d0820d-0146-4fd6-a746-8ceb01509cb7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:00.323458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-91d0820d-0146-4fd6-a746-8ceb01509cb7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:00.331183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-91d0820d-0146-4fd6-a746-8ceb01509cb7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1214 microversion: 2.1 time: 0.076656 Sep 02 09:35:00.332285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 132/259] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:00 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:00.441004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c86714de-62c7-4c2e-bc2b-fe8f16b9fbd0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'create', calling method: .version_select at 0x7f4e5c4a2c10>, body: {"keypair": {"name": "tempest-keypair-160664394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLHv/Nub91GKNLs9oyitrOKCP+dZwm8X9/+SH+WM/FJGCajmtPtMsbZZzUwsAyg1lCAT5X1aUvR7/ACidqd/kiHPGR6KcISIjkMyjVDGfbvmPU3OJLIUXh3XJ+RdEZ4Mg=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:35:00.464768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-c86714de-62c7-4c2e-bc2b-fe8f16b9fbd0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Getting quotas for project c2945ae512e14bfbb7d02dedc4de7cd4. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:35:00.468991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-c86714de-62c7-4c2e-bc2b-fe8f16b9fbd0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Getting quotas for user c79aaf1f72634eefb5e89c8005afe54b and project c2945ae512e14bfbb7d02dedc4de7cd4. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:35:00.681922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c86714de-62c7-4c2e-bc2b-fe8f16b9fbd0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.244812 Sep 02 09:35:00.682570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 128/260] 10.222.0.57 () {60 vars in 1159 bytes} [Fri Sep 2 09:35:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:35:01.353090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-754b8cf9-8f70-4de1-955a-25b708bad962 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:01.353704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-754b8cf9-8f70-4de1-955a-25b708bad962 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:01.408537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-754b8cf9-8f70-4de1-955a-25b708bad962 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:01.415365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-754b8cf9-8f70-4de1-955a-25b708bad962 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1214 microversion: 2.1 time: 0.066734 Sep 02 09:35:01.415979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 133/261] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:01 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:02.436477 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3f26afa9-878c-4b12-98d9-23ae2d7a1050 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:02.437192 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3f26afa9-878c-4b12-98d9-23ae2d7a1050 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:02.443701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f26afa9-878c-4b12-98d9-23ae2d7a1050 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:02.444296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f26afa9-878c-4b12-98d9-23ae2d7a1050 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:02.444824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f26afa9-878c-4b12-98d9-23ae2d7a1050 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:02.446101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f26afa9-878c-4b12-98d9-23ae2d7a1050 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:02.446615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f26afa9-878c-4b12-98d9-23ae2d7a1050 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:02.447077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f26afa9-878c-4b12-98d9-23ae2d7a1050 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:02.545857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3f26afa9-878c-4b12-98d9-23ae2d7a1050 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:02.553647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3f26afa9-878c-4b12-98d9-23ae2d7a1050 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1218 microversion: 2.1 time: 0.121278 Sep 02 09:35:02.554311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 129/262] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:02 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:03.044462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1404641164", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6039bcf1-9eb4-424a-b518-61e41a24db11"}], "security_groups": [{"name": "tempest-securitygroup--1154871948"}], "key_name": "tempest-keypair-160664394", "user_data": "}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:35:03.154142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.network.neutron [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] validate_networks() for [('6039bcf1-9eb4-424a-b518-61e41a24db11', None, None, None, None, None)] {{(pid=127533) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:35:03.526499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Flavor limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:35:03.526965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Image limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:35:03.527441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Flavor pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:35:03.527849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Image pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:35:03.528290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:35:03.537079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:03.537605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:03.538041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:03.538793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:03.539254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:03.540336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:03.557960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Getting quotas for project c2945ae512e14bfbb7d02dedc4de7cd4. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:35:03.561915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Getting quotas for user c79aaf1f72634eefb5e89c8005afe54b and project c2945ae512e14bfbb7d02dedc4de7cd4. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:35:03.573669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Going to run 1 instances... {{(pid=127533) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:35:03.575757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2d72e457-d38c-4740-8943-ea14d8cd2685 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:03.576364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2d72e457-d38c-4740-8943-ea14d8cd2685 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:03.576510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127533) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:35:03.582112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d72e457-d38c-4740-8943-ea14d8cd2685 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:03.582600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d72e457-d38c-4740-8943-ea14d8cd2685 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:03.583152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d72e457-d38c-4740-8943-ea14d8cd2685 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:03.583790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d72e457-d38c-4740-8943-ea14d8cd2685 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:03.584244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d72e457-d38c-4740-8943-ea14d8cd2685 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:03.584667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d72e457-d38c-4740-8943-ea14d8cd2685 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:03.645228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2d72e457-d38c-4740-8943-ea14d8cd2685 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:03.653476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2d72e457-d38c-4740-8943-ea14d8cd2685 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1218 microversion: 2.1 time: 0.081541 Sep 02 09:35:03.654076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 130/263] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:03 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:03.675624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6a5ec576-ecc3-4534-960c-881be6722b6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.635296 Sep 02 09:35:03.676687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 134/264] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 09:35:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:35:03.687398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-649c30d6-7ba6-4c41-83a0-8263c4e30bed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:03.688004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-649c30d6-7ba6-4c41-83a0-8263c4e30bed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:03.748822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-649c30d6-7ba6-4c41-83a0-8263c4e30bed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:03.757362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-649c30d6-7ba6-4c41-83a0-8263c4e30bed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1245 microversion: 2.1 time: 0.073598 Sep 02 09:35:03.771290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 131/265] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:04.674016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-91955be3-38fb-474c-b049-df6aa78cdc2c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:04.674663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-91955be3-38fb-474c-b049-df6aa78cdc2c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:04.681712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91955be3-38fb-474c-b049-df6aa78cdc2c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:04.683231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91955be3-38fb-474c-b049-df6aa78cdc2c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:04.683231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91955be3-38fb-474c-b049-df6aa78cdc2c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:04.683450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91955be3-38fb-474c-b049-df6aa78cdc2c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:04.683771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91955be3-38fb-474c-b049-df6aa78cdc2c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:04.684197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91955be3-38fb-474c-b049-df6aa78cdc2c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:04.750733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-91955be3-38fb-474c-b049-df6aa78cdc2c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:04.760513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-91955be3-38fb-474c-b049-df6aa78cdc2c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1218 microversion: 2.1 time: 0.088944 Sep 02 09:35:04.760513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 135/266] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:04 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:04.780186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1389766a-bac3-41e8-9391-ba1bd2521118 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:04.780792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1389766a-bac3-41e8-9391-ba1bd2521118 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:04.786932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1389766a-bac3-41e8-9391-ba1bd2521118 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:04.787555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1389766a-bac3-41e8-9391-ba1bd2521118 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:04.788259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1389766a-bac3-41e8-9391-ba1bd2521118 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:04.789233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1389766a-bac3-41e8-9391-ba1bd2521118 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:04.790158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1389766a-bac3-41e8-9391-ba1bd2521118 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:04.791229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1389766a-bac3-41e8-9391-ba1bd2521118 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:04.857458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1389766a-bac3-41e8-9391-ba1bd2521118 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:04.864980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1389766a-bac3-41e8-9391-ba1bd2521118 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1249 microversion: 2.1 time: 0.088646 Sep 02 09:35:04.865530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 132/267] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:05.779378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7811af81-9601-4565-abfe-00062f179a46 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:05.782518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7811af81-9601-4565-abfe-00062f179a46 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:05.786663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7811af81-9601-4565-abfe-00062f179a46 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:05.787247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7811af81-9601-4565-abfe-00062f179a46 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:05.787699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7811af81-9601-4565-abfe-00062f179a46 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:05.788363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7811af81-9601-4565-abfe-00062f179a46 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:05.788818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7811af81-9601-4565-abfe-00062f179a46 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:05.789890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7811af81-9601-4565-abfe-00062f179a46 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:05.887160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6c9282c5-32a1-4c32-a721-aa48ce37aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:05.887160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6c9282c5-32a1-4c32-a721-aa48ce37aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:05.893561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c9282c5-32a1-4c32-a721-aa48ce37aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:05.894143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c9282c5-32a1-4c32-a721-aa48ce37aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:05.894557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c9282c5-32a1-4c32-a721-aa48ce37aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:05.895289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c9282c5-32a1-4c32-a721-aa48ce37aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:05.895968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c9282c5-32a1-4c32-a721-aa48ce37aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:05.896554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c9282c5-32a1-4c32-a721-aa48ce37aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:05.965941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6c9282c5-32a1-4c32-a721-aa48ce37aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:05.973682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6c9282c5-32a1-4c32-a721-aa48ce37aa69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1249 microversion: 2.1 time: 0.092116 Sep 02 09:35:05.974286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 133/268] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:05.990883 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7811af81-9601-4565-abfe-00062f179a46 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:05.999660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7811af81-9601-4565-abfe-00062f179a46 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1210 microversion: 2.1 time: 0.224054 Sep 02 09:35:06.000224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 136/269] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:05 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1210 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:07.000474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-90b82d6f-a9fb-4e55-a12b-940d33a07c62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:07.001069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-90b82d6f-a9fb-4e55-a12b-940d33a07c62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:07.007649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90b82d6f-a9fb-4e55-a12b-940d33a07c62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:07.008999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90b82d6f-a9fb-4e55-a12b-940d33a07c62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:07.009336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90b82d6f-a9fb-4e55-a12b-940d33a07c62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:07.010030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90b82d6f-a9fb-4e55-a12b-940d33a07c62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:07.010481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90b82d6f-a9fb-4e55-a12b-940d33a07c62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:07.010925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-90b82d6f-a9fb-4e55-a12b-940d33a07c62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:07.020609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e15764ce-7d69-4e5a-becb-7812144fda9d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:07.021392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e15764ce-7d69-4e5a-becb-7812144fda9d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:07.028218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e15764ce-7d69-4e5a-becb-7812144fda9d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:07.029034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e15764ce-7d69-4e5a-becb-7812144fda9d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:07.029455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e15764ce-7d69-4e5a-becb-7812144fda9d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:07.030243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e15764ce-7d69-4e5a-becb-7812144fda9d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:07.030758 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e15764ce-7d69-4e5a-becb-7812144fda9d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:07.031191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e15764ce-7d69-4e5a-becb-7812144fda9d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:07.074631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-90b82d6f-a9fb-4e55-a12b-940d33a07c62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:07.082951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-90b82d6f-a9fb-4e55-a12b-940d33a07c62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1241 microversion: 2.1 time: 0.086489 Sep 02 09:35:07.084043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 134/270] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:07.106928 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e15764ce-7d69-4e5a-becb-7812144fda9d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:07.114447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e15764ce-7d69-4e5a-becb-7812144fda9d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1266 microversion: 2.1 time: 0.097691 Sep 02 09:35:07.115049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 137/271] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:07 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:08.105778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-702ef947-44cc-457b-822b-a10b65969734 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:08.106350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-702ef947-44cc-457b-822b-a10b65969734 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:08.113038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702ef947-44cc-457b-822b-a10b65969734 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:08.113813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702ef947-44cc-457b-822b-a10b65969734 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:08.114573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702ef947-44cc-457b-822b-a10b65969734 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:08.115463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702ef947-44cc-457b-822b-a10b65969734 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:08.116073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702ef947-44cc-457b-822b-a10b65969734 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:08.116500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702ef947-44cc-457b-822b-a10b65969734 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:08.137636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2b2d7798-e491-4a20-a84c-76ef94e6794e tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:08.138247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2b2d7798-e491-4a20-a84c-76ef94e6794e tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:08.144187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b2d7798-e491-4a20-a84c-76ef94e6794e tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:08.144907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b2d7798-e491-4a20-a84c-76ef94e6794e tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:08.145344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b2d7798-e491-4a20-a84c-76ef94e6794e tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:08.146120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b2d7798-e491-4a20-a84c-76ef94e6794e tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:08.146976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b2d7798-e491-4a20-a84c-76ef94e6794e tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:08.147414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b2d7798-e491-4a20-a84c-76ef94e6794e tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:08.189859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-702ef947-44cc-457b-822b-a10b65969734 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:08.198253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-702ef947-44cc-457b-822b-a10b65969734 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1297 microversion: 2.1 time: 0.096881 Sep 02 09:35:08.211808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 135/272] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:08.255696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2b2d7798-e491-4a20-a84c-76ef94e6794e tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:08.263972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2b2d7798-e491-4a20-a84c-76ef94e6794e tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1274 microversion: 2.1 time: 0.130786 Sep 02 09:35:08.278029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 138/273] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:08 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:09.220321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-04f46e4b-5826-4a9a-a7c5-6679c79566a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:09.221161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-04f46e4b-5826-4a9a-a7c5-6679c79566a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:09.227825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04f46e4b-5826-4a9a-a7c5-6679c79566a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:09.228461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04f46e4b-5826-4a9a-a7c5-6679c79566a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:09.229098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04f46e4b-5826-4a9a-a7c5-6679c79566a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:09.229987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04f46e4b-5826-4a9a-a7c5-6679c79566a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:09.230581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04f46e4b-5826-4a9a-a7c5-6679c79566a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:09.231305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-04f46e4b-5826-4a9a-a7c5-6679c79566a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:09.291235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4d44d4bf-d3ef-4599-bcec-348b2cfa5873 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:09.292214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4d44d4bf-d3ef-4599-bcec-348b2cfa5873 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:09.299028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d44d4bf-d3ef-4599-bcec-348b2cfa5873 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:09.299795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d44d4bf-d3ef-4599-bcec-348b2cfa5873 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:09.300432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d44d4bf-d3ef-4599-bcec-348b2cfa5873 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:09.301165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d44d4bf-d3ef-4599-bcec-348b2cfa5873 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:09.301621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d44d4bf-d3ef-4599-bcec-348b2cfa5873 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:09.302041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d44d4bf-d3ef-4599-bcec-348b2cfa5873 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:09.577698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4d44d4bf-d3ef-4599-bcec-348b2cfa5873 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:09.586726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4d44d4bf-d3ef-4599-bcec-348b2cfa5873 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.299653 Sep 02 09:35:09.601073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 139/274] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:09 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:09.663709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-04f46e4b-5826-4a9a-a7c5-6679c79566a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:09.677145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-04f46e4b-5826-4a9a-a7c5-6679c79566a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.462083 Sep 02 09:35:09.678155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 136/275] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:10.234891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-4d25442c-6264-451f-8fdf-4c55db428fd3 req-072d80c4-337b-4096-9a70-4f9e148d69bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457", "tag": "7bbd8d11-dbdb-401b-926c-3b56f63aea2c"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:35:10.250775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4d25442c-6264-451f-8fdf-4c55db428fd3 req-072d80c4-337b-4096-9a70-4f9e148d69bf service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:10.250775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4d25442c-6264-451f-8fdf-4c55db428fd3 req-072d80c4-337b-4096-9a70-4f9e148d69bf service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:10.250775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4d25442c-6264-451f-8fdf-4c55db428fd3 req-072d80c4-337b-4096-9a70-4f9e148d69bf service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:10.265876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-4d25442c-6264-451f-8fdf-4c55db428fd3 req-072d80c4-337b-4096-9a70-4f9e148d69bf service nova] Creating event network-changed:7bbd8d11-dbdb-401b-926c-3b56f63aea2c for instance c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 on hv-cinder-85083 Sep 02 09:35:10.275164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-4d25442c-6264-451f-8fdf-4c55db428fd3 req-072d80c4-337b-4096-9a70-4f9e148d69bf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042458 Sep 02 09:35:10.276538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 140/276] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:35:10.279996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-ed9b7ee1-9c71-4d99-8d49-bcc796ae5be4 req-1b0f4014-1105-463d-b882-9a9723bfe6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bccc75-d837-4a98-8a78-841b2edb8ce5", "tag": "72e00e01-0226-481d-9c3e-f109d75f21d1"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:35:10.290725 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:10.293541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ed9b7ee1-9c71-4d99-8d49-bcc796ae5be4 req-1b0f4014-1105-463d-b882-9a9723bfe6bd service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:10.294287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ed9b7ee1-9c71-4d99-8d49-bcc796ae5be4 req-1b0f4014-1105-463d-b882-9a9723bfe6bd service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:10.294853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ed9b7ee1-9c71-4d99-8d49-bcc796ae5be4 req-1b0f4014-1105-463d-b882-9a9723bfe6bd service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:10.308428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-ed9b7ee1-9c71-4d99-8d49-bcc796ae5be4 req-1b0f4014-1105-463d-b882-9a9723bfe6bd service nova] Creating event network-changed:72e00e01-0226-481d-9c3e-f109d75f21d1 for instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 on hv-cinder-85083 Sep 02 09:35:10.312528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-ed9b7ee1-9c71-4d99-8d49-bcc796ae5be4 req-1b0f4014-1105-463d-b882-9a9723bfe6bd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039511 Sep 02 09:35:10.313334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 137/277] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:35:10.612465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6913ea84-c9a0-4d94-8d71-d822e8dc42f3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:10.613956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6913ea84-c9a0-4d94-8d71-d822e8dc42f3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:10.622991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6913ea84-c9a0-4d94-8d71-d822e8dc42f3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:10.623750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6913ea84-c9a0-4d94-8d71-d822e8dc42f3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:10.624586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6913ea84-c9a0-4d94-8d71-d822e8dc42f3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:10.625822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6913ea84-c9a0-4d94-8d71-d822e8dc42f3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:10.626420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6913ea84-c9a0-4d94-8d71-d822e8dc42f3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:10.627034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6913ea84-c9a0-4d94-8d71-d822e8dc42f3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:10.701170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3830766c-3c0a-44ce-8d6a-dbee0da7b5d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:10.702039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3830766c-3c0a-44ce-8d6a-dbee0da7b5d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:10.708886 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3830766c-3c0a-44ce-8d6a-dbee0da7b5d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:10.709847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3830766c-3c0a-44ce-8d6a-dbee0da7b5d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:10.710964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3830766c-3c0a-44ce-8d6a-dbee0da7b5d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:10.710964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3830766c-3c0a-44ce-8d6a-dbee0da7b5d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:10.712017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3830766c-3c0a-44ce-8d6a-dbee0da7b5d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:10.712680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3830766c-3c0a-44ce-8d6a-dbee0da7b5d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:10.864148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6913ea84-c9a0-4d94-8d71-d822e8dc42f3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:10.872096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3830766c-3c0a-44ce-8d6a-dbee0da7b5d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:10.875311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6913ea84-c9a0-4d94-8d71-d822e8dc42f3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.269292 Sep 02 09:35:10.884241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3830766c-3c0a-44ce-8d6a-dbee0da7b5d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.187574 Sep 02 09:35:10.885369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 138/278] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:10.891011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 141/279] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:10 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:11.897706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bf5926e6-5294-4349-b34f-a29bd738b5ab tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:11.898512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bf5926e6-5294-4349-b34f-a29bd738b5ab tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:11.905332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf5926e6-5294-4349-b34f-a29bd738b5ab tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:11.905827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf5926e6-5294-4349-b34f-a29bd738b5ab tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:11.905983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c930dd8d-1ba7-45fb-9314-fe7404247d1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:11.906414 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf5926e6-5294-4349-b34f-a29bd738b5ab tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:11.906613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c930dd8d-1ba7-45fb-9314-fe7404247d1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:11.906992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf5926e6-5294-4349-b34f-a29bd738b5ab tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:11.907449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf5926e6-5294-4349-b34f-a29bd738b5ab tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:11.907872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf5926e6-5294-4349-b34f-a29bd738b5ab tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:11.912974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c930dd8d-1ba7-45fb-9314-fe7404247d1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:11.913452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c930dd8d-1ba7-45fb-9314-fe7404247d1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:11.913886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c930dd8d-1ba7-45fb-9314-fe7404247d1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:11.914602 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c930dd8d-1ba7-45fb-9314-fe7404247d1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:11.915097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c930dd8d-1ba7-45fb-9314-fe7404247d1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:11.915510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c930dd8d-1ba7-45fb-9314-fe7404247d1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:12.038852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bf5926e6-5294-4349-b34f-a29bd738b5ab tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:12.047589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bf5926e6-5294-4349-b34f-a29bd738b5ab tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.153648 Sep 02 09:35:12.048297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 139/280] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:11 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:12.052452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c930dd8d-1ba7-45fb-9314-fe7404247d1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:12.060510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c930dd8d-1ba7-45fb-9314-fe7404247d1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.158218 Sep 02 09:35:12.061453 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 142/281] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:13.068607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1efb315f-8969-4f83-92e7-5380b8c8f24c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:13.069258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1efb315f-8969-4f83-92e7-5380b8c8f24c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:13.075867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1efb315f-8969-4f83-92e7-5380b8c8f24c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:13.076422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1efb315f-8969-4f83-92e7-5380b8c8f24c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:13.076675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1efb315f-8969-4f83-92e7-5380b8c8f24c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:13.077412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1efb315f-8969-4f83-92e7-5380b8c8f24c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:13.077907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1efb315f-8969-4f83-92e7-5380b8c8f24c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:13.078327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1efb315f-8969-4f83-92e7-5380b8c8f24c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:13.082089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1966539f-3666-466a-a562-31a31641c754 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:13.089940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1966539f-3666-466a-a562-31a31641c754 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:13.089940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1966539f-3666-466a-a562-31a31641c754 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:13.090371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1966539f-3666-466a-a562-31a31641c754 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:13.090797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1966539f-3666-466a-a562-31a31641c754 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:13.091500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1966539f-3666-466a-a562-31a31641c754 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:13.091948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1966539f-3666-466a-a562-31a31641c754 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:13.092367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1966539f-3666-466a-a562-31a31641c754 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:13.098097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:13.221815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1efb315f-8969-4f83-92e7-5380b8c8f24c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:13.222106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1966539f-3666-466a-a562-31a31641c754 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:13.230547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1966539f-3666-466a-a562-31a31641c754 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.152498 Sep 02 09:35:13.230986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1efb315f-8969-4f83-92e7-5380b8c8f24c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.166038 Sep 02 09:35:13.231158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 143/282] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:13.231559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 140/283] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:13 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:14.251520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bebd34d0-5d37-4c94-995e-9c23996d80d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:14.252138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bebd34d0-5d37-4c94-995e-9c23996d80d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:14.252431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3b26a2de-c913-4a52-b329-3b6ff61803cf tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:14.253042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3b26a2de-c913-4a52-b329-3b6ff61803cf tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:14.254097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:14.255065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=10 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:14.256135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=12 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:14.260315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b26a2de-c913-4a52-b329-3b6ff61803cf tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:14.260553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bebd34d0-5d37-4c94-995e-9c23996d80d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:14.260800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b26a2de-c913-4a52-b329-3b6ff61803cf tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:14.261213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bebd34d0-5d37-4c94-995e-9c23996d80d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:14.261339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b26a2de-c913-4a52-b329-3b6ff61803cf tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:14.261651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bebd34d0-5d37-4c94-995e-9c23996d80d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:14.262042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b26a2de-c913-4a52-b329-3b6ff61803cf tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:14.262342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bebd34d0-5d37-4c94-995e-9c23996d80d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:14.262493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b26a2de-c913-4a52-b329-3b6ff61803cf tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:14.262825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bebd34d0-5d37-4c94-995e-9c23996d80d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:14.262948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3b26a2de-c913-4a52-b329-3b6ff61803cf tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:14.263254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bebd34d0-5d37-4c94-995e-9c23996d80d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:14.268462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:14.402424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3b26a2de-c913-4a52-b329-3b6ff61803cf tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:14.417514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3b26a2de-c913-4a52-b329-3b6ff61803cf tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.162817 Sep 02 09:35:14.423345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 141/284] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:14 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:14.430855 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bebd34d0-5d37-4c94-995e-9c23996d80d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:14.439232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bebd34d0-5d37-4c94-995e-9c23996d80d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.191785 Sep 02 09:35:14.439799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 144/285] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:15.436862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9070f855-7849-44e3-8a57-aabda5314f09 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:15.437476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9070f855-7849-44e3-8a57-aabda5314f09 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:15.444992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9070f855-7849-44e3-8a57-aabda5314f09 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:15.445521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9070f855-7849-44e3-8a57-aabda5314f09 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:15.446634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9070f855-7849-44e3-8a57-aabda5314f09 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:15.447630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9070f855-7849-44e3-8a57-aabda5314f09 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:15.448242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9070f855-7849-44e3-8a57-aabda5314f09 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:15.448991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9070f855-7849-44e3-8a57-aabda5314f09 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:15.471519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9f2fd49c-1e79-4df8-9192-4ce6dc790ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:15.472167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9f2fd49c-1e79-4df8-9192-4ce6dc790ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:15.478777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f2fd49c-1e79-4df8-9192-4ce6dc790ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:15.479264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f2fd49c-1e79-4df8-9192-4ce6dc790ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:15.479703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f2fd49c-1e79-4df8-9192-4ce6dc790ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:15.480392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f2fd49c-1e79-4df8-9192-4ce6dc790ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:15.480917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f2fd49c-1e79-4df8-9192-4ce6dc790ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:15.481347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f2fd49c-1e79-4df8-9192-4ce6dc790ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:15.596025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9070f855-7849-44e3-8a57-aabda5314f09 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:15.604392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9070f855-7849-44e3-8a57-aabda5314f09 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.173141 Sep 02 09:35:15.605037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 142/286] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:15 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:15.620731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9f2fd49c-1e79-4df8-9192-4ce6dc790ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:15.628570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9f2fd49c-1e79-4df8-9192-4ce6dc790ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.161533 Sep 02 09:35:15.629114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 145/287] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:16.625910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0c79e690-656d-46d8-a4e0-a800cff1bae0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:16.626520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0c79e690-656d-46d8-a4e0-a800cff1bae0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:16.632385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c79e690-656d-46d8-a4e0-a800cff1bae0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:16.633390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c79e690-656d-46d8-a4e0-a800cff1bae0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:16.633832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c79e690-656d-46d8-a4e0-a800cff1bae0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:16.634512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c79e690-656d-46d8-a4e0-a800cff1bae0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:16.635009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c79e690-656d-46d8-a4e0-a800cff1bae0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:16.635590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c79e690-656d-46d8-a4e0-a800cff1bae0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:16.649628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dc05b711-b466-475d-857e-75671a724a5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:16.650366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dc05b711-b466-475d-857e-75671a724a5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:16.658062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc05b711-b466-475d-857e-75671a724a5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:16.658547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc05b711-b466-475d-857e-75671a724a5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:16.659022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc05b711-b466-475d-857e-75671a724a5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:16.669699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc05b711-b466-475d-857e-75671a724a5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:16.669699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc05b711-b466-475d-857e-75671a724a5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:16.669699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc05b711-b466-475d-857e-75671a724a5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:16.776693 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0c79e690-656d-46d8-a4e0-a800cff1bae0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:16.785352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0c79e690-656d-46d8-a4e0-a800cff1bae0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.163514 Sep 02 09:35:16.786161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 143/288] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:16 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:16.802323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dc05b711-b466-475d-857e-75671a724a5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:16.810654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dc05b711-b466-475d-857e-75671a724a5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.165510 Sep 02 09:35:16.811243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 146/289] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:17.805492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4ba8dbef-5f82-4595-9196-534841bb6ce7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:17.806006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4ba8dbef-5f82-4595-9196-534841bb6ce7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:17.808091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:17.812682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ba8dbef-5f82-4595-9196-534841bb6ce7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:17.813157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ba8dbef-5f82-4595-9196-534841bb6ce7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:17.813581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ba8dbef-5f82-4595-9196-534841bb6ce7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:17.814256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ba8dbef-5f82-4595-9196-534841bb6ce7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:17.814720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ba8dbef-5f82-4595-9196-534841bb6ce7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:17.815141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ba8dbef-5f82-4595-9196-534841bb6ce7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:17.836498 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f962cd5c-8cca-4909-a93b-fb6fed27da00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:17.837254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f962cd5c-8cca-4909-a93b-fb6fed27da00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:17.843361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f962cd5c-8cca-4909-a93b-fb6fed27da00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:17.844071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f962cd5c-8cca-4909-a93b-fb6fed27da00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:17.844508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f962cd5c-8cca-4909-a93b-fb6fed27da00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:17.845213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f962cd5c-8cca-4909-a93b-fb6fed27da00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:17.845668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f962cd5c-8cca-4909-a93b-fb6fed27da00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:17.846093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f962cd5c-8cca-4909-a93b-fb6fed27da00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:17.955538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4ba8dbef-5f82-4595-9196-534841bb6ce7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:17.963859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4ba8dbef-5f82-4595-9196-534841bb6ce7 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.162331 Sep 02 09:35:17.964421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 144/290] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:17 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:17.981216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f962cd5c-8cca-4909-a93b-fb6fed27da00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:17.989057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f962cd5c-8cca-4909-a93b-fb6fed27da00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.156811 Sep 02 09:35:17.989965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 147/291] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:18.988876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-50cea391-26a1-4764-8481-83b4d25f8cef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:18.989476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-50cea391-26a1-4764-8481-83b4d25f8cef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:18.996122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50cea391-26a1-4764-8481-83b4d25f8cef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:18.996598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50cea391-26a1-4764-8481-83b4d25f8cef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:18.997289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50cea391-26a1-4764-8481-83b4d25f8cef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:18.997965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50cea391-26a1-4764-8481-83b4d25f8cef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:18.998413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50cea391-26a1-4764-8481-83b4d25f8cef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:18.998853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50cea391-26a1-4764-8481-83b4d25f8cef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:19.013177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-62527a77-b570-4817-a78d-c1f4aeaeeb9d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:19.013878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-62527a77-b570-4817-a78d-c1f4aeaeeb9d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:19.016325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:19.020879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62527a77-b570-4817-a78d-c1f4aeaeeb9d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:19.021364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62527a77-b570-4817-a78d-c1f4aeaeeb9d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:19.021803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62527a77-b570-4817-a78d-c1f4aeaeeb9d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:19.022490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62527a77-b570-4817-a78d-c1f4aeaeeb9d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:19.022969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62527a77-b570-4817-a78d-c1f4aeaeeb9d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:19.023900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62527a77-b570-4817-a78d-c1f4aeaeeb9d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:19.131344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-50cea391-26a1-4764-8481-83b4d25f8cef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:19.139281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-50cea391-26a1-4764-8481-83b4d25f8cef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.154264 Sep 02 09:35:19.139749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 145/292] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:18 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:19.157777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-62527a77-b570-4817-a78d-c1f4aeaeeb9d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:19.166152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-62527a77-b570-4817-a78d-c1f4aeaeeb9d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.156769 Sep 02 09:35:19.166734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 148/293] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:20.160681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0101e9d8-f900-4c06-a8d4-68206eb1a146 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:20.161297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0101e9d8-f900-4c06-a8d4-68206eb1a146 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:20.167936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0101e9d8-f900-4c06-a8d4-68206eb1a146 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:20.168422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0101e9d8-f900-4c06-a8d4-68206eb1a146 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:20.168856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0101e9d8-f900-4c06-a8d4-68206eb1a146 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:20.169544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0101e9d8-f900-4c06-a8d4-68206eb1a146 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:20.170000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0101e9d8-f900-4c06-a8d4-68206eb1a146 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:20.170425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0101e9d8-f900-4c06-a8d4-68206eb1a146 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:20.186754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-44d28424-ecfd-4a5d-80e7-bd9e9f325b5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:20.187359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-44d28424-ecfd-4a5d-80e7-bd9e9f325b5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:20.193608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44d28424-ecfd-4a5d-80e7-bd9e9f325b5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:20.197722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44d28424-ecfd-4a5d-80e7-bd9e9f325b5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:20.197722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44d28424-ecfd-4a5d-80e7-bd9e9f325b5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:20.197722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44d28424-ecfd-4a5d-80e7-bd9e9f325b5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:20.197722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44d28424-ecfd-4a5d-80e7-bd9e9f325b5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:20.198110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44d28424-ecfd-4a5d-80e7-bd9e9f325b5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:20.320244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0101e9d8-f900-4c06-a8d4-68206eb1a146 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:20.326754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0101e9d8-f900-4c06-a8d4-68206eb1a146 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.170228 Sep 02 09:35:20.327327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 146/294] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:20 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:20.345403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-44d28424-ecfd-4a5d-80e7-bd9e9f325b5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:20.353482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-44d28424-ecfd-4a5d-80e7-bd9e9f325b5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.170712 Sep 02 09:35:20.354039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 149/295] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:21.346369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dca5fb1e-0440-4aee-a901-4a5c66c72b0c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:21.346992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dca5fb1e-0440-4aee-a901-4a5c66c72b0c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:21.353264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dca5fb1e-0440-4aee-a901-4a5c66c72b0c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:21.353752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dca5fb1e-0440-4aee-a901-4a5c66c72b0c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:21.354187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dca5fb1e-0440-4aee-a901-4a5c66c72b0c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:21.354907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dca5fb1e-0440-4aee-a901-4a5c66c72b0c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:21.355366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dca5fb1e-0440-4aee-a901-4a5c66c72b0c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:21.355794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dca5fb1e-0440-4aee-a901-4a5c66c72b0c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:21.375099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c2cff529-8ac0-4001-93ff-fa405b2d9419 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:21.384141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c2cff529-8ac0-4001-93ff-fa405b2d9419 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:21.384141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c2cff529-8ac0-4001-93ff-fa405b2d9419 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:21.384141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c2cff529-8ac0-4001-93ff-fa405b2d9419 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:21.384422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c2cff529-8ac0-4001-93ff-fa405b2d9419 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:21.385090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c2cff529-8ac0-4001-93ff-fa405b2d9419 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:21.385539 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c2cff529-8ac0-4001-93ff-fa405b2d9419 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:21.385959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c2cff529-8ac0-4001-93ff-fa405b2d9419 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:21.499239 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dca5fb1e-0440-4aee-a901-4a5c66c72b0c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:21.507176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dca5fb1e-0440-4aee-a901-4a5c66c72b0c tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.164482 Sep 02 09:35:21.508436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 147/296] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:21 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:21.529873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c2cff529-8ac0-4001-93ff-fa405b2d9419 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:21.532463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c2cff529-8ac0-4001-93ff-fa405b2d9419 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.162169 Sep 02 09:35:21.533040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 150/297] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:22.529217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c7c30475-f88b-4c08-99f7-f7caea107141 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:22.529826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c7c30475-f88b-4c08-99f7-f7caea107141 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:22.535801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c30475-f88b-4c08-99f7-f7caea107141 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:22.536279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c30475-f88b-4c08-99f7-f7caea107141 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:22.536709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c30475-f88b-4c08-99f7-f7caea107141 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:22.537392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c30475-f88b-4c08-99f7-f7caea107141 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:22.537845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c30475-f88b-4c08-99f7-f7caea107141 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:22.538266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c30475-f88b-4c08-99f7-f7caea107141 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:22.553235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-264562ab-03fb-4504-9070-a4bdda2638cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:22.553849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-264562ab-03fb-4504-9070-a4bdda2638cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:22.560222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-264562ab-03fb-4504-9070-a4bdda2638cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:22.560712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-264562ab-03fb-4504-9070-a4bdda2638cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:22.561146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-264562ab-03fb-4504-9070-a4bdda2638cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:22.561834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-264562ab-03fb-4504-9070-a4bdda2638cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:22.562288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-264562ab-03fb-4504-9070-a4bdda2638cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:22.562733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-264562ab-03fb-4504-9070-a4bdda2638cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:22.671127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c7c30475-f88b-4c08-99f7-f7caea107141 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:22.678745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c7c30475-f88b-4c08-99f7-f7caea107141 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.153382 Sep 02 09:35:22.679361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 148/298] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:22 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:22.694280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-264562ab-03fb-4504-9070-a4bdda2638cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:22.702453 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-264562ab-03fb-4504-9070-a4bdda2638cf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.153048 Sep 02 09:35:22.703029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 151/299] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:23.699996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9e25f089-a47f-4951-bb59-1e14e998dcca tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:23.700601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9e25f089-a47f-4951-bb59-1e14e998dcca tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:23.706431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e25f089-a47f-4951-bb59-1e14e998dcca tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:23.706956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e25f089-a47f-4951-bb59-1e14e998dcca tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:23.707390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e25f089-a47f-4951-bb59-1e14e998dcca tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:23.708074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e25f089-a47f-4951-bb59-1e14e998dcca tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:23.708535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e25f089-a47f-4951-bb59-1e14e998dcca tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:23.708967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e25f089-a47f-4951-bb59-1e14e998dcca tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:23.724893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dd839a4d-301c-49fc-9d2e-a7c12bfcea5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:23.725499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dd839a4d-301c-49fc-9d2e-a7c12bfcea5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:23.732212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd839a4d-301c-49fc-9d2e-a7c12bfcea5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:23.732692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd839a4d-301c-49fc-9d2e-a7c12bfcea5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:23.733124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd839a4d-301c-49fc-9d2e-a7c12bfcea5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:23.733806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd839a4d-301c-49fc-9d2e-a7c12bfcea5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:23.734255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd839a4d-301c-49fc-9d2e-a7c12bfcea5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:23.734672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd839a4d-301c-49fc-9d2e-a7c12bfcea5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:23.837029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e25f089-a47f-4951-bb59-1e14e998dcca tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:23.844998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9e25f089-a47f-4951-bb59-1e14e998dcca tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.148805 Sep 02 09:35:23.845566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 149/300] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:23 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:23.871174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dd839a4d-301c-49fc-9d2e-a7c12bfcea5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:23.879379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dd839a4d-301c-49fc-9d2e-a7c12bfcea5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.158312 Sep 02 09:35:23.879935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 152/301] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:24.866697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-28ce42bf-06b6-4cb2-b698-0ce0478afc78 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:24.867351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-28ce42bf-06b6-4cb2-b698-0ce0478afc78 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:24.873694 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28ce42bf-06b6-4cb2-b698-0ce0478afc78 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:24.874170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28ce42bf-06b6-4cb2-b698-0ce0478afc78 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:24.874600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28ce42bf-06b6-4cb2-b698-0ce0478afc78 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:24.875301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28ce42bf-06b6-4cb2-b698-0ce0478afc78 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:24.875804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28ce42bf-06b6-4cb2-b698-0ce0478afc78 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:24.876218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28ce42bf-06b6-4cb2-b698-0ce0478afc78 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:24.900917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-de03646f-a498-4878-ad35-f03d5c35b777 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:24.902609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-de03646f-a498-4878-ad35-f03d5c35b777 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:24.908109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de03646f-a498-4878-ad35-f03d5c35b777 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:24.908592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de03646f-a498-4878-ad35-f03d5c35b777 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:24.909028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de03646f-a498-4878-ad35-f03d5c35b777 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:24.909778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de03646f-a498-4878-ad35-f03d5c35b777 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:24.910197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de03646f-a498-4878-ad35-f03d5c35b777 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:24.910619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de03646f-a498-4878-ad35-f03d5c35b777 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:25.016306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-28ce42bf-06b6-4cb2-b698-0ce0478afc78 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:25.024336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-28ce42bf-06b6-4cb2-b698-0ce0478afc78 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.161574 Sep 02 09:35:25.024900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 150/302] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:24 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:25.045709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-de03646f-a498-4878-ad35-f03d5c35b777 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:25.053231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-de03646f-a498-4878-ad35-f03d5c35b777 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.156915 Sep 02 09:35:25.053798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 153/303] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:26.045258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8213fb89-ebb5-46bc-ba90-ee7737c52323 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:26.045866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8213fb89-ebb5-46bc-ba90-ee7737c52323 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:26.051800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8213fb89-ebb5-46bc-ba90-ee7737c52323 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:26.052285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8213fb89-ebb5-46bc-ba90-ee7737c52323 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:26.052726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8213fb89-ebb5-46bc-ba90-ee7737c52323 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:26.053408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8213fb89-ebb5-46bc-ba90-ee7737c52323 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:26.053863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8213fb89-ebb5-46bc-ba90-ee7737c52323 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:26.054285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8213fb89-ebb5-46bc-ba90-ee7737c52323 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:26.073894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-148cebac-1e91-4b15-936a-c7304337b9d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:26.074496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-148cebac-1e91-4b15-936a-c7304337b9d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:26.080830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-148cebac-1e91-4b15-936a-c7304337b9d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:26.081313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-148cebac-1e91-4b15-936a-c7304337b9d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:26.081742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-148cebac-1e91-4b15-936a-c7304337b9d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:26.082421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-148cebac-1e91-4b15-936a-c7304337b9d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:26.082903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-148cebac-1e91-4b15-936a-c7304337b9d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:26.083323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-148cebac-1e91-4b15-936a-c7304337b9d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:26.179908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8213fb89-ebb5-46bc-ba90-ee7737c52323 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:26.188453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8213fb89-ebb5-46bc-ba90-ee7737c52323 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.146977 Sep 02 09:35:26.189032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 151/304] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:26 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:26.216507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-148cebac-1e91-4b15-936a-c7304337b9d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:26.224111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-148cebac-1e91-4b15-936a-c7304337b9d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.154010 Sep 02 09:35:26.224657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 154/305] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:26 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:27.214017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3f072913-f6cf-4ac2-90ec-71ea78dc6472 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:27.214622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3f072913-f6cf-4ac2-90ec-71ea78dc6472 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:27.220790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f072913-f6cf-4ac2-90ec-71ea78dc6472 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:27.221273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f072913-f6cf-4ac2-90ec-71ea78dc6472 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:27.221701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f072913-f6cf-4ac2-90ec-71ea78dc6472 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:27.222377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f072913-f6cf-4ac2-90ec-71ea78dc6472 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:27.222855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f072913-f6cf-4ac2-90ec-71ea78dc6472 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:27.223275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f072913-f6cf-4ac2-90ec-71ea78dc6472 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:27.247373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-12623764-00da-46fd-9220-6da0ec3d8066 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:27.248460 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-12623764-00da-46fd-9220-6da0ec3d8066 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:27.255089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12623764-00da-46fd-9220-6da0ec3d8066 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:27.255582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12623764-00da-46fd-9220-6da0ec3d8066 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:27.256020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12623764-00da-46fd-9220-6da0ec3d8066 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:27.256714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12623764-00da-46fd-9220-6da0ec3d8066 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:27.257173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12623764-00da-46fd-9220-6da0ec3d8066 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:27.257595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12623764-00da-46fd-9220-6da0ec3d8066 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:27.357857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3f072913-f6cf-4ac2-90ec-71ea78dc6472 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:27.365763 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3f072913-f6cf-4ac2-90ec-71ea78dc6472 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.155579 Sep 02 09:35:27.366533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 152/306] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:27 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:27.388365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-12623764-00da-46fd-9220-6da0ec3d8066 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:27.399051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-12623764-00da-46fd-9220-6da0ec3d8066 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.154463 Sep 02 09:35:27.399051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 155/307] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:28.387745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-45fd1be5-70d3-46de-be7b-6383ae82ced1 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:28.388257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-45fd1be5-70d3-46de-be7b-6383ae82ced1 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:28.394728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45fd1be5-70d3-46de-be7b-6383ae82ced1 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:28.395244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45fd1be5-70d3-46de-be7b-6383ae82ced1 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:28.395692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45fd1be5-70d3-46de-be7b-6383ae82ced1 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:28.396374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45fd1be5-70d3-46de-be7b-6383ae82ced1 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:28.396854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45fd1be5-70d3-46de-be7b-6383ae82ced1 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:28.397297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45fd1be5-70d3-46de-be7b-6383ae82ced1 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:28.422723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-af94e720-0d00-4ca2-b16e-aded31e6e958 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:28.423352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-af94e720-0d00-4ca2-b16e-aded31e6e958 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:28.429491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af94e720-0d00-4ca2-b16e-aded31e6e958 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:28.429974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af94e720-0d00-4ca2-b16e-aded31e6e958 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:28.430410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af94e720-0d00-4ca2-b16e-aded31e6e958 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:28.431127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af94e720-0d00-4ca2-b16e-aded31e6e958 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:28.431718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af94e720-0d00-4ca2-b16e-aded31e6e958 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:28.432722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af94e720-0d00-4ca2-b16e-aded31e6e958 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:28.531623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-45fd1be5-70d3-46de-be7b-6383ae82ced1 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:28.539654 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-45fd1be5-70d3-46de-be7b-6383ae82ced1 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.156016 Sep 02 09:35:28.540222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 153/308] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:28 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:28.564044 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-af94e720-0d00-4ca2-b16e-aded31e6e958 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:28.571761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-af94e720-0d00-4ca2-b16e-aded31e6e958 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.153570 Sep 02 09:35:28.572351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 156/309] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:29.561522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9ea379a5-629d-4685-a5f5-f252e081ad17 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:29.562122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9ea379a5-629d-4685-a5f5-f252e081ad17 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:29.568106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ea379a5-629d-4685-a5f5-f252e081ad17 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:29.568582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ea379a5-629d-4685-a5f5-f252e081ad17 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:29.569008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ea379a5-629d-4685-a5f5-f252e081ad17 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:29.569692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ea379a5-629d-4685-a5f5-f252e081ad17 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:29.570146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ea379a5-629d-4685-a5f5-f252e081ad17 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:29.570556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ea379a5-629d-4685-a5f5-f252e081ad17 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:29.593358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-458b9132-27eb-4533-bb01-ae2ea07969d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:29.594059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-458b9132-27eb-4533-bb01-ae2ea07969d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:29.600780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-458b9132-27eb-4533-bb01-ae2ea07969d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:29.601249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-458b9132-27eb-4533-bb01-ae2ea07969d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:29.601681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-458b9132-27eb-4533-bb01-ae2ea07969d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:29.602370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-458b9132-27eb-4533-bb01-ae2ea07969d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:29.602854 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-458b9132-27eb-4533-bb01-ae2ea07969d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:29.603279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-458b9132-27eb-4533-bb01-ae2ea07969d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:29.715611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9ea379a5-629d-4685-a5f5-f252e081ad17 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:29.723877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9ea379a5-629d-4685-a5f5-f252e081ad17 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.166934 Sep 02 09:35:29.735254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 154/310] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:29 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:29.754983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-458b9132-27eb-4533-bb01-ae2ea07969d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:29.760639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-458b9132-27eb-4533-bb01-ae2ea07969d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.170784 Sep 02 09:35:29.761204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 157/311] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:30.745081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d930d15b-b264-4535-bb10-5c13e7d05209 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:30.745625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d930d15b-b264-4535-bb10-5c13e7d05209 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:30.751834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d930d15b-b264-4535-bb10-5c13e7d05209 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:30.752314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d930d15b-b264-4535-bb10-5c13e7d05209 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:30.752748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d930d15b-b264-4535-bb10-5c13e7d05209 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:30.753425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d930d15b-b264-4535-bb10-5c13e7d05209 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:30.753878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d930d15b-b264-4535-bb10-5c13e7d05209 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:30.754300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d930d15b-b264-4535-bb10-5c13e7d05209 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:30.782120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-055babb7-7869-4426-a137-01426f900203 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:30.782942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-055babb7-7869-4426-a137-01426f900203 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:30.799975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-055babb7-7869-4426-a137-01426f900203 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:30.800664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-055babb7-7869-4426-a137-01426f900203 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:30.801041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-055babb7-7869-4426-a137-01426f900203 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:30.801738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-055babb7-7869-4426-a137-01426f900203 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:30.802188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-055babb7-7869-4426-a137-01426f900203 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:30.802611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-055babb7-7869-4426-a137-01426f900203 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:30.921875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d930d15b-b264-4535-bb10-5c13e7d05209 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:30.930773 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d930d15b-b264-4535-bb10-5c13e7d05209 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.189571 Sep 02 09:35:30.945349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 155/312] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:30 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:30.955846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-055babb7-7869-4426-a137-01426f900203 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:30.963980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-055babb7-7869-4426-a137-01426f900203 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.186318 Sep 02 09:35:30.964565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 158/313] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:31.812290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-76e146c1-ebbf-45f1-8ae5-755ab5c338d2 req-728ee164-e840-4659-8709-f2f1f017c400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bccc75-d837-4a98-8a78-841b2edb8ce5", "name": "network-vif-plugged", "status": "completed", "tag": "72e00e01-0226-481d-9c3e-f109d75f21d1"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:35:31.822132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-76e146c1-ebbf-45f1-8ae5-755ab5c338d2 req-728ee164-e840-4659-8709-f2f1f017c400 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:31.822610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-76e146c1-ebbf-45f1-8ae5-755ab5c338d2 req-728ee164-e840-4659-8709-f2f1f017c400 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:31.823742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-76e146c1-ebbf-45f1-8ae5-755ab5c338d2 req-728ee164-e840-4659-8709-f2f1f017c400 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:31.834648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-76e146c1-ebbf-45f1-8ae5-755ab5c338d2 req-728ee164-e840-4659-8709-f2f1f017c400 service nova] Creating event network-vif-plugged:72e00e01-0226-481d-9c3e-f109d75f21d1 for instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 on hv-cinder-85083 Sep 02 09:35:31.839555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-76e146c1-ebbf-45f1-8ae5-755ab5c338d2 req-728ee164-e840-4659-8709-f2f1f017c400 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031102 Sep 02 09:35:31.840523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 156/314] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:35:31.953526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e42dfaa3-881a-4b83-b6a5-1158c9e5c8e5 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:31.954135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e42dfaa3-881a-4b83-b6a5-1158c9e5c8e5 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:31.961998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e42dfaa3-881a-4b83-b6a5-1158c9e5c8e5 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:31.962494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e42dfaa3-881a-4b83-b6a5-1158c9e5c8e5 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:31.963019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e42dfaa3-881a-4b83-b6a5-1158c9e5c8e5 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:31.963757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e42dfaa3-881a-4b83-b6a5-1158c9e5c8e5 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:31.964210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e42dfaa3-881a-4b83-b6a5-1158c9e5c8e5 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:31.964630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e42dfaa3-881a-4b83-b6a5-1158c9e5c8e5 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:31.988913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-18ca6dc2-9123-4f4b-88a0-dd9a4bc520e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:31.989790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-18ca6dc2-9123-4f4b-88a0-dd9a4bc520e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:31.997318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18ca6dc2-9123-4f4b-88a0-dd9a4bc520e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:31.997933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18ca6dc2-9123-4f4b-88a0-dd9a4bc520e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:31.998595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18ca6dc2-9123-4f4b-88a0-dd9a4bc520e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:31.999477 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18ca6dc2-9123-4f4b-88a0-dd9a4bc520e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:31.999942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18ca6dc2-9123-4f4b-88a0-dd9a4bc520e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:32.000416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18ca6dc2-9123-4f4b-88a0-dd9a4bc520e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:32.107696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e42dfaa3-881a-4b83-b6a5-1158c9e5c8e5 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:32.116219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e42dfaa3-881a-4b83-b6a5-1158c9e5c8e5 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.166833 Sep 02 09:35:32.116813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 159/315] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:31 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:32.146674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-18ca6dc2-9123-4f4b-88a0-dd9a4bc520e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:32.149164 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:32.155563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-18ca6dc2-9123-4f4b-88a0-dd9a4bc520e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.171501 Sep 02 09:35:32.161957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 157/316] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:33.137471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ac3bb352-c558-4a9d-9702-8644a0006824 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:33.138090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ac3bb352-c558-4a9d-9702-8644a0006824 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:33.144526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac3bb352-c558-4a9d-9702-8644a0006824 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:33.145016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac3bb352-c558-4a9d-9702-8644a0006824 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:33.145459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac3bb352-c558-4a9d-9702-8644a0006824 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:33.146150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac3bb352-c558-4a9d-9702-8644a0006824 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:33.146608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac3bb352-c558-4a9d-9702-8644a0006824 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:33.147064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac3bb352-c558-4a9d-9702-8644a0006824 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:33.181302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cd7a210c-eaf4-4756-a156-f6acb6583abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:33.182072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cd7a210c-eaf4-4756-a156-f6acb6583abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:33.188985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd7a210c-eaf4-4756-a156-f6acb6583abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:33.189737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd7a210c-eaf4-4756-a156-f6acb6583abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:33.190176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd7a210c-eaf4-4756-a156-f6acb6583abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:33.190899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd7a210c-eaf4-4756-a156-f6acb6583abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:33.191520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd7a210c-eaf4-4756-a156-f6acb6583abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:33.191946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd7a210c-eaf4-4756-a156-f6acb6583abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:33.282437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ac3bb352-c558-4a9d-9702-8644a0006824 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:33.284699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:33.292771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ac3bb352-c558-4a9d-9702-8644a0006824 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.159513 Sep 02 09:35:33.297312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 160/317] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:33 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:33.335093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cd7a210c-eaf4-4756-a156-f6acb6583abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:33.342755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cd7a210c-eaf4-4756-a156-f6acb6583abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.165198 Sep 02 09:35:33.343297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 158/318] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:34.314727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4eab2d6b-1181-490c-a378-3b7e39542376 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:34.315346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4eab2d6b-1181-490c-a378-3b7e39542376 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:34.321870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4eab2d6b-1181-490c-a378-3b7e39542376 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:34.322347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4eab2d6b-1181-490c-a378-3b7e39542376 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:34.322808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4eab2d6b-1181-490c-a378-3b7e39542376 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:34.323501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4eab2d6b-1181-490c-a378-3b7e39542376 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:34.323952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4eab2d6b-1181-490c-a378-3b7e39542376 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:34.324373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4eab2d6b-1181-490c-a378-3b7e39542376 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:34.363412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-325a37b8-cf21-4135-8ad8-0ba13710350f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:34.364023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-325a37b8-cf21-4135-8ad8-0ba13710350f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:34.370571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-325a37b8-cf21-4135-8ad8-0ba13710350f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:34.371342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-325a37b8-cf21-4135-8ad8-0ba13710350f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:34.371785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-325a37b8-cf21-4135-8ad8-0ba13710350f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:34.372476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-325a37b8-cf21-4135-8ad8-0ba13710350f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:34.373583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-325a37b8-cf21-4135-8ad8-0ba13710350f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:34.374027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-325a37b8-cf21-4135-8ad8-0ba13710350f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:34.464172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4eab2d6b-1181-490c-a378-3b7e39542376 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:34.471809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4eab2d6b-1181-490c-a378-3b7e39542376 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.161160 Sep 02 09:35:34.472493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 161/319] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:34 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:34.506301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-325a37b8-cf21-4135-8ad8-0ba13710350f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:34.514131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-325a37b8-cf21-4135-8ad8-0ba13710350f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.154694 Sep 02 09:35:34.514830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 159/320] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:35.493044 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-272d217f-7480-4c46-9660-67767ccb67fc tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:35.493620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-272d217f-7480-4c46-9660-67767ccb67fc tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:35.500847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-272d217f-7480-4c46-9660-67767ccb67fc tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:35.501353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-272d217f-7480-4c46-9660-67767ccb67fc tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:35.501778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-272d217f-7480-4c46-9660-67767ccb67fc tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:35.502462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-272d217f-7480-4c46-9660-67767ccb67fc tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:35.502955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-272d217f-7480-4c46-9660-67767ccb67fc tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:35.503386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-272d217f-7480-4c46-9660-67767ccb67fc tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:35.534024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c29ba480-6d05-4681-98f6-8ef15d6d5a03 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:35.534625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c29ba480-6d05-4681-98f6-8ef15d6d5a03 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:35.540925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c29ba480-6d05-4681-98f6-8ef15d6d5a03 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:35.541395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c29ba480-6d05-4681-98f6-8ef15d6d5a03 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:35.541798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c29ba480-6d05-4681-98f6-8ef15d6d5a03 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:35.542489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c29ba480-6d05-4681-98f6-8ef15d6d5a03 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:35.542967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c29ba480-6d05-4681-98f6-8ef15d6d5a03 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:35.546642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c29ba480-6d05-4681-98f6-8ef15d6d5a03 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:35.632141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-272d217f-7480-4c46-9660-67767ccb67fc tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:35.640413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-272d217f-7480-4c46-9660-67767ccb67fc tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.151367 Sep 02 09:35:35.640988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 162/321] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:35 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:35.677580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c29ba480-6d05-4681-98f6-8ef15d6d5a03 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:35.686143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c29ba480-6d05-4681-98f6-8ef15d6d5a03 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.155936 Sep 02 09:35:35.686985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 160/322] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:36.661179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-94ec70b5-3bf9-4222-a22b-47145659ef89 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:36.661789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-94ec70b5-3bf9-4222-a22b-47145659ef89 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:36.668413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94ec70b5-3bf9-4222-a22b-47145659ef89 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:36.669510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94ec70b5-3bf9-4222-a22b-47145659ef89 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:36.669935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94ec70b5-3bf9-4222-a22b-47145659ef89 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:36.670617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94ec70b5-3bf9-4222-a22b-47145659ef89 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:36.671102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94ec70b5-3bf9-4222-a22b-47145659ef89 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:36.671529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94ec70b5-3bf9-4222-a22b-47145659ef89 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:36.707888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ef03d0cd-cb2a-4dd9-91f0-9c52431f818a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:36.708614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ef03d0cd-cb2a-4dd9-91f0-9c52431f818a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:36.718369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef03d0cd-cb2a-4dd9-91f0-9c52431f818a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:36.719584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef03d0cd-cb2a-4dd9-91f0-9c52431f818a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:36.720190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef03d0cd-cb2a-4dd9-91f0-9c52431f818a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:36.721447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef03d0cd-cb2a-4dd9-91f0-9c52431f818a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:36.723722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef03d0cd-cb2a-4dd9-91f0-9c52431f818a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:36.724393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef03d0cd-cb2a-4dd9-91f0-9c52431f818a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:36.812046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-94ec70b5-3bf9-4222-a22b-47145659ef89 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:36.820085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-94ec70b5-3bf9-4222-a22b-47145659ef89 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.162742 Sep 02 09:35:36.820592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 163/323] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:36 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:36.859490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ef03d0cd-cb2a-4dd9-91f0-9c52431f818a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:36.867026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ef03d0cd-cb2a-4dd9-91f0-9c52431f818a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.162961 Sep 02 09:35:36.867589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 161/324] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:37.840960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8a651666-bc36-43cc-b99b-dcee0980baa6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:37.841684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8a651666-bc36-43cc-b99b-dcee0980baa6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:37.848129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a651666-bc36-43cc-b99b-dcee0980baa6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:37.848615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a651666-bc36-43cc-b99b-dcee0980baa6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:37.849047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a651666-bc36-43cc-b99b-dcee0980baa6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:37.849765 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a651666-bc36-43cc-b99b-dcee0980baa6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:37.850214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a651666-bc36-43cc-b99b-dcee0980baa6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:37.850634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a651666-bc36-43cc-b99b-dcee0980baa6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:37.887626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e9dc9f56-9cef-4cc3-9720-f1fe37e2f341 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:37.888260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e9dc9f56-9cef-4cc3-9720-f1fe37e2f341 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:37.894263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9dc9f56-9cef-4cc3-9720-f1fe37e2f341 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:37.894777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9dc9f56-9cef-4cc3-9720-f1fe37e2f341 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:37.895215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9dc9f56-9cef-4cc3-9720-f1fe37e2f341 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:37.895917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9dc9f56-9cef-4cc3-9720-f1fe37e2f341 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:37.896371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9dc9f56-9cef-4cc3-9720-f1fe37e2f341 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:37.896795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9dc9f56-9cef-4cc3-9720-f1fe37e2f341 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:37.990788 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8a651666-bc36-43cc-b99b-dcee0980baa6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:37.998812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8a651666-bc36-43cc-b99b-dcee0980baa6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.161714 Sep 02 09:35:37.999382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 164/325] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:37 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:38.037935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e9dc9f56-9cef-4cc3-9720-f1fe37e2f341 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:38.046097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e9dc9f56-9cef-4cc3-9720-f1fe37e2f341 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.162280 Sep 02 09:35:38.046649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 162/326] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:39.019578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-749affc8-70e1-4176-90e9-ed9802c43d3d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:39.020101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-749affc8-70e1-4176-90e9-ed9802c43d3d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:39.026478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749affc8-70e1-4176-90e9-ed9802c43d3d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:39.026995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749affc8-70e1-4176-90e9-ed9802c43d3d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:39.027430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749affc8-70e1-4176-90e9-ed9802c43d3d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:39.028596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749affc8-70e1-4176-90e9-ed9802c43d3d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:39.029047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749affc8-70e1-4176-90e9-ed9802c43d3d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:39.029467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749affc8-70e1-4176-90e9-ed9802c43d3d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:39.066508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3197d98b-243a-4667-a83a-a4dfe41662ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:39.067256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3197d98b-243a-4667-a83a-a4dfe41662ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:39.073433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3197d98b-243a-4667-a83a-a4dfe41662ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:39.073996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3197d98b-243a-4667-a83a-a4dfe41662ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:39.074506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3197d98b-243a-4667-a83a-a4dfe41662ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:39.075384 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3197d98b-243a-4667-a83a-a4dfe41662ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:39.075944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3197d98b-243a-4667-a83a-a4dfe41662ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:39.076437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3197d98b-243a-4667-a83a-a4dfe41662ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:39.162920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-749affc8-70e1-4176-90e9-ed9802c43d3d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:39.171586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-749affc8-70e1-4176-90e9-ed9802c43d3d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.155692 Sep 02 09:35:39.172540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 165/327] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:39 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:39.220470 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3197d98b-243a-4667-a83a-a4dfe41662ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:39.228126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3197d98b-243a-4667-a83a-a4dfe41662ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.165508 Sep 02 09:35:39.228689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 163/328] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:40.194132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2b20832f-6f18-4877-b901-ca49c0e93aef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:40.194728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2b20832f-6f18-4877-b901-ca49c0e93aef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:40.201535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b20832f-6f18-4877-b901-ca49c0e93aef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:40.203623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b20832f-6f18-4877-b901-ca49c0e93aef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:40.203623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b20832f-6f18-4877-b901-ca49c0e93aef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:40.203623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b20832f-6f18-4877-b901-ca49c0e93aef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:40.203623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b20832f-6f18-4877-b901-ca49c0e93aef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:40.204105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b20832f-6f18-4877-b901-ca49c0e93aef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:40.249485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-34a1a4b7-0c94-4cce-a30d-2eef75265e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:40.250123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-34a1a4b7-0c94-4cce-a30d-2eef75265e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:40.256248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34a1a4b7-0c94-4cce-a30d-2eef75265e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:40.257129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34a1a4b7-0c94-4cce-a30d-2eef75265e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:40.257368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34a1a4b7-0c94-4cce-a30d-2eef75265e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:40.258153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34a1a4b7-0c94-4cce-a30d-2eef75265e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:40.258671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34a1a4b7-0c94-4cce-a30d-2eef75265e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:40.259297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34a1a4b7-0c94-4cce-a30d-2eef75265e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:40.340579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2b20832f-6f18-4877-b901-ca49c0e93aef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:40.348930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2b20832f-6f18-4877-b901-ca49c0e93aef tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.158576 Sep 02 09:35:40.349389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 166/329] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:40 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:40.389102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-34a1a4b7-0c94-4cce-a30d-2eef75265e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:40.397150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-34a1a4b7-0c94-4cce-a30d-2eef75265e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.152471 Sep 02 09:35:40.397703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 164/330] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:41.370024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d7c96082-37db-459b-adfa-7b1464a5bc5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:41.370921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d7c96082-37db-459b-adfa-7b1464a5bc5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:41.377258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7c96082-37db-459b-adfa-7b1464a5bc5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:41.377737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7c96082-37db-459b-adfa-7b1464a5bc5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:41.378169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7c96082-37db-459b-adfa-7b1464a5bc5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:41.378880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7c96082-37db-459b-adfa-7b1464a5bc5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:41.379330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7c96082-37db-459b-adfa-7b1464a5bc5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:41.379747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7c96082-37db-459b-adfa-7b1464a5bc5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:41.417786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e599ca9a-9c18-46aa-a442-003e619e7bb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:41.418569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e599ca9a-9c18-46aa-a442-003e619e7bb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:41.424536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e599ca9a-9c18-46aa-a442-003e619e7bb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:41.425018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e599ca9a-9c18-46aa-a442-003e619e7bb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:41.425448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e599ca9a-9c18-46aa-a442-003e619e7bb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:41.426135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e599ca9a-9c18-46aa-a442-003e619e7bb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:41.426585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e599ca9a-9c18-46aa-a442-003e619e7bb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:41.427030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e599ca9a-9c18-46aa-a442-003e619e7bb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:41.509900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d7c96082-37db-459b-adfa-7b1464a5bc5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:41.518570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d7c96082-37db-459b-adfa-7b1464a5bc5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.152678 Sep 02 09:35:41.519160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 167/331] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:41 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:41.782870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e599ca9a-9c18-46aa-a442-003e619e7bb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:41.790531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e599ca9a-9c18-46aa-a442-003e619e7bb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.376824 Sep 02 09:35:41.791124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 165/332] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:42.540050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4ffcc221-f1dc-4ee0-8bb4-baf4c9b3dfe8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:42.540638 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4ffcc221-f1dc-4ee0-8bb4-baf4c9b3dfe8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:42.547802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ffcc221-f1dc-4ee0-8bb4-baf4c9b3dfe8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:42.548278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ffcc221-f1dc-4ee0-8bb4-baf4c9b3dfe8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:42.548706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ffcc221-f1dc-4ee0-8bb4-baf4c9b3dfe8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:42.549379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ffcc221-f1dc-4ee0-8bb4-baf4c9b3dfe8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:42.549826 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ffcc221-f1dc-4ee0-8bb4-baf4c9b3dfe8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:42.550243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ffcc221-f1dc-4ee0-8bb4-baf4c9b3dfe8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:42.691597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4ffcc221-f1dc-4ee0-8bb4-baf4c9b3dfe8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:42.699253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4ffcc221-f1dc-4ee0-8bb4-baf4c9b3dfe8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.162984 Sep 02 09:35:42.699948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 168/333] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:42 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:42.811082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4fabdf1e-d5b5-4dac-a0c2-8cac0d21de1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:42.811619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4fabdf1e-d5b5-4dac-a0c2-8cac0d21de1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:42.817529 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fabdf1e-d5b5-4dac-a0c2-8cac0d21de1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:42.818008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fabdf1e-d5b5-4dac-a0c2-8cac0d21de1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:42.818441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fabdf1e-d5b5-4dac-a0c2-8cac0d21de1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:42.819142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fabdf1e-d5b5-4dac-a0c2-8cac0d21de1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:42.819590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fabdf1e-d5b5-4dac-a0c2-8cac0d21de1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:42.820008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fabdf1e-d5b5-4dac-a0c2-8cac0d21de1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:42.945249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4fabdf1e-d5b5-4dac-a0c2-8cac0d21de1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:42.953435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4fabdf1e-d5b5-4dac-a0c2-8cac0d21de1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.146298 Sep 02 09:35:42.953988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 166/334] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:43.719971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a8b51365-95cb-4ced-aceb-f8667fc57fd8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:43.720578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a8b51365-95cb-4ced-aceb-f8667fc57fd8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:43.727142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8b51365-95cb-4ced-aceb-f8667fc57fd8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:43.727624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8b51365-95cb-4ced-aceb-f8667fc57fd8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:43.728057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8b51365-95cb-4ced-aceb-f8667fc57fd8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:43.728739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8b51365-95cb-4ced-aceb-f8667fc57fd8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:43.729193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8b51365-95cb-4ced-aceb-f8667fc57fd8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:43.729617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8b51365-95cb-4ced-aceb-f8667fc57fd8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:43.861201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a8b51365-95cb-4ced-aceb-f8667fc57fd8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:43.868736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a8b51365-95cb-4ced-aceb-f8667fc57fd8 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.152612 Sep 02 09:35:43.869291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 169/335] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:43 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:43.974116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-db667aab-9644-4989-b2ab-33ac043c9335 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:43.974644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-db667aab-9644-4989-b2ab-33ac043c9335 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:43.980527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db667aab-9644-4989-b2ab-33ac043c9335 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:43.981011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db667aab-9644-4989-b2ab-33ac043c9335 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:43.981435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db667aab-9644-4989-b2ab-33ac043c9335 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:43.982105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db667aab-9644-4989-b2ab-33ac043c9335 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:43.983201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db667aab-9644-4989-b2ab-33ac043c9335 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:43.983628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db667aab-9644-4989-b2ab-33ac043c9335 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:44.122662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-db667aab-9644-4989-b2ab-33ac043c9335 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:44.139432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-db667aab-9644-4989-b2ab-33ac043c9335 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.169262 Sep 02 09:35:44.140014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 167/336] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:44.890559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ba1f98a8-ea81-4204-9974-bcc96ef6fb3b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:44.891192 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ba1f98a8-ea81-4204-9974-bcc96ef6fb3b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:44.897502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba1f98a8-ea81-4204-9974-bcc96ef6fb3b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:44.898004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba1f98a8-ea81-4204-9974-bcc96ef6fb3b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:44.898434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba1f98a8-ea81-4204-9974-bcc96ef6fb3b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:44.899137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba1f98a8-ea81-4204-9974-bcc96ef6fb3b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:44.899583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba1f98a8-ea81-4204-9974-bcc96ef6fb3b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:44.899999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba1f98a8-ea81-4204-9974-bcc96ef6fb3b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:45.028802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ba1f98a8-ea81-4204-9974-bcc96ef6fb3b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:45.036407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ba1f98a8-ea81-4204-9974-bcc96ef6fb3b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.150301 Sep 02 09:35:45.036971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 170/337] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:44 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:45.159868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3dd4da1c-6ca8-41d3-926c-4207280c66e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:45.160528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3dd4da1c-6ca8-41d3-926c-4207280c66e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:45.166349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dd4da1c-6ca8-41d3-926c-4207280c66e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:45.166860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dd4da1c-6ca8-41d3-926c-4207280c66e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:45.167287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dd4da1c-6ca8-41d3-926c-4207280c66e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:45.167962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dd4da1c-6ca8-41d3-926c-4207280c66e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:45.168411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dd4da1c-6ca8-41d3-926c-4207280c66e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:45.168828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dd4da1c-6ca8-41d3-926c-4207280c66e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:45.298641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3dd4da1c-6ca8-41d3-926c-4207280c66e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:45.306412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3dd4da1c-6ca8-41d3-926c-4207280c66e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.150381 Sep 02 09:35:45.311226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 168/338] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:46.057200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-215df539-d40d-4a79-bafa-d5b0d7570f04 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:46.057815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-215df539-d40d-4a79-bafa-d5b0d7570f04 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:46.064581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-215df539-d40d-4a79-bafa-d5b0d7570f04 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:46.065067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-215df539-d40d-4a79-bafa-d5b0d7570f04 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:46.065511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-215df539-d40d-4a79-bafa-d5b0d7570f04 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:46.066199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-215df539-d40d-4a79-bafa-d5b0d7570f04 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:46.066655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-215df539-d40d-4a79-bafa-d5b0d7570f04 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:46.067120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-215df539-d40d-4a79-bafa-d5b0d7570f04 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:46.201822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-215df539-d40d-4a79-bafa-d5b0d7570f04 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:46.203860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-215df539-d40d-4a79-bafa-d5b0d7570f04 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.150587 Sep 02 09:35:46.204421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 171/339] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:46 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:46.327831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-839d0fa2-c6ad-47a8-94df-dd4928629075 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:46.328992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-839d0fa2-c6ad-47a8-94df-dd4928629075 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:46.335013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-839d0fa2-c6ad-47a8-94df-dd4928629075 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:46.335489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-839d0fa2-c6ad-47a8-94df-dd4928629075 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:46.335918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-839d0fa2-c6ad-47a8-94df-dd4928629075 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:46.336589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-839d0fa2-c6ad-47a8-94df-dd4928629075 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:46.337054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-839d0fa2-c6ad-47a8-94df-dd4928629075 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:46.337454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-839d0fa2-c6ad-47a8-94df-dd4928629075 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:46.465578 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-839d0fa2-c6ad-47a8-94df-dd4928629075 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:46.473222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-839d0fa2-c6ad-47a8-94df-dd4928629075 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1371 microversion: 2.1 time: 0.149339 Sep 02 09:35:46.473791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 169/340] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:46.682244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-eba155ba-5a6b-42ff-83f6-2f7ce335bd2a req-bd2f5990-b687-43ee-bdee-65e21bf3b1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457", "name": "network-vif-plugged", "status": "completed", "tag": "7bbd8d11-dbdb-401b-926c-3b56f63aea2c"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:35:46.692373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-eba155ba-5a6b-42ff-83f6-2f7ce335bd2a req-bd2f5990-b687-43ee-bdee-65e21bf3b1d4 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:46.692848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-eba155ba-5a6b-42ff-83f6-2f7ce335bd2a req-bd2f5990-b687-43ee-bdee-65e21bf3b1d4 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:46.693278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-eba155ba-5a6b-42ff-83f6-2f7ce335bd2a req-bd2f5990-b687-43ee-bdee-65e21bf3b1d4 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:46.703860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-eba155ba-5a6b-42ff-83f6-2f7ce335bd2a req-bd2f5990-b687-43ee-bdee-65e21bf3b1d4 service nova] Creating event network-vif-plugged:7bbd8d11-dbdb-401b-926c-3b56f63aea2c for instance c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 on hv-cinder-85083 Sep 02 09:35:46.708762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-eba155ba-5a6b-42ff-83f6-2f7ce335bd2a req-bd2f5990-b687-43ee-bdee-65e21bf3b1d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030165 Sep 02 09:35:46.711477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 172/341] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:35:47.223935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4ae2eb19-e230-4a03-af86-470b652a048a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:47.224540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4ae2eb19-e230-4a03-af86-470b652a048a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:47.230582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ae2eb19-e230-4a03-af86-470b652a048a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:47.231098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ae2eb19-e230-4a03-af86-470b652a048a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:47.231534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ae2eb19-e230-4a03-af86-470b652a048a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:47.232849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ae2eb19-e230-4a03-af86-470b652a048a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:47.233303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ae2eb19-e230-4a03-af86-470b652a048a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:47.233727 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ae2eb19-e230-4a03-af86-470b652a048a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:47.362525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4ae2eb19-e230-4a03-af86-470b652a048a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:47.370149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4ae2eb19-e230-4a03-af86-470b652a048a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.150107 Sep 02 09:35:47.371003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 170/342] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:47 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:47.494458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-43dec96a-b10e-4a7d-b6c4-45b38b313a3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:47.495439 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-43dec96a-b10e-4a7d-b6c4-45b38b313a3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:47.501438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43dec96a-b10e-4a7d-b6c4-45b38b313a3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:47.501921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43dec96a-b10e-4a7d-b6c4-45b38b313a3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:47.502350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43dec96a-b10e-4a7d-b6c4-45b38b313a3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:47.503061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43dec96a-b10e-4a7d-b6c4-45b38b313a3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:47.503545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43dec96a-b10e-4a7d-b6c4-45b38b313a3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:47.503933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43dec96a-b10e-4a7d-b6c4-45b38b313a3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:47.644238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-43dec96a-b10e-4a7d-b6c4-45b38b313a3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:47.650563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-43dec96a-b10e-4a7d-b6c4-45b38b313a3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1565 microversion: 2.1 time: 0.160941 Sep 02 09:35:47.651220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 173/343] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:47.671415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-28754199-6c79-48a0-9a21-e7b1861a2b18 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:47.671900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-28754199-6c79-48a0-9a21-e7b1861a2b18 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:47.677689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28754199-6c79-48a0-9a21-e7b1861a2b18 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:47.678677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28754199-6c79-48a0-9a21-e7b1861a2b18 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:47.678677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28754199-6c79-48a0-9a21-e7b1861a2b18 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:47.679275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28754199-6c79-48a0-9a21-e7b1861a2b18 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:47.679720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28754199-6c79-48a0-9a21-e7b1861a2b18 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:47.680134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28754199-6c79-48a0-9a21-e7b1861a2b18 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:47.761032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-28754199-6c79-48a0-9a21-e7b1861a2b18 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093337 Sep 02 09:35:47.761612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 171/344] 10.222.0.57 () {58 vars in 1275 bytes} [Fri Sep 2 09:35:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:35:48.391922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ef60cfac-1a21-4b50-a9e1-1666967def84 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:48.392750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ef60cfac-1a21-4b50-a9e1-1666967def84 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:48.403004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef60cfac-1a21-4b50-a9e1-1666967def84 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:48.403818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef60cfac-1a21-4b50-a9e1-1666967def84 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:48.404482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef60cfac-1a21-4b50-a9e1-1666967def84 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:48.405428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef60cfac-1a21-4b50-a9e1-1666967def84 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:48.406106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef60cfac-1a21-4b50-a9e1-1666967def84 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:48.406811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef60cfac-1a21-4b50-a9e1-1666967def84 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:48.600558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-214906737", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-199031911", "security_groups": [{"name": "tempest-secgroup-smoke-659154806"}], "block_device_mapping_v2": [{"uuid": "7faac35b-b8fc-40cf-b908-62121a22e39f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11a779c0-ef30-4cee-9b8a-917c9d89c032"}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:35:48.754377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] validate_networks() for [('11a779c0-ef30-4cee-9b8a-917c9d89c032', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:35:48.829781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ef60cfac-1a21-4b50-a9e1-1666967def84 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:48.837712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ef60cfac-1a21-4b50-a9e1-1666967def84 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.450249 Sep 02 09:35:48.838841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 174/345] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:48 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:49.133483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:35:49.133907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:35:49.134376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:35:49.134808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:35:49.135218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:35:49.137337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=60 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:49.146734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:49.147268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:49.148123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:49.148680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:49.149142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:49.149578 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:49.167863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Getting quotas for project 2c5938d62e2d40969d096b66e14edd75. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:35:49.171967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Getting quotas for user d935a4a30e4d44e0a392596452a5c1b6 and project 2c5938d62e2d40969d096b66e14edd75. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:35:49.230205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:35:49.232457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7faac35b-b8fc-40cf-b908-62121a22e39f',volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:35:49.319081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-6d1b3a7e-9adf-48a5-9676-476c26753a58 req-ecd22ad7-2012-403e-bd92-af80fb1f440e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bccc75-d837-4a98-8a78-841b2edb8ce5", "tag": "72e00e01-0226-481d-9c3e-f109d75f21d1"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:35:49.324055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=54 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:49.329915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6d1b3a7e-9adf-48a5-9676-476c26753a58 req-ecd22ad7-2012-403e-bd92-af80fb1f440e service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:49.330392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6d1b3a7e-9adf-48a5-9676-476c26753a58 req-ecd22ad7-2012-403e-bd92-af80fb1f440e service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:49.330844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6d1b3a7e-9adf-48a5-9676-476c26753a58 req-ecd22ad7-2012-403e-bd92-af80fb1f440e service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:49.341819 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-6d1b3a7e-9adf-48a5-9676-476c26753a58 req-ecd22ad7-2012-403e-bd92-af80fb1f440e service nova] Creating event network-changed:72e00e01-0226-481d-9c3e-f109d75f21d1 for instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 on hv-cinder-85083 Sep 02 09:35:49.347188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-6d1b3a7e-9adf-48a5-9676-476c26753a58 req-ecd22ad7-2012-403e-bd92-af80fb1f440e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031713 Sep 02 09:35:49.347919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 175/346] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:35:49.682557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f4ee9a80-1df6-48cb-be2f-8e5ba1a0fa98 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.086055 Sep 02 09:35:49.683846 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 172/347] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 09:35:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:35:49.695912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-13ef1ab6-8354-436b-8bbf-d246cc158a89 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:49.696879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-13ef1ab6-8354-436b-8bbf-d246cc158a89 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:49.767355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-13ef1ab6-8354-436b-8bbf-d246cc158a89 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:49.777156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-13ef1ab6-8354-436b-8bbf-d246cc158a89 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1093 microversion: 2.1 time: 0.085446 Sep 02 09:35:49.779438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 176/348] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:49 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1093 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:49.861540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-975d6d91-5a13-46bd-baf8-7b2342f3c850 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:49.862150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-975d6d91-5a13-46bd-baf8-7b2342f3c850 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:49.869551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-975d6d91-5a13-46bd-baf8-7b2342f3c850 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:49.870820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-975d6d91-5a13-46bd-baf8-7b2342f3c850 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:49.871343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-975d6d91-5a13-46bd-baf8-7b2342f3c850 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:49.872158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-975d6d91-5a13-46bd-baf8-7b2342f3c850 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:49.873377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-975d6d91-5a13-46bd-baf8-7b2342f3c850 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:49.873993 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-975d6d91-5a13-46bd-baf8-7b2342f3c850 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:50.015356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-975d6d91-5a13-46bd-baf8-7b2342f3c850 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:50.023433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-975d6d91-5a13-46bd-baf8-7b2342f3c850 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.166299 Sep 02 09:35:50.024011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 173/349] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:49 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:50.798973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2656db30-d4c7-4950-bc18-e2ae6f2e440a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:50.799579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2656db30-d4c7-4950-bc18-e2ae6f2e440a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:50.808757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2656db30-d4c7-4950-bc18-e2ae6f2e440a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:50.809179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2656db30-d4c7-4950-bc18-e2ae6f2e440a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:50.809614 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2656db30-d4c7-4950-bc18-e2ae6f2e440a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:50.810838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2656db30-d4c7-4950-bc18-e2ae6f2e440a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:50.811380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2656db30-d4c7-4950-bc18-e2ae6f2e440a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:50.811890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2656db30-d4c7-4950-bc18-e2ae6f2e440a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:50.877132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2656db30-d4c7-4950-bc18-e2ae6f2e440a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:50.884856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2656db30-d4c7-4950-bc18-e2ae6f2e440a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1143 microversion: 2.1 time: 0.090059 Sep 02 09:35:50.885418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 177/350] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:50 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:51.045120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fa7e9cc3-7e06-4a71-883e-3948f940090d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:51.045728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fa7e9cc3-7e06-4a71-883e-3948f940090d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:51.051663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa7e9cc3-7e06-4a71-883e-3948f940090d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:51.052148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa7e9cc3-7e06-4a71-883e-3948f940090d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:51.052591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa7e9cc3-7e06-4a71-883e-3948f940090d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:51.053274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa7e9cc3-7e06-4a71-883e-3948f940090d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:51.053730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa7e9cc3-7e06-4a71-883e-3948f940090d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:51.054158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa7e9cc3-7e06-4a71-883e-3948f940090d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:51.182575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fa7e9cc3-7e06-4a71-883e-3948f940090d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:51.190670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fa7e9cc3-7e06-4a71-883e-3948f940090d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.149951 Sep 02 09:35:51.200866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 174/351] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:51 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:51.905485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c876859d-1024-403f-82db-f11f5a195005 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:51.906098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c876859d-1024-403f-82db-f11f5a195005 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:51.912503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c876859d-1024-403f-82db-f11f5a195005 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:51.912971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c876859d-1024-403f-82db-f11f5a195005 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:51.913523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c876859d-1024-403f-82db-f11f5a195005 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:51.914124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c876859d-1024-403f-82db-f11f5a195005 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:51.914584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c876859d-1024-403f-82db-f11f5a195005 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:51.915058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c876859d-1024-403f-82db-f11f5a195005 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:51.976140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c876859d-1024-403f-82db-f11f5a195005 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:51.984350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c876859d-1024-403f-82db-f11f5a195005 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1143 microversion: 2.1 time: 0.082705 Sep 02 09:35:51.984918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 178/352] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:51 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:52.210908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3f4e0263-6591-4af5-bfb9-3e28a590dbe2 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:52.211637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3f4e0263-6591-4af5-bfb9-3e28a590dbe2 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:52.218058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f4e0263-6591-4af5-bfb9-3e28a590dbe2 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:52.218529 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f4e0263-6591-4af5-bfb9-3e28a590dbe2 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:52.219917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f4e0263-6591-4af5-bfb9-3e28a590dbe2 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:52.219917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f4e0263-6591-4af5-bfb9-3e28a590dbe2 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:52.220120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f4e0263-6591-4af5-bfb9-3e28a590dbe2 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:52.220505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3f4e0263-6591-4af5-bfb9-3e28a590dbe2 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:52.235591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:52.352149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3f4e0263-6591-4af5-bfb9-3e28a590dbe2 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:52.360474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3f4e0263-6591-4af5-bfb9-3e28a590dbe2 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.153407 Sep 02 09:35:52.361243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 175/353] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:52 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:53.004999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4448a8ec-1e05-42c8-86cc-9e8e9aff6e02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:53.005596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4448a8ec-1e05-42c8-86cc-9e8e9aff6e02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:53.012004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4448a8ec-1e05-42c8-86cc-9e8e9aff6e02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:53.012487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4448a8ec-1e05-42c8-86cc-9e8e9aff6e02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:53.012924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4448a8ec-1e05-42c8-86cc-9e8e9aff6e02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:53.013639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4448a8ec-1e05-42c8-86cc-9e8e9aff6e02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:53.014088 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4448a8ec-1e05-42c8-86cc-9e8e9aff6e02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:53.014512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4448a8ec-1e05-42c8-86cc-9e8e9aff6e02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:53.075407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4448a8ec-1e05-42c8-86cc-9e8e9aff6e02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:53.077835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:53.083935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4448a8ec-1e05-42c8-86cc-9e8e9aff6e02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1143 microversion: 2.1 time: 0.082750 Sep 02 09:35:53.085614 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 179/354] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:52 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:53.380396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7bb5b447-67f6-4216-a3f7-29bb7664655f tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:53.380957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7bb5b447-67f6-4216-a3f7-29bb7664655f tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:53.387241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb5b447-67f6-4216-a3f7-29bb7664655f tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:53.387723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb5b447-67f6-4216-a3f7-29bb7664655f tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:53.388155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb5b447-67f6-4216-a3f7-29bb7664655f tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:53.389319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb5b447-67f6-4216-a3f7-29bb7664655f tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:53.389764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb5b447-67f6-4216-a3f7-29bb7664655f tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:53.390185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bb5b447-67f6-4216-a3f7-29bb7664655f tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:53.519587 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7bb5b447-67f6-4216-a3f7-29bb7664655f tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:53.527175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7bb5b447-67f6-4216-a3f7-29bb7664655f tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.150644 Sep 02 09:35:53.527742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 176/355] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:53 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:54.104875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9f208e04-256b-4e88-b66c-09b9640b685b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:54.105418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9f208e04-256b-4e88-b66c-09b9640b685b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:54.112244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f208e04-256b-4e88-b66c-09b9640b685b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:54.112717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f208e04-256b-4e88-b66c-09b9640b685b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:54.113149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f208e04-256b-4e88-b66c-09b9640b685b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:54.113824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f208e04-256b-4e88-b66c-09b9640b685b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:54.114269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f208e04-256b-4e88-b66c-09b9640b685b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:54.114688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f208e04-256b-4e88-b66c-09b9640b685b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:54.173503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9f208e04-256b-4e88-b66c-09b9640b685b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:54.180966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9f208e04-256b-4e88-b66c-09b9640b685b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1143 microversion: 2.1 time: 0.079998 Sep 02 09:35:54.181516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 180/356] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:54 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:54.548216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ea2ecbf0-99c8-4a17-9b32-0b73178ba78a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:54.548721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ea2ecbf0-99c8-4a17-9b32-0b73178ba78a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:54.554608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ea2ecbf0-99c8-4a17-9b32-0b73178ba78a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:54.555107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ea2ecbf0-99c8-4a17-9b32-0b73178ba78a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:54.555537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ea2ecbf0-99c8-4a17-9b32-0b73178ba78a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:54.556207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ea2ecbf0-99c8-4a17-9b32-0b73178ba78a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:54.556651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ea2ecbf0-99c8-4a17-9b32-0b73178ba78a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:54.557062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ea2ecbf0-99c8-4a17-9b32-0b73178ba78a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:54.688112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ea2ecbf0-99c8-4a17-9b32-0b73178ba78a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:54.695698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ea2ecbf0-99c8-4a17-9b32-0b73178ba78a tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.151481 Sep 02 09:35:54.696254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 177/357] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:54 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:55.201027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-99ef295f-c1a5-4c93-88bd-e195223a0745 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:55.201654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-99ef295f-c1a5-4c93-88bd-e195223a0745 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:55.208070 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99ef295f-c1a5-4c93-88bd-e195223a0745 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:55.208554 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99ef295f-c1a5-4c93-88bd-e195223a0745 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:55.208989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99ef295f-c1a5-4c93-88bd-e195223a0745 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:55.209673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99ef295f-c1a5-4c93-88bd-e195223a0745 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:55.210130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99ef295f-c1a5-4c93-88bd-e195223a0745 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:55.210553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99ef295f-c1a5-4c93-88bd-e195223a0745 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:55.273552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-99ef295f-c1a5-4c93-88bd-e195223a0745 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:55.281671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-99ef295f-c1a5-4c93-88bd-e195223a0745 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1143 microversion: 2.1 time: 0.084432 Sep 02 09:35:55.282233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 181/358] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:55 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:55.720417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-451c8820-f02d-497b-aba4-181c525e564d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:55.720947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-451c8820-f02d-497b-aba4-181c525e564d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:55.726935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-451c8820-f02d-497b-aba4-181c525e564d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:55.727415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-451c8820-f02d-497b-aba4-181c525e564d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:55.727843 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-451c8820-f02d-497b-aba4-181c525e564d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:55.728514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-451c8820-f02d-497b-aba4-181c525e564d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:55.728957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-451c8820-f02d-497b-aba4-181c525e564d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:55.729371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-451c8820-f02d-497b-aba4-181c525e564d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:55.854397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-451c8820-f02d-497b-aba4-181c525e564d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:55.862838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-451c8820-f02d-497b-aba4-181c525e564d tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.147029 Sep 02 09:35:55.863388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 178/359] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:55 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:56.301923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d0dc6a27-a4c3-470d-9560-ee8927f7fec9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:56.302531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d0dc6a27-a4c3-470d-9560-ee8927f7fec9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:56.308970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0dc6a27-a4c3-470d-9560-ee8927f7fec9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:56.309447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0dc6a27-a4c3-470d-9560-ee8927f7fec9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:56.309876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0dc6a27-a4c3-470d-9560-ee8927f7fec9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:56.310576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0dc6a27-a4c3-470d-9560-ee8927f7fec9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:56.311056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0dc6a27-a4c3-470d-9560-ee8927f7fec9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:56.315862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0dc6a27-a4c3-470d-9560-ee8927f7fec9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:56.373034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d0dc6a27-a4c3-470d-9560-ee8927f7fec9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:56.380722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d0dc6a27-a4c3-470d-9560-ee8927f7fec9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1143 microversion: 2.1 time: 0.082597 Sep 02 09:35:56.381297 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 182/360] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:56 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:56.884127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3773df09-72fc-43f5-8091-3c0eb246ba69 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:56.884730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3773df09-72fc-43f5-8091-3c0eb246ba69 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:56.891517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3773df09-72fc-43f5-8091-3c0eb246ba69 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:56.892039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3773df09-72fc-43f5-8091-3c0eb246ba69 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:56.892473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3773df09-72fc-43f5-8091-3c0eb246ba69 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:56.893188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3773df09-72fc-43f5-8091-3c0eb246ba69 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:56.893640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3773df09-72fc-43f5-8091-3c0eb246ba69 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:56.894062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3773df09-72fc-43f5-8091-3c0eb246ba69 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:57.023393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3773df09-72fc-43f5-8091-3c0eb246ba69 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:57.030904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3773df09-72fc-43f5-8091-3c0eb246ba69 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1314 microversion: 2.1 time: 0.150569 Sep 02 09:35:57.031472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 179/361] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:56 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:57.401969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ed9f38ca-a53b-446f-a20b-e37a4ed57877 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:57.402489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ed9f38ca-a53b-446f-a20b-e37a4ed57877 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:57.409113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed9f38ca-a53b-446f-a20b-e37a4ed57877 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:57.412450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed9f38ca-a53b-446f-a20b-e37a4ed57877 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:57.413119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed9f38ca-a53b-446f-a20b-e37a4ed57877 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:57.414042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed9f38ca-a53b-446f-a20b-e37a4ed57877 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:57.414847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed9f38ca-a53b-446f-a20b-e37a4ed57877 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:57.415492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed9f38ca-a53b-446f-a20b-e37a4ed57877 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:57.496394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ed9f38ca-a53b-446f-a20b-e37a4ed57877 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:57.504238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ed9f38ca-a53b-446f-a20b-e37a4ed57877 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1135 microversion: 2.1 time: 0.106200 Sep 02 09:35:57.504831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 183/362] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:57 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1135 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:58.052437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d0150688-78b3-4322-8bf5-e74706192564 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:58.053052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d0150688-78b3-4322-8bf5-e74706192564 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:58.059907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0150688-78b3-4322-8bf5-e74706192564 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:58.060673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0150688-78b3-4322-8bf5-e74706192564 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:58.061110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0150688-78b3-4322-8bf5-e74706192564 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:58.062493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0150688-78b3-4322-8bf5-e74706192564 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:58.063147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0150688-78b3-4322-8bf5-e74706192564 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:58.063580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d0150688-78b3-4322-8bf5-e74706192564 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:58.194796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d0150688-78b3-4322-8bf5-e74706192564 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:58.203067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d0150688-78b3-4322-8bf5-e74706192564 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1464 microversion: 2.1 time: 0.154469 Sep 02 09:35:58.203903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 180/363] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:58 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:58.402271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-03ae6a3f-83c7-451d-8af4-d0769f9aae5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:58.402793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-03ae6a3f-83c7-451d-8af4-d0769f9aae5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:58.409696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03ae6a3f-83c7-451d-8af4-d0769f9aae5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:58.410234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03ae6a3f-83c7-451d-8af4-d0769f9aae5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:58.410879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03ae6a3f-83c7-451d-8af4-d0769f9aae5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:58.411836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03ae6a3f-83c7-451d-8af4-d0769f9aae5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:58.412286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03ae6a3f-83c7-451d-8af4-d0769f9aae5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:58.412786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03ae6a3f-83c7-451d-8af4-d0769f9aae5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:58.438236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-03ae6a3f-83c7-451d-8af4-d0769f9aae5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Going to try to terminate instance {{(pid=127533) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:35:58.526954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c47a9ae4-5952-4c5f-a3fe-6133b2b078b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:58.527569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c47a9ae4-5952-4c5f-a3fe-6133b2b078b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:58.534009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c47a9ae4-5952-4c5f-a3fe-6133b2b078b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:58.534495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c47a9ae4-5952-4c5f-a3fe-6133b2b078b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:58.534969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c47a9ae4-5952-4c5f-a3fe-6133b2b078b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:58.535848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c47a9ae4-5952-4c5f-a3fe-6133b2b078b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:58.536437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c47a9ae4-5952-4c5f-a3fe-6133b2b078b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:58.536859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c47a9ae4-5952-4c5f-a3fe-6133b2b078b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:58.600998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c47a9ae4-5952-4c5f-a3fe-6133b2b078b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:58.609562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c47a9ae4-5952-4c5f-a3fe-6133b2b078b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1191 microversion: 2.1 time: 0.088632 Sep 02 09:35:58.610173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 181/364] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:58 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:35:58.725387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-03ae6a3f-83c7-451d-8af4-d0769f9aae5b tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 204 len: 0 microversion: 2.1 time: 0.326683 Sep 02 09:35:58.726007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 184/365] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:35:58 2022] DELETE /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:35:58.734069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-45169ecd-e54b-401f-991b-720eff049cd6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:58.734677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-45169ecd-e54b-401f-991b-720eff049cd6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:58.740630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45169ecd-e54b-401f-991b-720eff049cd6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:58.741103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45169ecd-e54b-401f-991b-720eff049cd6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:58.741530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45169ecd-e54b-401f-991b-720eff049cd6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:58.742251 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45169ecd-e54b-401f-991b-720eff049cd6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:58.742645 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45169ecd-e54b-401f-991b-720eff049cd6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:58.743099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45169ecd-e54b-401f-991b-720eff049cd6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:58.875513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-45169ecd-e54b-401f-991b-720eff049cd6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:58.883315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-45169ecd-e54b-401f-991b-720eff049cd6 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1470 microversion: 2.1 time: 0.153167 Sep 02 09:35:58.883871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 182/366] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:58 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:59.632393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-92ba5ac5-9d43-450b-a057-a2f4d155f9f9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:59.633118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-92ba5ac5-9d43-450b-a057-a2f4d155f9f9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:59.639414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92ba5ac5-9d43-450b-a057-a2f4d155f9f9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:59.640079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92ba5ac5-9d43-450b-a057-a2f4d155f9f9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:59.640520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92ba5ac5-9d43-450b-a057-a2f4d155f9f9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:59.641221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92ba5ac5-9d43-450b-a057-a2f4d155f9f9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:59.641677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92ba5ac5-9d43-450b-a057-a2f4d155f9f9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:59.642099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92ba5ac5-9d43-450b-a057-a2f4d155f9f9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:59.704685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-92ba5ac5-9d43-450b-a057-a2f4d155f9f9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:35:59.715276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-92ba5ac5-9d43-450b-a057-a2f4d155f9f9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1199 microversion: 2.1 time: 0.087316 Sep 02 09:35:59.715886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 185/367] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:59 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:35:59.962663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2046c564-8852-4362-977d-221a00ace648 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:35:59.963267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2046c564-8852-4362-977d-221a00ace648 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:35:59.965033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:59.965727 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:35:59.970875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2046c564-8852-4362-977d-221a00ace648 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:59.975817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2046c564-8852-4362-977d-221a00ace648 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:59.975817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2046c564-8852-4362-977d-221a00ace648 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:35:59.975817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2046c564-8852-4362-977d-221a00ace648 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:35:59.975817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2046c564-8852-4362-977d-221a00ace648 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:35:59.976175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2046c564-8852-4362-977d-221a00ace648 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:00.102254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2046c564-8852-4362-977d-221a00ace648 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:00.109871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2046c564-8852-4362-977d-221a00ace648 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1470 microversion: 2.1 time: 0.151238 Sep 02 09:36:00.110434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 183/368] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:35:59 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:00.741933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1ddeacee-4bdf-476f-962c-a1b0c8c00f2b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:00.742652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1ddeacee-4bdf-476f-962c-a1b0c8c00f2b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:00.744778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:00.751225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ddeacee-4bdf-476f-962c-a1b0c8c00f2b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:00.751721 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ddeacee-4bdf-476f-962c-a1b0c8c00f2b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:00.752158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ddeacee-4bdf-476f-962c-a1b0c8c00f2b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:00.752882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ddeacee-4bdf-476f-962c-a1b0c8c00f2b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:00.753366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ddeacee-4bdf-476f-962c-a1b0c8c00f2b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:00.753796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ddeacee-4bdf-476f-962c-a1b0c8c00f2b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:00.820991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1ddeacee-4bdf-476f-962c-a1b0c8c00f2b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:00.828669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1ddeacee-4bdf-476f-962c-a1b0c8c00f2b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1209 microversion: 2.1 time: 0.090749 Sep 02 09:36:00.829444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 186/369] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:00 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:01.133393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f27470f9-cdd7-416b-83fb-98d25275cf98 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:01.133994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f27470f9-cdd7-416b-83fb-98d25275cf98 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:01.140313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f27470f9-cdd7-416b-83fb-98d25275cf98 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:01.140836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f27470f9-cdd7-416b-83fb-98d25275cf98 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:01.141330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f27470f9-cdd7-416b-83fb-98d25275cf98 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:01.142022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f27470f9-cdd7-416b-83fb-98d25275cf98 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:01.142498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f27470f9-cdd7-416b-83fb-98d25275cf98 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:01.142952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f27470f9-cdd7-416b-83fb-98d25275cf98 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:01.282189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f27470f9-cdd7-416b-83fb-98d25275cf98 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:01.288793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f27470f9-cdd7-416b-83fb-98d25275cf98 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1470 microversion: 2.1 time: 0.160984 Sep 02 09:36:01.289378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 184/370] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:01 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:01.850273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3971d7b9-5f19-4abc-a8ca-c17b5afd32e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:01.850908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3971d7b9-5f19-4abc-a8ca-c17b5afd32e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:01.857254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3971d7b9-5f19-4abc-a8ca-c17b5afd32e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:01.857734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3971d7b9-5f19-4abc-a8ca-c17b5afd32e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:01.858166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3971d7b9-5f19-4abc-a8ca-c17b5afd32e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:01.858875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3971d7b9-5f19-4abc-a8ca-c17b5afd32e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:01.859324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3971d7b9-5f19-4abc-a8ca-c17b5afd32e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:01.859809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3971d7b9-5f19-4abc-a8ca-c17b5afd32e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:01.988500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3971d7b9-5f19-4abc-a8ca-c17b5afd32e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:01.996384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3971d7b9-5f19-4abc-a8ca-c17b5afd32e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1276 microversion: 2.1 time: 0.150333 Sep 02 09:36:01.996940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 187/371] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:01 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:02.310193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-114e1063-9485-4197-ba5b-d99068d747eb tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:02.310834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-114e1063-9485-4197-ba5b-d99068d747eb tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:02.317221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-114e1063-9485-4197-ba5b-d99068d747eb tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:02.317711 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-114e1063-9485-4197-ba5b-d99068d747eb tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:02.318144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-114e1063-9485-4197-ba5b-d99068d747eb tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:02.318850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-114e1063-9485-4197-ba5b-d99068d747eb tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:02.319307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-114e1063-9485-4197-ba5b-d99068d747eb tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:02.319732 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-114e1063-9485-4197-ba5b-d99068d747eb tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:02.449568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-114e1063-9485-4197-ba5b-d99068d747eb tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:02.457898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-114e1063-9485-4197-ba5b-d99068d747eb tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1470 microversion: 2.1 time: 0.151586 Sep 02 09:36:02.458460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 185/372] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:02 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:03.017127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c6ea2c9f-d607-4ecf-b0d1-9d011c114f71 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:03.017736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c6ea2c9f-d607-4ecf-b0d1-9d011c114f71 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:03.024494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6ea2c9f-d607-4ecf-b0d1-9d011c114f71 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:03.024981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6ea2c9f-d607-4ecf-b0d1-9d011c114f71 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:03.025408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6ea2c9f-d607-4ecf-b0d1-9d011c114f71 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:03.026092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6ea2c9f-d607-4ecf-b0d1-9d011c114f71 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:03.026544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6ea2c9f-d607-4ecf-b0d1-9d011c114f71 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:03.027000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6ea2c9f-d607-4ecf-b0d1-9d011c114f71 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:03.156610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c6ea2c9f-d607-4ecf-b0d1-9d011c114f71 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:03.164663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c6ea2c9f-d607-4ecf-b0d1-9d011c114f71 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1276 microversion: 2.1 time: 0.151371 Sep 02 09:36:03.165224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 188/373] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:03 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:03.478982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ed16d7d0-07ac-489f-b668-a137e6bc4093 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:03.479519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ed16d7d0-07ac-489f-b668-a137e6bc4093 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:03.485604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed16d7d0-07ac-489f-b668-a137e6bc4093 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:03.486146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed16d7d0-07ac-489f-b668-a137e6bc4093 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:03.486579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed16d7d0-07ac-489f-b668-a137e6bc4093 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:03.487287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed16d7d0-07ac-489f-b668-a137e6bc4093 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:03.487739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed16d7d0-07ac-489f-b668-a137e6bc4093 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:03.488161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ed16d7d0-07ac-489f-b668-a137e6bc4093 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:03.613820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ed16d7d0-07ac-489f-b668-a137e6bc4093 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:03.621386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ed16d7d0-07ac-489f-b668-a137e6bc4093 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1470 microversion: 2.1 time: 0.146342 Sep 02 09:36:03.621951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 186/374] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:03 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:04.185053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ea5e1728-e340-4720-ab23-d36c8634337e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:04.185695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ea5e1728-e340-4720-ab23-d36c8634337e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:04.192631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea5e1728-e340-4720-ab23-d36c8634337e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:04.193115 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea5e1728-e340-4720-ab23-d36c8634337e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:04.193560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea5e1728-e340-4720-ab23-d36c8634337e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:04.194259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea5e1728-e340-4720-ab23-d36c8634337e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:04.194698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea5e1728-e340-4720-ab23-d36c8634337e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:04.195143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea5e1728-e340-4720-ab23-d36c8634337e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:04.325915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ea5e1728-e340-4720-ab23-d36c8634337e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:04.334148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ea5e1728-e340-4720-ab23-d36c8634337e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1276 microversion: 2.1 time: 0.153052 Sep 02 09:36:04.334722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 189/375] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:04 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:04.641815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f9fbd449-41cd-4c61-8506-548fce1442b0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:04.642455 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f9fbd449-41cd-4c61-8506-548fce1442b0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:04.648597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9fbd449-41cd-4c61-8506-548fce1442b0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:04.649072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9fbd449-41cd-4c61-8506-548fce1442b0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:04.649502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9fbd449-41cd-4c61-8506-548fce1442b0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:04.650177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9fbd449-41cd-4c61-8506-548fce1442b0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:04.650624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9fbd449-41cd-4c61-8506-548fce1442b0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:04.651068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9fbd449-41cd-4c61-8506-548fce1442b0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:04.871540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f9fbd449-41cd-4c61-8506-548fce1442b0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:04.871540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f9fbd449-41cd-4c61-8506-548fce1442b0 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1470 microversion: 2.1 time: 0.164434 Sep 02 09:36:04.871540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 187/376] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:04 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:05.353562 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-55b10b9a-b860-4d06-ac37-5ddca6f0eea4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:05.354212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-55b10b9a-b860-4d06-ac37-5ddca6f0eea4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:05.360627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55b10b9a-b860-4d06-ac37-5ddca6f0eea4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:05.361107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55b10b9a-b860-4d06-ac37-5ddca6f0eea4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:05.361544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55b10b9a-b860-4d06-ac37-5ddca6f0eea4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:05.362229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55b10b9a-b860-4d06-ac37-5ddca6f0eea4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:05.362680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55b10b9a-b860-4d06-ac37-5ddca6f0eea4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:05.363130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55b10b9a-b860-4d06-ac37-5ddca6f0eea4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:05.487694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-55b10b9a-b860-4d06-ac37-5ddca6f0eea4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:05.495304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-55b10b9a-b860-4d06-ac37-5ddca6f0eea4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1276 microversion: 2.1 time: 0.145580 Sep 02 09:36:05.495867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 190/377] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:05 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:05.823248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-55cff639-551d-4d29-872b-a8c132ab9595 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:05.823860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-55cff639-551d-4d29-872b-a8c132ab9595 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:05.829770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55cff639-551d-4d29-872b-a8c132ab9595 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:05.830915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55cff639-551d-4d29-872b-a8c132ab9595 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:05.831380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55cff639-551d-4d29-872b-a8c132ab9595 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:05.832067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55cff639-551d-4d29-872b-a8c132ab9595 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:05.832521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55cff639-551d-4d29-872b-a8c132ab9595 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:05.832946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55cff639-551d-4d29-872b-a8c132ab9595 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:05.963380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-55cff639-551d-4d29-872b-a8c132ab9595 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:05.971052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-55cff639-551d-4d29-872b-a8c132ab9595 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1470 microversion: 2.1 time: 0.151749 Sep 02 09:36:05.971615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 188/378] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:05 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:06.515854 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ad3e9e75-7d9c-410d-8f79-c33f74f49a4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:06.516445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ad3e9e75-7d9c-410d-8f79-c33f74f49a4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:06.523810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad3e9e75-7d9c-410d-8f79-c33f74f49a4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:06.523810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad3e9e75-7d9c-410d-8f79-c33f74f49a4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:06.524233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad3e9e75-7d9c-410d-8f79-c33f74f49a4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:06.525072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad3e9e75-7d9c-410d-8f79-c33f74f49a4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:06.525530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad3e9e75-7d9c-410d-8f79-c33f74f49a4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:06.525946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad3e9e75-7d9c-410d-8f79-c33f74f49a4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:06.732120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ad3e9e75-7d9c-410d-8f79-c33f74f49a4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:06.740279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ad3e9e75-7d9c-410d-8f79-c33f74f49a4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1276 microversion: 2.1 time: 0.228601 Sep 02 09:36:06.754115 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 191/379] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:06 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1276 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:06.996405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-475f5bca-1b19-4121-913c-83db82f8ee30 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:06.997032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-475f5bca-1b19-4121-913c-83db82f8ee30 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:07.006830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-475f5bca-1b19-4121-913c-83db82f8ee30 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:07.007646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-475f5bca-1b19-4121-913c-83db82f8ee30 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:07.008258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-475f5bca-1b19-4121-913c-83db82f8ee30 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:07.009124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-475f5bca-1b19-4121-913c-83db82f8ee30 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:07.010449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-475f5bca-1b19-4121-913c-83db82f8ee30 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:07.011309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-475f5bca-1b19-4121-913c-83db82f8ee30 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:07.023417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-4eb0cf8a-b395-49fc-9ded-e45876937b9c req-ff8e0847-8a53-4ad9-bbe7-28d5fb81a7ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457", "name": "network-vif-deleted", "tag": "7bbd8d11-dbdb-401b-926c-3b56f63aea2c"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:07.035749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4eb0cf8a-b395-49fc-9ded-e45876937b9c req-ff8e0847-8a53-4ad9-bbe7-28d5fb81a7ff service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:07.035749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4eb0cf8a-b395-49fc-9ded-e45876937b9c req-ff8e0847-8a53-4ad9-bbe7-28d5fb81a7ff service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:07.035749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4eb0cf8a-b395-49fc-9ded-e45876937b9c req-ff8e0847-8a53-4ad9-bbe7-28d5fb81a7ff service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:07.047756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-4eb0cf8a-b395-49fc-9ded-e45876937b9c req-ff8e0847-8a53-4ad9-bbe7-28d5fb81a7ff service nova] Creating event network-vif-deleted:7bbd8d11-dbdb-401b-926c-3b56f63aea2c for instance c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 on hv-cinder-85083 Sep 02 09:36:07.053795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-4eb0cf8a-b395-49fc-9ded-e45876937b9c req-ff8e0847-8a53-4ad9-bbe7-28d5fb81a7ff service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034045 Sep 02 09:36:07.054731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 192/380] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:36:07.090495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-475f5bca-1b19-4121-913c-83db82f8ee30 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:07.112729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-475f5bca-1b19-4121-913c-83db82f8ee30 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1428 microversion: 2.1 time: 0.122389 Sep 02 09:36:07.113400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 189/381] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:06 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1428 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:07.292029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-4d1b394b-0e18-45e7-865e-277d2022a700 req-86a58b82-90b8-41ea-b64b-4272d0bf80d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c278bb-a399-4a52-bb7a-6d1782711406", "tag": "992ffb61-2296-4bd8-bec8-1499e9e418f4"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:07.302961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4d1b394b-0e18-45e7-865e-277d2022a700 req-86a58b82-90b8-41ea-b64b-4272d0bf80d2 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:07.309321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4d1b394b-0e18-45e7-865e-277d2022a700 req-86a58b82-90b8-41ea-b64b-4272d0bf80d2 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:07.309321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4d1b394b-0e18-45e7-865e-277d2022a700 req-86a58b82-90b8-41ea-b64b-4272d0bf80d2 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:07.314999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-4d1b394b-0e18-45e7-865e-277d2022a700 req-86a58b82-90b8-41ea-b64b-4272d0bf80d2 service nova] Creating event network-changed:992ffb61-2296-4bd8-bec8-1499e9e418f4 for instance 99c278bb-a399-4a52-bb7a-6d1782711406 on hv-cinder-85083 Sep 02 09:36:07.319770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-4d1b394b-0e18-45e7-865e-277d2022a700 req-86a58b82-90b8-41ea-b64b-4272d0bf80d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Sep 02 09:36:07.320358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 193/382] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:36:07.761326 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bcd4067e-9233-44f5-b6a2-c38c8951e5c0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:07.762031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bcd4067e-9233-44f5-b6a2-c38c8951e5c0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:07.768530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bcd4067e-9233-44f5-b6a2-c38c8951e5c0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:07.773895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bcd4067e-9233-44f5-b6a2-c38c8951e5c0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:07.773895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bcd4067e-9233-44f5-b6a2-c38c8951e5c0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:07.773895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bcd4067e-9233-44f5-b6a2-c38c8951e5c0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:07.773895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bcd4067e-9233-44f5-b6a2-c38c8951e5c0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:07.774303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bcd4067e-9233-44f5-b6a2-c38c8951e5c0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:07.899688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bcd4067e-9233-44f5-b6a2-c38c8951e5c0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:07.907317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bcd4067e-9233-44f5-b6a2-c38c8951e5c0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1276 microversion: 2.1 time: 0.149863 Sep 02 09:36:07.907880 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 190/383] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:07 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:08.134424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:08.136084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:08.144098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:08.146851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:08.146851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:08.146851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:08.146851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:08.147330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:08.180560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:08.181054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:08.181681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:08.182132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lazy-loading 'fault' on Instance uuid c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:36:08.252984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd304395e2a0a49ceae4c4d9166ca92e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d6a5715cf497fbda2b68647c0a5a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:08.261889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b5f94c74-723f-4dc7-8d76-b49f03b538fe tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 200 len: 1304 microversion: 2.1 time: 0.131935 Sep 02 09:36:08.266733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 194/384] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:08 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:08.928906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d7acb01c-6102-4a54-8d81-5b9574375b27 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:08.929552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d7acb01c-6102-4a54-8d81-5b9574375b27 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:08.938795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7acb01c-6102-4a54-8d81-5b9574375b27 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:08.938795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7acb01c-6102-4a54-8d81-5b9574375b27 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:08.938795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7acb01c-6102-4a54-8d81-5b9574375b27 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:08.938795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7acb01c-6102-4a54-8d81-5b9574375b27 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:08.939147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7acb01c-6102-4a54-8d81-5b9574375b27 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:08.939147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7acb01c-6102-4a54-8d81-5b9574375b27 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:09.112307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d7acb01c-6102-4a54-8d81-5b9574375b27 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:09.121808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d7acb01c-6102-4a54-8d81-5b9574375b27 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1276 microversion: 2.1 time: 0.196970 Sep 02 09:36:09.122373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 191/385] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:08 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:09.282995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:09.283597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] [instance: c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:09.290094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:09.290576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:09.291042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:09.291731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:09.292180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:09.293823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:09.306373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] HTTP exception thrown: Instance c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 could not be found. Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Request method failure captured: Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 HTTP/1.1 Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc5AXEpjMKKGdX7gHWgIADAV6uCxhQtsoDfnuVufv9uhBaFGmmzK_QxfsZTnR3mko9sy4T0aSNKzSfOGxJeOf5vD1NDQRYyLVWAfStU9W1iNo52xX5IGpkjUKmVqUBdumBXkItWvcyD1cXD4ith7xRVnsqRajfQyGXDuOp0D2Yd3-88 Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: f81d6a5715cf497fbda2b68647c0a5a2 Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesNegativeTest-1023084255 Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:36:09.307976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f81d6a5715cf497fbda2b68647c0a5a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f81d6a5715cf497fbda2b68647c0a5a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f81d6a5715cf497fbda2b68647c0a5a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f81d6a5715cf497fbda2b68647c0a5a2", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesNegativeTest-1023084255 Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: f81d6a5715cf497fbda2b68647c0a5a2 Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesNegativeTest-1023084255 Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesNegativeTest-1023084255-project Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: d304395e2a0a49ceae4c4d9166ca92e2 Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesNegativeTest-1023084255-project Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 could not be found. Sep 02 09:36:09.309524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': 'c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457'} Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 could not be found. Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:36:09.310363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 could not be found. Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 could not be found. Sep 02 09:36:09.311871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:36:09.313064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] Returning 404 to user: Instance c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:36:09.313064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5db17459-47a8-4a52-8048-6b4bc51ffea3 tempest-VolumesNegativeTest-1023084255 tempest-VolumesNegativeTest-1023084255-project] 10.222.0.57 "GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457" status: 404 len: 111 microversion: 2.1 time: 0.030311 Sep 02 09:36:09.313064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 195/386] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:09 2022] GET /compute/v2.1/servers/c20cc5ff-3b4d-4764-8ca8-25d4cc2c9457 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:36:10.142863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5e5d3779-83b8-434f-8703-503c71341ecb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:10.143476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5e5d3779-83b8-434f-8703-503c71341ecb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:10.154241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e5d3779-83b8-434f-8703-503c71341ecb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:10.160791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e5d3779-83b8-434f-8703-503c71341ecb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:10.160791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e5d3779-83b8-434f-8703-503c71341ecb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:10.160791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e5d3779-83b8-434f-8703-503c71341ecb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:10.160791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e5d3779-83b8-434f-8703-503c71341ecb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:10.161230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e5d3779-83b8-434f-8703-503c71341ecb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:10.161230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:10.296085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5e5d3779-83b8-434f-8703-503c71341ecb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:10.302562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5e5d3779-83b8-434f-8703-503c71341ecb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.163794 Sep 02 09:36:10.303165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 192/387] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:10 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:36:11.323158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ce46819a-f344-4c63-b57a-4fe9f4663060 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:11.332756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ce46819a-f344-4c63-b57a-4fe9f4663060 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:11.340020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce46819a-f344-4c63-b57a-4fe9f4663060 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:11.340595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce46819a-f344-4c63-b57a-4fe9f4663060 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:11.341157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce46819a-f344-4c63-b57a-4fe9f4663060 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:11.341974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce46819a-f344-4c63-b57a-4fe9f4663060 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:11.342425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce46819a-f344-4c63-b57a-4fe9f4663060 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:11.342889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce46819a-f344-4c63-b57a-4fe9f4663060 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:11.362583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:11.485744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ce46819a-f344-4c63-b57a-4fe9f4663060 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:11.493488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ce46819a-f344-4c63-b57a-4fe9f4663060 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.174214 Sep 02 09:36:11.494043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 196/388] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:11 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:12.514350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d95de6b5-ad50-4b64-b7d4-119b169c929b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:12.515624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d95de6b5-ad50-4b64-b7d4-119b169c929b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:12.522475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d95de6b5-ad50-4b64-b7d4-119b169c929b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:12.523059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d95de6b5-ad50-4b64-b7d4-119b169c929b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:12.523560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d95de6b5-ad50-4b64-b7d4-119b169c929b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:12.524523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d95de6b5-ad50-4b64-b7d4-119b169c929b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:12.525151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d95de6b5-ad50-4b64-b7d4-119b169c929b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:12.525865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d95de6b5-ad50-4b64-b7d4-119b169c929b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:12.681428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d95de6b5-ad50-4b64-b7d4-119b169c929b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:12.689614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d95de6b5-ad50-4b64-b7d4-119b169c929b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.179467 Sep 02 09:36:12.690291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 193/389] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:12 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:13.716048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c7d0d339-2467-43f5-bf13-a64a577978f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:13.717302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c7d0d339-2467-43f5-bf13-a64a577978f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:13.726262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7d0d339-2467-43f5-bf13-a64a577978f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:13.727641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7d0d339-2467-43f5-bf13-a64a577978f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:13.728389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7d0d339-2467-43f5-bf13-a64a577978f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:13.729687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7d0d339-2467-43f5-bf13-a64a577978f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:13.730696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7d0d339-2467-43f5-bf13-a64a577978f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:13.731518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7d0d339-2467-43f5-bf13-a64a577978f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:13.932813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c7d0d339-2467-43f5-bf13-a64a577978f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:13.942841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c7d0d339-2467-43f5-bf13-a64a577978f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.235065 Sep 02 09:36:13.943409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 197/390] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:13 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:14.964229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3976aaea-1e7b-4d66-96a7-eb24e641044e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:14.965417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3976aaea-1e7b-4d66-96a7-eb24e641044e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:14.971786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3976aaea-1e7b-4d66-96a7-eb24e641044e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:14.972268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3976aaea-1e7b-4d66-96a7-eb24e641044e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:14.972702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3976aaea-1e7b-4d66-96a7-eb24e641044e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:14.973922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3976aaea-1e7b-4d66-96a7-eb24e641044e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:14.974403 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3976aaea-1e7b-4d66-96a7-eb24e641044e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:14.974851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3976aaea-1e7b-4d66-96a7-eb24e641044e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:15.138109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3976aaea-1e7b-4d66-96a7-eb24e641044e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:15.144637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3976aaea-1e7b-4d66-96a7-eb24e641044e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.184281 Sep 02 09:36:15.146052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 194/391] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:14 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:16.167370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ccc3e90a-0ccf-45cd-8022-395d9ae663bc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:16.167993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ccc3e90a-0ccf-45cd-8022-395d9ae663bc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:16.180646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc3e90a-0ccf-45cd-8022-395d9ae663bc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:16.181213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc3e90a-0ccf-45cd-8022-395d9ae663bc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:16.181704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc3e90a-0ccf-45cd-8022-395d9ae663bc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:16.189052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc3e90a-0ccf-45cd-8022-395d9ae663bc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:16.189052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc3e90a-0ccf-45cd-8022-395d9ae663bc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:16.189052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc3e90a-0ccf-45cd-8022-395d9ae663bc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:16.611032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ccc3e90a-0ccf-45cd-8022-395d9ae663bc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:16.619874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ccc3e90a-0ccf-45cd-8022-395d9ae663bc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.457026 Sep 02 09:36:16.620702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 198/392] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:16 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:17.642181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a711c149-8bad-43b2-a5d9-36b703c1d954 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:17.642957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a711c149-8bad-43b2-a5d9-36b703c1d954 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:17.651071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a711c149-8bad-43b2-a5d9-36b703c1d954 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:17.651364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a711c149-8bad-43b2-a5d9-36b703c1d954 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:17.651832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a711c149-8bad-43b2-a5d9-36b703c1d954 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:17.652692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a711c149-8bad-43b2-a5d9-36b703c1d954 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:17.653218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a711c149-8bad-43b2-a5d9-36b703c1d954 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:17.653714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a711c149-8bad-43b2-a5d9-36b703c1d954 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:17.800253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a711c149-8bad-43b2-a5d9-36b703c1d954 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:17.808061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a711c149-8bad-43b2-a5d9-36b703c1d954 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.170334 Sep 02 09:36:17.808628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 195/393] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:17 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:18.828944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a2e8543a-c334-4cf5-83c0-6077dc4e8cbe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:18.829536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a2e8543a-c334-4cf5-83c0-6077dc4e8cbe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:18.836843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2e8543a-c334-4cf5-83c0-6077dc4e8cbe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:18.837325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2e8543a-c334-4cf5-83c0-6077dc4e8cbe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:18.837757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2e8543a-c334-4cf5-83c0-6077dc4e8cbe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:18.838440 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2e8543a-c334-4cf5-83c0-6077dc4e8cbe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:18.839103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2e8543a-c334-4cf5-83c0-6077dc4e8cbe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:18.839523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2e8543a-c334-4cf5-83c0-6077dc4e8cbe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:18.987390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a2e8543a-c334-4cf5-83c0-6077dc4e8cbe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:18.997110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a2e8543a-c334-4cf5-83c0-6077dc4e8cbe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.171988 Sep 02 09:36:18.997800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 199/394] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:18 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:20.018080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-18b97c62-b7ed-45a9-8796-99f9c331d773 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:20.018826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-18b97c62-b7ed-45a9-8796-99f9c331d773 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:20.020772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:20.025452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18b97c62-b7ed-45a9-8796-99f9c331d773 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:20.026007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18b97c62-b7ed-45a9-8796-99f9c331d773 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:20.026521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18b97c62-b7ed-45a9-8796-99f9c331d773 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:20.027308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18b97c62-b7ed-45a9-8796-99f9c331d773 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:20.027760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18b97c62-b7ed-45a9-8796-99f9c331d773 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:20.028284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-18b97c62-b7ed-45a9-8796-99f9c331d773 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:20.167877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-18b97c62-b7ed-45a9-8796-99f9c331d773 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:20.176274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-18b97c62-b7ed-45a9-8796-99f9c331d773 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.162084 Sep 02 09:36:20.176989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 196/395] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:20 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:21.205130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b3a48ef5-1265-41ff-b320-737b91fabc2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:21.205130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b3a48ef5-1265-41ff-b320-737b91fabc2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:21.205130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:21.210899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a48ef5-1265-41ff-b320-737b91fabc2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:21.211531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a48ef5-1265-41ff-b320-737b91fabc2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:21.211929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a48ef5-1265-41ff-b320-737b91fabc2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:21.212629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a48ef5-1265-41ff-b320-737b91fabc2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:21.213682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a48ef5-1265-41ff-b320-737b91fabc2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:21.213682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a48ef5-1265-41ff-b320-737b91fabc2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:21.359591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b3a48ef5-1265-41ff-b320-737b91fabc2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:21.367078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b3a48ef5-1265-41ff-b320-737b91fabc2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.171655 Sep 02 09:36:21.368261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 200/396] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:21 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:36:22.388119 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2c6ad4eb-e829-4133-a7a1-10fef44f8aa7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:22.388804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2c6ad4eb-e829-4133-a7a1-10fef44f8aa7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:22.394963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c6ad4eb-e829-4133-a7a1-10fef44f8aa7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:22.395446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c6ad4eb-e829-4133-a7a1-10fef44f8aa7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:22.395899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c6ad4eb-e829-4133-a7a1-10fef44f8aa7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:22.396567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c6ad4eb-e829-4133-a7a1-10fef44f8aa7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:22.397017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c6ad4eb-e829-4133-a7a1-10fef44f8aa7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:22.397438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c6ad4eb-e829-4133-a7a1-10fef44f8aa7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:22.509141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-6364cd3b-fa9c-41f6-89fc-4ee42e2e0531 req-fee65e20-2b8c-4d9f-b59a-e17448f904d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c278bb-a399-4a52-bb7a-6d1782711406", "name": "network-vif-plugged", "status": "completed", "tag": "992ffb61-2296-4bd8-bec8-1499e9e418f4"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:22.519687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6364cd3b-fa9c-41f6-89fc-4ee42e2e0531 req-fee65e20-2b8c-4d9f-b59a-e17448f904d7 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:22.520428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6364cd3b-fa9c-41f6-89fc-4ee42e2e0531 req-fee65e20-2b8c-4d9f-b59a-e17448f904d7 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:22.521019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6364cd3b-fa9c-41f6-89fc-4ee42e2e0531 req-fee65e20-2b8c-4d9f-b59a-e17448f904d7 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:22.532677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-6364cd3b-fa9c-41f6-89fc-4ee42e2e0531 req-fee65e20-2b8c-4d9f-b59a-e17448f904d7 service nova] Creating event network-vif-plugged:992ffb61-2296-4bd8-bec8-1499e9e418f4 for instance 99c278bb-a399-4a52-bb7a-6d1782711406 on hv-cinder-85083 Sep 02 09:36:22.534362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2c6ad4eb-e829-4133-a7a1-10fef44f8aa7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:22.537710 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-6364cd3b-fa9c-41f6-89fc-4ee42e2e0531 req-fee65e20-2b8c-4d9f-b59a-e17448f904d7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Sep 02 09:36:22.538300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 201/397] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:36:22.542831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2c6ad4eb-e829-4133-a7a1-10fef44f8aa7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.158930 Sep 02 09:36:22.543401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 197/398] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:22 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:23.564525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-58baef22-e72a-4966-a1ca-679e7c431b55 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:23.565227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-58baef22-e72a-4966-a1ca-679e7c431b55 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:23.571858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58baef22-e72a-4966-a1ca-679e7c431b55 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:23.572352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58baef22-e72a-4966-a1ca-679e7c431b55 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:23.572776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58baef22-e72a-4966-a1ca-679e7c431b55 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:23.573458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58baef22-e72a-4966-a1ca-679e7c431b55 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:23.573911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58baef22-e72a-4966-a1ca-679e7c431b55 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:23.574337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58baef22-e72a-4966-a1ca-679e7c431b55 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:23.706250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-58baef22-e72a-4966-a1ca-679e7c431b55 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:23.715400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-58baef22-e72a-4966-a1ca-679e7c431b55 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.155866 Sep 02 09:36:23.715957 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 202/399] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:23 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:24.739471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb0a8d23-2b0f-454b-aea6-f1de0aa2dc5d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:24.740082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb0a8d23-2b0f-454b-aea6-f1de0aa2dc5d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:24.746539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0a8d23-2b0f-454b-aea6-f1de0aa2dc5d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:24.747069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0a8d23-2b0f-454b-aea6-f1de0aa2dc5d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:24.747506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0a8d23-2b0f-454b-aea6-f1de0aa2dc5d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:24.748190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0a8d23-2b0f-454b-aea6-f1de0aa2dc5d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:24.748641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0a8d23-2b0f-454b-aea6-f1de0aa2dc5d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:24.749062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb0a8d23-2b0f-454b-aea6-f1de0aa2dc5d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:24.881771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb0a8d23-2b0f-454b-aea6-f1de0aa2dc5d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:24.889547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb0a8d23-2b0f-454b-aea6-f1de0aa2dc5d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.154044 Sep 02 09:36:24.890109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 198/400] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:24 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:25.910689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-31611452-165e-419e-805e-32fdb6b312d2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:25.911346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-31611452-165e-419e-805e-32fdb6b312d2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:25.917808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31611452-165e-419e-805e-32fdb6b312d2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:25.918304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31611452-165e-419e-805e-32fdb6b312d2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:25.918756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31611452-165e-419e-805e-32fdb6b312d2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:25.919455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31611452-165e-419e-805e-32fdb6b312d2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:25.919914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31611452-165e-419e-805e-32fdb6b312d2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:25.920344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31611452-165e-419e-805e-32fdb6b312d2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:26.049545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-31611452-165e-419e-805e-32fdb6b312d2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:26.057902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-31611452-165e-419e-805e-32fdb6b312d2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.151941 Sep 02 09:36:26.058463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 203/401] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:25 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:27.077394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-da54b70a-01d1-42d5-8559-6d93d454150a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:27.077923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-da54b70a-01d1-42d5-8559-6d93d454150a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:27.083810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da54b70a-01d1-42d5-8559-6d93d454150a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:27.084293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da54b70a-01d1-42d5-8559-6d93d454150a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:27.084725 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da54b70a-01d1-42d5-8559-6d93d454150a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:27.085405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da54b70a-01d1-42d5-8559-6d93d454150a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:27.085857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da54b70a-01d1-42d5-8559-6d93d454150a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:27.086284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da54b70a-01d1-42d5-8559-6d93d454150a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:27.221858 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da54b70a-01d1-42d5-8559-6d93d454150a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:27.230558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-da54b70a-01d1-42d5-8559-6d93d454150a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.157006 Sep 02 09:36:27.231187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 199/402] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:27 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:28.251289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a142a467-39b2-40e7-92bb-ef96c8ace0cf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:28.252185 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a142a467-39b2-40e7-92bb-ef96c8ace0cf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:28.258655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a142a467-39b2-40e7-92bb-ef96c8ace0cf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:28.259157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a142a467-39b2-40e7-92bb-ef96c8ace0cf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:28.259585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a142a467-39b2-40e7-92bb-ef96c8ace0cf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:28.260263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a142a467-39b2-40e7-92bb-ef96c8ace0cf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:28.260707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a142a467-39b2-40e7-92bb-ef96c8ace0cf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:28.261128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a142a467-39b2-40e7-92bb-ef96c8ace0cf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:28.404596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a142a467-39b2-40e7-92bb-ef96c8ace0cf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:28.412295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a142a467-39b2-40e7-92bb-ef96c8ace0cf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1264 microversion: 2.1 time: 0.164790 Sep 02 09:36:28.412867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 204/403] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:28 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:29.440296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9fcc7896-0fa3-436d-9e69-d93bc079bca0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:29.441087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9fcc7896-0fa3-436d-9e69-d93bc079bca0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:29.447543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc7896-0fa3-436d-9e69-d93bc079bca0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:29.448615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc7896-0fa3-436d-9e69-d93bc079bca0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:29.449124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc7896-0fa3-436d-9e69-d93bc079bca0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:29.449893 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc7896-0fa3-436d-9e69-d93bc079bca0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:29.450548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc7896-0fa3-436d-9e69-d93bc079bca0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:29.451171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fcc7896-0fa3-436d-9e69-d93bc079bca0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:29.592977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9fcc7896-0fa3-436d-9e69-d93bc079bca0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:29.601771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9fcc7896-0fa3-436d-9e69-d93bc079bca0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1450 microversion: 2.1 time: 0.165303 Sep 02 09:36:29.615532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 200/404] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:29 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:29.628695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3d6f73d2-b1e1-470d-8951-874bc536c0a2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:29.629605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3d6f73d2-b1e1-470d-8951-874bc536c0a2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:29.637431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d6f73d2-b1e1-470d-8951-874bc536c0a2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:29.642626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d6f73d2-b1e1-470d-8951-874bc536c0a2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:29.642626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d6f73d2-b1e1-470d-8951-874bc536c0a2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:29.642626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d6f73d2-b1e1-470d-8951-874bc536c0a2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:29.642626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d6f73d2-b1e1-470d-8951-874bc536c0a2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:29.642977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d6f73d2-b1e1-470d-8951-874bc536c0a2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:29.792810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3d6f73d2-b1e1-470d-8951-874bc536c0a2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:29.801009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3d6f73d2-b1e1-470d-8951-874bc536c0a2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1450 microversion: 2.1 time: 0.177433 Sep 02 09:36:29.801588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 205/405] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:29 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:32.373707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-8754f4f3-d74f-4d9f-94eb-e652b9581af3 req-7ef785ac-d2b0-4bd3-8313-07a05e648bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c278bb-a399-4a52-bb7a-6d1782711406", "tag": "992ffb61-2296-4bd8-bec8-1499e9e418f4"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:32.385672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-8754f4f3-d74f-4d9f-94eb-e652b9581af3 req-7ef785ac-d2b0-4bd3-8313-07a05e648bbf service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:32.386388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-8754f4f3-d74f-4d9f-94eb-e652b9581af3 req-7ef785ac-d2b0-4bd3-8313-07a05e648bbf service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:32.386996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-8754f4f3-d74f-4d9f-94eb-e652b9581af3 req-7ef785ac-d2b0-4bd3-8313-07a05e648bbf service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:32.399643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-8754f4f3-d74f-4d9f-94eb-e652b9581af3 req-7ef785ac-d2b0-4bd3-8313-07a05e648bbf service nova] Creating event network-changed:992ffb61-2296-4bd8-bec8-1499e9e418f4 for instance 99c278bb-a399-4a52-bb7a-6d1782711406 on hv-cinder-85083 Sep 02 09:36:32.405530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-8754f4f3-d74f-4d9f-94eb-e652b9581af3 req-7ef785ac-d2b0-4bd3-8313-07a05e648bbf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035974 Sep 02 09:36:32.410586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 201/406] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:36:38.646516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-304513199", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "networks": [{"uuid": "6ecff31c-e278-4e1c-9b6e-53dacab1210c"}]}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:38.700771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.network.neutron [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] validate_networks() for [('6ecff31c-e278-4e1c-9b6e-53dacab1210c', None, None, None, None, None)] {{(pid=127533) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:36:39.046186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Flavor limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:36:39.046614 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Image limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:36:39.047141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Flavor pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:36:39.047549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Image pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:36:39.047965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:36:39.062538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:39.062538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:39.062538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:39.062538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:39.062977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:39.062977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:39.077420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Getting quotas for project aa4bc1ecdf7543ea9777b69428329986. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:36:39.081387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Getting quotas for user a9c034fcd0ed4825b5661a7bc3d37719 and project aa4bc1ecdf7543ea9777b69428329986. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:36:39.092972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Going to run 1 instances... {{(pid=127533) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:36:39.095290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127533) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:36:39.219280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-222740ed-539d-4b12-828f-0d47051907bf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576881 Sep 02 09:36:39.220032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 206/407] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 09:36:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:36:39.232594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ac101671-0980-4c07-818f-31ceeb79179c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:39.234204 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ac101671-0980-4c07-818f-31ceeb79179c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:39.301498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ac101671-0980-4c07-818f-31ceeb79179c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:39.309020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ac101671-0980-4c07-818f-31ceeb79179c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1213 microversion: 2.1 time: 0.081695 Sep 02 09:36:39.310375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 202/408] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:39 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:40.334636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d551f100-044f-4db1-ba25-cff3fddd8590 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:40.335426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d551f100-044f-4db1-ba25-cff3fddd8590 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:40.343057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d551f100-044f-4db1-ba25-cff3fddd8590 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:40.343551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d551f100-044f-4db1-ba25-cff3fddd8590 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:40.343994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d551f100-044f-4db1-ba25-cff3fddd8590 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:40.344693 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d551f100-044f-4db1-ba25-cff3fddd8590 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:40.345151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d551f100-044f-4db1-ba25-cff3fddd8590 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:40.345670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d551f100-044f-4db1-ba25-cff3fddd8590 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:40.411748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-427672659", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "networks": [{"uuid": "f7abc83e-41de-4b14-a83d-2791ce6d6171"}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:40.413297 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d551f100-044f-4db1-ba25-cff3fddd8590 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:40.422618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d551f100-044f-4db1-ba25-cff3fddd8590 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1217 microversion: 2.1 time: 0.091830 Sep 02 09:36:40.424756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 207/409] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:40 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:40.470566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] validate_networks() for [('f7abc83e-41de-4b14-a83d-2791ce6d6171', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:36:40.823269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:36:40.823669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:36:40.824133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:36:40.824531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:36:40.825036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:36:40.834769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:40.835199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:40.835793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:40.836628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:40.837075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:40.837493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:40.854931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Getting quotas for project 7232d6277f26496ab552afa4abe13ad5. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:36:40.859118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Getting quotas for user 889d4c60870447bda2926106026a0537 and project 7232d6277f26496ab552afa4abe13ad5. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:36:40.870008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:36:40.873008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:36:40.989525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-22e9e06c-0500-4279-8091-15241fac9462 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581740 Sep 02 09:36:40.990186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 203/410] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 09:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 09:36:41.001544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-14a2a848-2ee2-489b-8cf9-f2ce5ba63fc1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:41.002155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-14a2a848-2ee2-489b-8cf9-f2ce5ba63fc1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:41.066694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-14a2a848-2ee2-489b-8cf9-f2ce5ba63fc1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:41.074418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-14a2a848-2ee2-489b-8cf9-f2ce5ba63fc1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1218 microversion: 2.1 time: 0.077192 Sep 02 09:36:41.078253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 208/411] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:40 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:41.445585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-50d4d4a3-5726-46db-aa82-51211368505e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:41.446264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-50d4d4a3-5726-46db-aa82-51211368505e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:41.453359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50d4d4a3-5726-46db-aa82-51211368505e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:41.453840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50d4d4a3-5726-46db-aa82-51211368505e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:41.454273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50d4d4a3-5726-46db-aa82-51211368505e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:41.454980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50d4d4a3-5726-46db-aa82-51211368505e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:41.455438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50d4d4a3-5726-46db-aa82-51211368505e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:41.456943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50d4d4a3-5726-46db-aa82-51211368505e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:41.517959 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-50d4d4a3-5726-46db-aa82-51211368505e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:41.525567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-50d4d4a3-5726-46db-aa82-51211368505e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1265 microversion: 2.1 time: 0.083970 Sep 02 09:36:41.526128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 204/412] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:41 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:36:42.096332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ca651770-1295-4bf1-a831-ab368f184fab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:42.096976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ca651770-1295-4bf1-a831-ab368f184fab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:42.103849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca651770-1295-4bf1-a831-ab368f184fab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:42.104339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca651770-1295-4bf1-a831-ab368f184fab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:42.104782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca651770-1295-4bf1-a831-ab368f184fab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:42.105479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca651770-1295-4bf1-a831-ab368f184fab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:42.105934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca651770-1295-4bf1-a831-ab368f184fab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:42.107687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca651770-1295-4bf1-a831-ab368f184fab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:42.182894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ca651770-1295-4bf1-a831-ab368f184fab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:42.191019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ca651770-1295-4bf1-a831-ab368f184fab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1222 microversion: 2.1 time: 0.098510 Sep 02 09:36:42.191598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 209/413] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:42 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:42.545539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a40fb180-2801-4302-956d-a9ae16d5b952 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:42.546148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a40fb180-2801-4302-956d-a9ae16d5b952 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:42.552241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a40fb180-2801-4302-956d-a9ae16d5b952 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:42.552717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a40fb180-2801-4302-956d-a9ae16d5b952 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:42.553144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a40fb180-2801-4302-956d-a9ae16d5b952 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:42.553819 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a40fb180-2801-4302-956d-a9ae16d5b952 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:42.554265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a40fb180-2801-4302-956d-a9ae16d5b952 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:42.554682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a40fb180-2801-4302-956d-a9ae16d5b952 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:42.560799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=64 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:42.698227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a40fb180-2801-4302-956d-a9ae16d5b952 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:42.706353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a40fb180-2801-4302-956d-a9ae16d5b952 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.164649 Sep 02 09:36:42.706901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 205/414] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:42 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:43.213058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a74a90c5-a19e-40ce-8a01-671b28fbfad1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:43.213676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a74a90c5-a19e-40ce-8a01-671b28fbfad1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:43.220762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a74a90c5-a19e-40ce-8a01-671b28fbfad1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:43.221256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a74a90c5-a19e-40ce-8a01-671b28fbfad1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:43.221701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a74a90c5-a19e-40ce-8a01-671b28fbfad1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:43.222402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a74a90c5-a19e-40ce-8a01-671b28fbfad1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:43.222888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a74a90c5-a19e-40ce-8a01-671b28fbfad1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:43.223321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a74a90c5-a19e-40ce-8a01-671b28fbfad1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:43.312407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a74a90c5-a19e-40ce-8a01-671b28fbfad1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:43.319982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a74a90c5-a19e-40ce-8a01-671b28fbfad1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1270 microversion: 2.1 time: 0.110909 Sep 02 09:36:43.320728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 210/415] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:43 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:43.516123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-fb70ae6d-ae11-4ab5-9785-c8eb04cf8d5c req-f3f2b175-0999-4061-b298-991cd49016d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d206d4fc-4472-4b36-b6df-4921c211051d", "tag": "5fe07c2b-f3ca-4267-8880-bf0958145073"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:43.526025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fb70ae6d-ae11-4ab5-9785-c8eb04cf8d5c req-f3f2b175-0999-4061-b298-991cd49016d5 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:43.526508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fb70ae6d-ae11-4ab5-9785-c8eb04cf8d5c req-f3f2b175-0999-4061-b298-991cd49016d5 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:43.526967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fb70ae6d-ae11-4ab5-9785-c8eb04cf8d5c req-f3f2b175-0999-4061-b298-991cd49016d5 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:43.543112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-fb70ae6d-ae11-4ab5-9785-c8eb04cf8d5c req-f3f2b175-0999-4061-b298-991cd49016d5 service nova] Creating event network-changed:5fe07c2b-f3ca-4267-8880-bf0958145073 for instance d206d4fc-4472-4b36-b6df-4921c211051d on hv-cinder-85083 Sep 02 09:36:43.549623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-fb70ae6d-ae11-4ab5-9785-c8eb04cf8d5c req-f3f2b175-0999-4061-b298-991cd49016d5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036806 Sep 02 09:36:43.549623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 206/416] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:36:43.728174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2bca5d73-8778-48c4-aac4-54be9fe6d68b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:43.728900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2bca5d73-8778-48c4-aac4-54be9fe6d68b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:43.735218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bca5d73-8778-48c4-aac4-54be9fe6d68b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:43.735710 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bca5d73-8778-48c4-aac4-54be9fe6d68b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:43.736146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bca5d73-8778-48c4-aac4-54be9fe6d68b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:43.736832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bca5d73-8778-48c4-aac4-54be9fe6d68b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:43.737284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bca5d73-8778-48c4-aac4-54be9fe6d68b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:43.737877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bca5d73-8778-48c4-aac4-54be9fe6d68b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:43.935388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2bca5d73-8778-48c4-aac4-54be9fe6d68b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:43.943400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2bca5d73-8778-48c4-aac4-54be9fe6d68b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.219097 Sep 02 09:36:43.957162 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 211/417] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:43 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:44.345277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a7e5e897-3b01-4acc-9a7a-f3ebb702a28e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:44.346371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a7e5e897-3b01-4acc-9a7a-f3ebb702a28e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:44.353254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7e5e897-3b01-4acc-9a7a-f3ebb702a28e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:44.353672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7e5e897-3b01-4acc-9a7a-f3ebb702a28e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:44.354275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7e5e897-3b01-4acc-9a7a-f3ebb702a28e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:44.355227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7e5e897-3b01-4acc-9a7a-f3ebb702a28e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:44.355733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7e5e897-3b01-4acc-9a7a-f3ebb702a28e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:44.356383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7e5e897-3b01-4acc-9a7a-f3ebb702a28e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:44.431462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a7e5e897-3b01-4acc-9a7a-f3ebb702a28e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:44.439089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a7e5e897-3b01-4acc-9a7a-f3ebb702a28e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1276 microversion: 2.1 time: 0.101506 Sep 02 09:36:44.439661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 207/418] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:44 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:44.964780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1a475ef5-fe68-444e-a873-2f211da6444c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:44.965400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1a475ef5-fe68-444e-a873-2f211da6444c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:44.972336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a475ef5-fe68-444e-a873-2f211da6444c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:44.972823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a475ef5-fe68-444e-a873-2f211da6444c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:44.973264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a475ef5-fe68-444e-a873-2f211da6444c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:44.973979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a475ef5-fe68-444e-a873-2f211da6444c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:44.974435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a475ef5-fe68-444e-a873-2f211da6444c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:44.974904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a475ef5-fe68-444e-a873-2f211da6444c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:45.103792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1a475ef5-fe68-444e-a873-2f211da6444c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:45.111850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1a475ef5-fe68-444e-a873-2f211da6444c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.150997 Sep 02 09:36:45.112419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 212/419] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:44 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:45.409953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9784aff0-daaa-49cf-a7d6-d75464074b37 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:45.410472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9784aff0-daaa-49cf-a7d6-d75464074b37 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:45.416331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9784aff0-daaa-49cf-a7d6-d75464074b37 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:45.416820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9784aff0-daaa-49cf-a7d6-d75464074b37 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:45.417258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9784aff0-daaa-49cf-a7d6-d75464074b37 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:45.417951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9784aff0-daaa-49cf-a7d6-d75464074b37 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:45.418410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9784aff0-daaa-49cf-a7d6-d75464074b37 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:45.418875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9784aff0-daaa-49cf-a7d6-d75464074b37 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:45.441584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9784aff0-daaa-49cf-a7d6-d75464074b37 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/ips" status: 200 len: 145 microversion: 2.1 time: 0.035648 Sep 02 09:36:45.442147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 208/420] 10.222.0.57 () {58 vars in 1248 bytes} [Fri Sep 2 09:36:45 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:36:45.459911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-691574b9-f634-4442-8352-005881a5d30a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:45.460525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-691574b9-f634-4442-8352-005881a5d30a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:45.467177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-691574b9-f634-4442-8352-005881a5d30a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:45.467668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-691574b9-f634-4442-8352-005881a5d30a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:45.468104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-691574b9-f634-4442-8352-005881a5d30a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:45.468791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-691574b9-f634-4442-8352-005881a5d30a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:45.469241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-691574b9-f634-4442-8352-005881a5d30a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:45.469663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-691574b9-f634-4442-8352-005881a5d30a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:45.598915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-691574b9-f634-4442-8352-005881a5d30a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:45.606547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-691574b9-f634-4442-8352-005881a5d30a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.150394 Sep 02 09:36:45.607753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 213/421] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:45 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:46.132435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a33c09b9-fb1b-4a72-9466-dc082ae463bb tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:46.132973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a33c09b9-fb1b-4a72-9466-dc082ae463bb tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:46.138939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a33c09b9-fb1b-4a72-9466-dc082ae463bb tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:46.139432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a33c09b9-fb1b-4a72-9466-dc082ae463bb tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:46.139871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a33c09b9-fb1b-4a72-9466-dc082ae463bb tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:46.140560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a33c09b9-fb1b-4a72-9466-dc082ae463bb tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:46.141018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a33c09b9-fb1b-4a72-9466-dc082ae463bb tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:46.141446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a33c09b9-fb1b-4a72-9466-dc082ae463bb tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:46.270666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a33c09b9-fb1b-4a72-9466-dc082ae463bb tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:46.278329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a33c09b9-fb1b-4a72-9466-dc082ae463bb tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.150067 Sep 02 09:36:46.278923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 209/422] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:46 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:46.627536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-81bdcb8b-6f6e-41a4-b028-a5c3af99c149 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:46.628145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-81bdcb8b-6f6e-41a4-b028-a5c3af99c149 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:46.634690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bdcb8b-6f6e-41a4-b028-a5c3af99c149 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:46.641249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bdcb8b-6f6e-41a4-b028-a5c3af99c149 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:46.641249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bdcb8b-6f6e-41a4-b028-a5c3af99c149 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:46.641249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bdcb8b-6f6e-41a4-b028-a5c3af99c149 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:46.641249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bdcb8b-6f6e-41a4-b028-a5c3af99c149 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:46.641700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bdcb8b-6f6e-41a4-b028-a5c3af99c149 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:46.641700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=92 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:46.765412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-81bdcb8b-6f6e-41a4-b028-a5c3af99c149 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:46.772998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-81bdcb8b-6f6e-41a4-b028-a5c3af99c149 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.149376 Sep 02 09:36:46.773572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 214/423] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:46 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:47.300125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-be5c1953-615b-4d86-991c-cfb4c3c5770f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:47.300640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-be5c1953-615b-4d86-991c-cfb4c3c5770f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:47.306786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5c1953-615b-4d86-991c-cfb4c3c5770f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:47.307285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5c1953-615b-4d86-991c-cfb4c3c5770f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:47.307692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5c1953-615b-4d86-991c-cfb4c3c5770f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:47.308362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5c1953-615b-4d86-991c-cfb4c3c5770f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:47.308806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5c1953-615b-4d86-991c-cfb4c3c5770f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:47.309220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5c1953-615b-4d86-991c-cfb4c3c5770f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:47.438673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be5c1953-615b-4d86-991c-cfb4c3c5770f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:47.446220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-be5c1953-615b-4d86-991c-cfb4c3c5770f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.150086 Sep 02 09:36:47.446794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 210/424] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:47 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:47.793844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8d430347-a9fa-459a-9d58-8f3a6dfdbd1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:47.794607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8d430347-a9fa-459a-9d58-8f3a6dfdbd1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:47.802073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d430347-a9fa-459a-9d58-8f3a6dfdbd1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:47.802564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d430347-a9fa-459a-9d58-8f3a6dfdbd1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:47.803035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d430347-a9fa-459a-9d58-8f3a6dfdbd1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:47.803726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d430347-a9fa-459a-9d58-8f3a6dfdbd1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:47.804176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d430347-a9fa-459a-9d58-8f3a6dfdbd1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:47.804601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d430347-a9fa-459a-9d58-8f3a6dfdbd1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:47.936411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8d430347-a9fa-459a-9d58-8f3a6dfdbd1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:47.944119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8d430347-a9fa-459a-9d58-8f3a6dfdbd1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.154529 Sep 02 09:36:47.944690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 215/425] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:47 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:48.329552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-fd93a85e-5048-427b-80cd-1a8f6d326adf req-a58222ca-9f9d-467a-ac6e-088b94711401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94dc7b98-31d1-406f-9070-26ccfe00e15b", "tag": "6b7348aa-d687-4af3-a6bc-a5bf38d3cb42"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:48.339139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fd93a85e-5048-427b-80cd-1a8f6d326adf req-a58222ca-9f9d-467a-ac6e-088b94711401 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:48.339613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fd93a85e-5048-427b-80cd-1a8f6d326adf req-a58222ca-9f9d-467a-ac6e-088b94711401 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:48.340037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-fd93a85e-5048-427b-80cd-1a8f6d326adf req-a58222ca-9f9d-467a-ac6e-088b94711401 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:48.350994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-fd93a85e-5048-427b-80cd-1a8f6d326adf req-a58222ca-9f9d-467a-ac6e-088b94711401 service nova] Creating event network-changed:6b7348aa-d687-4af3-a6bc-a5bf38d3cb42 for instance 94dc7b98-31d1-406f-9070-26ccfe00e15b on hv-cinder-85083 Sep 02 09:36:48.356139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-fd93a85e-5048-427b-80cd-1a8f6d326adf req-a58222ca-9f9d-467a-ac6e-088b94711401 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032053 Sep 02 09:36:48.357178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 211/426] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:36:48.466938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7893d547-d4d5-47ab-9603-92b0e0ef9e15 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:48.467591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7893d547-d4d5-47ab-9603-92b0e0ef9e15 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:48.473741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7893d547-d4d5-47ab-9603-92b0e0ef9e15 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:48.474297 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7893d547-d4d5-47ab-9603-92b0e0ef9e15 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:48.480049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7893d547-d4d5-47ab-9603-92b0e0ef9e15 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:48.480049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7893d547-d4d5-47ab-9603-92b0e0ef9e15 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:48.480049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7893d547-d4d5-47ab-9603-92b0e0ef9e15 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:48.480049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7893d547-d4d5-47ab-9603-92b0e0ef9e15 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:48.606750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7893d547-d4d5-47ab-9603-92b0e0ef9e15 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:48.614454 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7893d547-d4d5-47ab-9603-92b0e0ef9e15 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.151420 Sep 02 09:36:48.615049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 216/427] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:48 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:48.965825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-14c673d8-af54-4987-9e79-0e80ee1e6f0f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:48.966515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-14c673d8-af54-4987-9e79-0e80ee1e6f0f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:48.972669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c673d8-af54-4987-9e79-0e80ee1e6f0f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:48.973148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c673d8-af54-4987-9e79-0e80ee1e6f0f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:48.973577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c673d8-af54-4987-9e79-0e80ee1e6f0f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:48.974252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c673d8-af54-4987-9e79-0e80ee1e6f0f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:48.974723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c673d8-af54-4987-9e79-0e80ee1e6f0f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:48.975139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c673d8-af54-4987-9e79-0e80ee1e6f0f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:49.123856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-43b7b7b1-b6a7-44b4-9948-c531d77194f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e002e4a-ad01-4f0d-bc79-7c25ac6987e3"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:49.126331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-43b7b7b1-b6a7-44b4-9948-c531d77194f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:49.128718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:49.133776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43b7b7b1-b6a7-44b4-9948-c531d77194f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:49.134272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43b7b7b1-b6a7-44b4-9948-c531d77194f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:49.134739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43b7b7b1-b6a7-44b4-9948-c531d77194f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:49.135472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43b7b7b1-b6a7-44b4-9948-c531d77194f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:49.135930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43b7b7b1-b6a7-44b4-9948-c531d77194f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:49.136359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43b7b7b1-b6a7-44b4-9948-c531d77194f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:49.199244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-14c673d8-af54-4987-9e79-0e80ee1e6f0f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:49.209028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-14c673d8-af54-4987-9e79-0e80ee1e6f0f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.246306 Sep 02 09:36:49.209028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 212/428] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:48 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:49.635857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8968fc0a-8ec4-4e2f-9319-79a2538c9ac1 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:49.636527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8968fc0a-8ec4-4e2f-9319-79a2538c9ac1 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:49.642913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8968fc0a-8ec4-4e2f-9319-79a2538c9ac1 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:49.643395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8968fc0a-8ec4-4e2f-9319-79a2538c9ac1 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:49.643827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8968fc0a-8ec4-4e2f-9319-79a2538c9ac1 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:49.644504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8968fc0a-8ec4-4e2f-9319-79a2538c9ac1 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:49.644960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8968fc0a-8ec4-4e2f-9319-79a2538c9ac1 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:49.645407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8968fc0a-8ec4-4e2f-9319-79a2538c9ac1 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:49.772346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8968fc0a-8ec4-4e2f-9319-79a2538c9ac1 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:49.780021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8968fc0a-8ec4-4e2f-9319-79a2538c9ac1 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.148100 Sep 02 09:36:49.781136 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 213/429] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:49 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:36:50.229079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6e745209-ad09-4fb2-bf28-502a3407a988 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:50.229682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6e745209-ad09-4fb2-bf28-502a3407a988 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:50.236067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e745209-ad09-4fb2-bf28-502a3407a988 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:50.236551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e745209-ad09-4fb2-bf28-502a3407a988 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:50.236983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e745209-ad09-4fb2-bf28-502a3407a988 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:50.237663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e745209-ad09-4fb2-bf28-502a3407a988 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:50.238111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e745209-ad09-4fb2-bf28-502a3407a988 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:50.238531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e745209-ad09-4fb2-bf28-502a3407a988 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:50.363649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6e745209-ad09-4fb2-bf28-502a3407a988 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:50.371292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6e745209-ad09-4fb2-bf28-502a3407a988 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.146109 Sep 02 09:36:50.371849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 214/430] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:50 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:36:50.801663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1bad2625-0de7-45b6-8fbe-b96eaf4d8159 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:50.802292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1bad2625-0de7-45b6-8fbe-b96eaf4d8159 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:50.808134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bad2625-0de7-45b6-8fbe-b96eaf4d8159 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:50.808610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bad2625-0de7-45b6-8fbe-b96eaf4d8159 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:50.810789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bad2625-0de7-45b6-8fbe-b96eaf4d8159 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:50.810789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bad2625-0de7-45b6-8fbe-b96eaf4d8159 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:50.810789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bad2625-0de7-45b6-8fbe-b96eaf4d8159 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:50.810789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bad2625-0de7-45b6-8fbe-b96eaf4d8159 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:50.845641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:50.866086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=8 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:50.942973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1bad2625-0de7-45b6-8fbe-b96eaf4d8159 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:50.950463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1bad2625-0de7-45b6-8fbe-b96eaf4d8159 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.152726 Sep 02 09:36:50.951056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 215/431] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:50 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:36:51.071160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=8 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:51.393596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9d4f83ef-77c2-4514-b626-0028dee52c7b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:51.394126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9d4f83ef-77c2-4514-b626-0028dee52c7b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:51.400005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d4f83ef-77c2-4514-b626-0028dee52c7b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:51.400485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d4f83ef-77c2-4514-b626-0028dee52c7b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:51.400920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d4f83ef-77c2-4514-b626-0028dee52c7b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:51.401595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d4f83ef-77c2-4514-b626-0028dee52c7b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:51.402042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d4f83ef-77c2-4514-b626-0028dee52c7b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:51.402464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d4f83ef-77c2-4514-b626-0028dee52c7b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:51.527109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9d4f83ef-77c2-4514-b626-0028dee52c7b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:51.534579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9d4f83ef-77c2-4514-b626-0028dee52c7b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.145725 Sep 02 09:36:51.535167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 216/432] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:51 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:36:51.971467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d9d3d2ce-af08-4f9b-bd7f-6c70646d547f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:51.972101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d9d3d2ce-af08-4f9b-bd7f-6c70646d547f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:51.978032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9d3d2ce-af08-4f9b-bd7f-6c70646d547f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:51.978504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9d3d2ce-af08-4f9b-bd7f-6c70646d547f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:51.978963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9d3d2ce-af08-4f9b-bd7f-6c70646d547f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:51.979631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9d3d2ce-af08-4f9b-bd7f-6c70646d547f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:51.980075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9d3d2ce-af08-4f9b-bd7f-6c70646d547f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:51.980496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9d3d2ce-af08-4f9b-bd7f-6c70646d547f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:52.108380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d9d3d2ce-af08-4f9b-bd7f-6c70646d547f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:52.116502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d9d3d2ce-af08-4f9b-bd7f-6c70646d547f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.148911 Sep 02 09:36:52.117071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 217/433] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:51 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:36:52.555213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7107d53e-857c-4d8f-af4b-644db36a2989 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:52.555925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7107d53e-857c-4d8f-af4b-644db36a2989 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:52.559049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:52.562652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7107d53e-857c-4d8f-af4b-644db36a2989 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:52.563280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7107d53e-857c-4d8f-af4b-644db36a2989 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:52.563810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7107d53e-857c-4d8f-af4b-644db36a2989 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:52.564597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7107d53e-857c-4d8f-af4b-644db36a2989 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:52.565225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7107d53e-857c-4d8f-af4b-644db36a2989 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:52.565907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7107d53e-857c-4d8f-af4b-644db36a2989 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:52.823295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-43b7b7b1-b6a7-44b4-9948-c531d77194f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "POST /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.703152 Sep 02 09:36:52.824593 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 217/434] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 09:36:49 2022] POST /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 194 bytes in 3705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:36:52.920026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-6bea2989-e6cd-402f-bffb-1014cba28664 req-1e0aaf79-26dd-47ba-8cee-17d27480465d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d206d4fc-4472-4b36-b6df-4921c211051d", "name": "network-vif-plugged", "status": "completed", "tag": "5fe07c2b-f3ca-4267-8880-bf0958145073"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:52.931315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6bea2989-e6cd-402f-bffb-1014cba28664 req-1e0aaf79-26dd-47ba-8cee-17d27480465d service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:52.931826 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6bea2989-e6cd-402f-bffb-1014cba28664 req-1e0aaf79-26dd-47ba-8cee-17d27480465d service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:52.932271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6bea2989-e6cd-402f-bffb-1014cba28664 req-1e0aaf79-26dd-47ba-8cee-17d27480465d service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:52.944874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-6bea2989-e6cd-402f-bffb-1014cba28664 req-1e0aaf79-26dd-47ba-8cee-17d27480465d service nova] Creating event network-vif-plugged:5fe07c2b-f3ca-4267-8880-bf0958145073 for instance d206d4fc-4472-4b36-b6df-4921c211051d on hv-cinder-85083 Sep 02 09:36:52.955661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-6bea2989-e6cd-402f-bffb-1014cba28664 req-1e0aaf79-26dd-47ba-8cee-17d27480465d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034829 Sep 02 09:36:52.956895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 218/435] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:36:53.028063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7107d53e-857c-4d8f-af4b-644db36a2989 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:53.050841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7107d53e-857c-4d8f-af4b-644db36a2989 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.484688 Sep 02 09:36:53.050841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 218/436] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:52 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:53.137056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b01ba0df-2788-4d0a-ae84-b65a21b19c27 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:53.137752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b01ba0df-2788-4d0a-ae84-b65a21b19c27 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:53.144574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b01ba0df-2788-4d0a-ae84-b65a21b19c27 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:53.144859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b01ba0df-2788-4d0a-ae84-b65a21b19c27 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:53.145298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b01ba0df-2788-4d0a-ae84-b65a21b19c27 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:53.146034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b01ba0df-2788-4d0a-ae84-b65a21b19c27 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:53.146425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b01ba0df-2788-4d0a-ae84-b65a21b19c27 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:53.146890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b01ba0df-2788-4d0a-ae84-b65a21b19c27 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:53.309449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b01ba0df-2788-4d0a-ae84-b65a21b19c27 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:53.318428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b01ba0df-2788-4d0a-ae84-b65a21b19c27 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.185493 Sep 02 09:36:53.319037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 219/437] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:53 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:54.056940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b0cc5605-25f7-4fa2-ac2e-f4bd8fe09f0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:54.057541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b0cc5605-25f7-4fa2-ac2e-f4bd8fe09f0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:54.063484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0cc5605-25f7-4fa2-ac2e-f4bd8fe09f0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:54.063965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0cc5605-25f7-4fa2-ac2e-f4bd8fe09f0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:54.064418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0cc5605-25f7-4fa2-ac2e-f4bd8fe09f0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:54.065248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0cc5605-25f7-4fa2-ac2e-f4bd8fe09f0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:54.065700 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0cc5605-25f7-4fa2-ac2e-f4bd8fe09f0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:54.066118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0cc5605-25f7-4fa2-ac2e-f4bd8fe09f0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:54.192905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b0cc5605-25f7-4fa2-ac2e-f4bd8fe09f0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:54.200677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b0cc5605-25f7-4fa2-ac2e-f4bd8fe09f0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.147637 Sep 02 09:36:54.201260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 219/438] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:54 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:54.338369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3fd0b1b6-b3e2-45ed-96c0-4a62dc4722c8 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:54.338944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3fd0b1b6-b3e2-45ed-96c0-4a62dc4722c8 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:54.341336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:54.346370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3fd0b1b6-b3e2-45ed-96c0-4a62dc4722c8 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:54.346909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3fd0b1b6-b3e2-45ed-96c0-4a62dc4722c8 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:54.347349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3fd0b1b6-b3e2-45ed-96c0-4a62dc4722c8 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:54.348039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3fd0b1b6-b3e2-45ed-96c0-4a62dc4722c8 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:54.348491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3fd0b1b6-b3e2-45ed-96c0-4a62dc4722c8 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:54.348914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3fd0b1b6-b3e2-45ed-96c0-4a62dc4722c8 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:54.478469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3fd0b1b6-b3e2-45ed-96c0-4a62dc4722c8 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:54.486205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3fd0b1b6-b3e2-45ed-96c0-4a62dc4722c8 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.151764 Sep 02 09:36:54.486791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 220/439] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:54 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:55.222138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-00a402d6-3a05-4d58-a645-f2c2ee3584b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:55.222930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-00a402d6-3a05-4d58-a645-f2c2ee3584b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:55.229059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00a402d6-3a05-4d58-a645-f2c2ee3584b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:55.229541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00a402d6-3a05-4d58-a645-f2c2ee3584b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:55.229966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00a402d6-3a05-4d58-a645-f2c2ee3584b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:55.230643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00a402d6-3a05-4d58-a645-f2c2ee3584b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:55.231114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00a402d6-3a05-4d58-a645-f2c2ee3584b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:55.231529 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00a402d6-3a05-4d58-a645-f2c2ee3584b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:55.364444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-00a402d6-3a05-4d58-a645-f2c2ee3584b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:55.371975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-00a402d6-3a05-4d58-a645-f2c2ee3584b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.154538 Sep 02 09:36:55.372534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 220/440] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:55 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:55.507395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6d45346e-efee-48a6-a5b4-fd70848225b4 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:55.508092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6d45346e-efee-48a6-a5b4-fd70848225b4 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:55.516296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d45346e-efee-48a6-a5b4-fd70848225b4 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:55.517561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d45346e-efee-48a6-a5b4-fd70848225b4 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:55.518192 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d45346e-efee-48a6-a5b4-fd70848225b4 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:55.519112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d45346e-efee-48a6-a5b4-fd70848225b4 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:55.519797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d45346e-efee-48a6-a5b4-fd70848225b4 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:55.520384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d45346e-efee-48a6-a5b4-fd70848225b4 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:55.659124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6d45346e-efee-48a6-a5b4-fd70848225b4 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:55.667249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6d45346e-efee-48a6-a5b4-fd70848225b4 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1313 microversion: 2.1 time: 0.164220 Sep 02 09:36:55.668033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 221/441] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:55 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:56.392388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-940572cd-f53e-4aec-9960-21a7a466b3de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:56.392902 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-940572cd-f53e-4aec-9960-21a7a466b3de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:56.398834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940572cd-f53e-4aec-9960-21a7a466b3de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:56.399309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940572cd-f53e-4aec-9960-21a7a466b3de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:56.399746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940572cd-f53e-4aec-9960-21a7a466b3de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:56.400414 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940572cd-f53e-4aec-9960-21a7a466b3de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:56.400862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940572cd-f53e-4aec-9960-21a7a466b3de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:56.401277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940572cd-f53e-4aec-9960-21a7a466b3de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:56.526069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-940572cd-f53e-4aec-9960-21a7a466b3de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:56.534196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-940572cd-f53e-4aec-9960-21a7a466b3de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.145749 Sep 02 09:36:56.534762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 221/442] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:56 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:56.688471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cb8a4df7-28a1-4004-839e-7c7e17fb06d2 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:56.699166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cb8a4df7-28a1-4004-839e-7c7e17fb06d2 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:56.699166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8a4df7-28a1-4004-839e-7c7e17fb06d2 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:56.699166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8a4df7-28a1-4004-839e-7c7e17fb06d2 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:56.699166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8a4df7-28a1-4004-839e-7c7e17fb06d2 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:56.699561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8a4df7-28a1-4004-839e-7c7e17fb06d2 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:56.699561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8a4df7-28a1-4004-839e-7c7e17fb06d2 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:56.699561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8a4df7-28a1-4004-839e-7c7e17fb06d2 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:57.049975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-83fed316-0bf8-4c75-abe7-07e6c2f03d0d req-0cc5db5c-b547-42a7-a921-58aebcabf121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94dc7b98-31d1-406f-9070-26ccfe00e15b", "name": "network-vif-plugged", "status": "completed", "tag": "6b7348aa-d687-4af3-a6bc-a5bf38d3cb42"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:36:57.061024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-83fed316-0bf8-4c75-abe7-07e6c2f03d0d req-0cc5db5c-b547-42a7-a921-58aebcabf121 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:57.061500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-83fed316-0bf8-4c75-abe7-07e6c2f03d0d req-0cc5db5c-b547-42a7-a921-58aebcabf121 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:57.061923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-83fed316-0bf8-4c75-abe7-07e6c2f03d0d req-0cc5db5c-b547-42a7-a921-58aebcabf121 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:57.062619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cb8a4df7-28a1-4004-839e-7c7e17fb06d2 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:57.071177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cb8a4df7-28a1-4004-839e-7c7e17fb06d2 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1496 microversion: 2.1 time: 0.386614 Sep 02 09:36:57.072575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 222/443] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:56 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1496 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:57.073454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-83fed316-0bf8-4c75-abe7-07e6c2f03d0d req-0cc5db5c-b547-42a7-a921-58aebcabf121 service nova] Creating event network-vif-plugged:6b7348aa-d687-4af3-a6bc-a5bf38d3cb42 for instance 94dc7b98-31d1-406f-9070-26ccfe00e15b on hv-cinder-85083 Sep 02 09:36:57.080482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-83fed316-0bf8-4c75-abe7-07e6c2f03d0d req-0cc5db5c-b547-42a7-a921-58aebcabf121 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032781 Sep 02 09:36:57.080482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 222/444] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:36:57.554478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b3ac6494-c437-43a7-8279-e46f866e133e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:57.555120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b3ac6494-c437-43a7-8279-e46f866e133e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:57.560920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ac6494-c437-43a7-8279-e46f866e133e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:57.561403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ac6494-c437-43a7-8279-e46f866e133e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:57.561907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ac6494-c437-43a7-8279-e46f866e133e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:57.562662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ac6494-c437-43a7-8279-e46f866e133e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:57.563214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ac6494-c437-43a7-8279-e46f866e133e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:57.563636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ac6494-c437-43a7-8279-e46f866e133e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:57.691482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b3ac6494-c437-43a7-8279-e46f866e133e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:57.699575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b3ac6494-c437-43a7-8279-e46f866e133e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.148895 Sep 02 09:36:57.700130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 223/445] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:57 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:58.014270 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4675020c-927b-4bbf-828a-98767e17b8cc tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:58.014904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4675020c-927b-4bbf-828a-98767e17b8cc tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:58.021402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4675020c-927b-4bbf-828a-98767e17b8cc tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:58.023289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4675020c-927b-4bbf-828a-98767e17b8cc tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:58.023289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4675020c-927b-4bbf-828a-98767e17b8cc tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:58.023289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4675020c-927b-4bbf-828a-98767e17b8cc tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:58.023571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4675020c-927b-4bbf-828a-98767e17b8cc tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:58.023892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4675020c-927b-4bbf-828a-98767e17b8cc tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:58.050234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4675020c-927b-4bbf-828a-98767e17b8cc tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:36:58.063786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:36:58.270484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4675020c-927b-4bbf-828a-98767e17b8cc tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 204 len: 0 microversion: 2.1 time: 0.260238 Sep 02 09:36:58.271095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 223/446] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:36:58 2022] DELETE /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:36:58.279202 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0221890c-ecc3-4b4e-a9a5-8d52a7fc7c9c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:58.279800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0221890c-ecc3-4b4e-a9a5-8d52a7fc7c9c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:58.286127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0221890c-ecc3-4b4e-a9a5-8d52a7fc7c9c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:58.286611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0221890c-ecc3-4b4e-a9a5-8d52a7fc7c9c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:58.287081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0221890c-ecc3-4b4e-a9a5-8d52a7fc7c9c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:58.288052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0221890c-ecc3-4b4e-a9a5-8d52a7fc7c9c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:58.288287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0221890c-ecc3-4b4e-a9a5-8d52a7fc7c9c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:58.288615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0221890c-ecc3-4b4e-a9a5-8d52a7fc7c9c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:58.418488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0221890c-ecc3-4b4e-a9a5-8d52a7fc7c9c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:58.426164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0221890c-ecc3-4b4e-a9a5-8d52a7fc7c9c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1502 microversion: 2.1 time: 0.150777 Sep 02 09:36:58.426747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 224/447] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:58 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:58.719975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3dcd8e1b-344d-4824-9c78-ffdb1fa7165c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:58.721224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3dcd8e1b-344d-4824-9c78-ffdb1fa7165c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:58.727148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dcd8e1b-344d-4824-9c78-ffdb1fa7165c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:58.727636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dcd8e1b-344d-4824-9c78-ffdb1fa7165c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:58.728084 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dcd8e1b-344d-4824-9c78-ffdb1fa7165c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:58.728768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dcd8e1b-344d-4824-9c78-ffdb1fa7165c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:58.729224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dcd8e1b-344d-4824-9c78-ffdb1fa7165c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:58.729653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dcd8e1b-344d-4824-9c78-ffdb1fa7165c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:58.855735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3dcd8e1b-344d-4824-9c78-ffdb1fa7165c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:58.863429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3dcd8e1b-344d-4824-9c78-ffdb1fa7165c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.147944 Sep 02 09:36:58.864001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 224/448] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:58 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:59.446612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b7d6b74b-5d17-47be-b4a4-92cf38a20dd7 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:59.447223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b7d6b74b-5d17-47be-b4a4-92cf38a20dd7 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:59.453626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7d6b74b-5d17-47be-b4a4-92cf38a20dd7 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:59.454106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7d6b74b-5d17-47be-b4a4-92cf38a20dd7 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:59.454543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7d6b74b-5d17-47be-b4a4-92cf38a20dd7 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:59.455263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7d6b74b-5d17-47be-b4a4-92cf38a20dd7 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:59.455717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7d6b74b-5d17-47be-b4a4-92cf38a20dd7 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:59.456142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7d6b74b-5d17-47be-b4a4-92cf38a20dd7 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:59.585655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b7d6b74b-5d17-47be-b4a4-92cf38a20dd7 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:36:59.593292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b7d6b74b-5d17-47be-b4a4-92cf38a20dd7 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1502 microversion: 2.1 time: 0.150646 Sep 02 09:36:59.593850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 225/449] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:59 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:36:59.884335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b57d5849-771e-422a-8c7e-89864d5ce4ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:36:59.884942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b57d5849-771e-422a-8c7e-89864d5ce4ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:36:59.890941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b57d5849-771e-422a-8c7e-89864d5ce4ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:59.891433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b57d5849-771e-422a-8c7e-89864d5ce4ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:59.891867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b57d5849-771e-422a-8c7e-89864d5ce4ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:36:59.892548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b57d5849-771e-422a-8c7e-89864d5ce4ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:36:59.893655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b57d5849-771e-422a-8c7e-89864d5ce4ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:36:59.894079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b57d5849-771e-422a-8c7e-89864d5ce4ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:00.018458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b57d5849-771e-422a-8c7e-89864d5ce4ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:00.025948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b57d5849-771e-422a-8c7e-89864d5ce4ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1318 microversion: 2.1 time: 0.145715 Sep 02 09:37:00.026509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 225/450] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:36:59 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:00.615243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-54816d18-772c-4a56-a7c1-6473a8856b26 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:00.615850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-54816d18-772c-4a56-a7c1-6473a8856b26 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:00.622377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54816d18-772c-4a56-a7c1-6473a8856b26 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:00.622923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54816d18-772c-4a56-a7c1-6473a8856b26 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:00.623398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54816d18-772c-4a56-a7c1-6473a8856b26 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:00.624080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54816d18-772c-4a56-a7c1-6473a8856b26 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:00.624531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54816d18-772c-4a56-a7c1-6473a8856b26 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:00.624950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54816d18-772c-4a56-a7c1-6473a8856b26 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:00.755379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-54816d18-772c-4a56-a7c1-6473a8856b26 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:00.763250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-54816d18-772c-4a56-a7c1-6473a8856b26 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1502 microversion: 2.1 time: 0.152729 Sep 02 09:37:00.763813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 226/451] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:00 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:01.046750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5a2c4b01-8cb5-4c7b-8556-355e522cd689 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:01.047292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5a2c4b01-8cb5-4c7b-8556-355e522cd689 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:01.053918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a2c4b01-8cb5-4c7b-8556-355e522cd689 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:01.054411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a2c4b01-8cb5-4c7b-8556-355e522cd689 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:01.054873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a2c4b01-8cb5-4c7b-8556-355e522cd689 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:01.055593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a2c4b01-8cb5-4c7b-8556-355e522cd689 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:01.056048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a2c4b01-8cb5-4c7b-8556-355e522cd689 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:01.056469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a2c4b01-8cb5-4c7b-8556-355e522cd689 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:01.186906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5a2c4b01-8cb5-4c7b-8556-355e522cd689 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:01.194644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5a2c4b01-8cb5-4c7b-8556-355e522cd689 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1508 microversion: 2.1 time: 0.151859 Sep 02 09:37:01.195239 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 226/452] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:01 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:01.784992 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bd646f7c-b5ef-4fbb-9652-e256cb170010 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:01.785635 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bd646f7c-b5ef-4fbb-9652-e256cb170010 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:01.792179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd646f7c-b5ef-4fbb-9652-e256cb170010 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:01.793149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd646f7c-b5ef-4fbb-9652-e256cb170010 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:01.793637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd646f7c-b5ef-4fbb-9652-e256cb170010 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:01.794320 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd646f7c-b5ef-4fbb-9652-e256cb170010 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:01.794828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd646f7c-b5ef-4fbb-9652-e256cb170010 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:01.795244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd646f7c-b5ef-4fbb-9652-e256cb170010 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:01.933271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bd646f7c-b5ef-4fbb-9652-e256cb170010 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:01.941086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bd646f7c-b5ef-4fbb-9652-e256cb170010 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1502 microversion: 2.1 time: 0.160496 Sep 02 09:37:01.941633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 227/453] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:01 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:02.478660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-9852482a-40f2-4cc8-b0f0-87e4c3c74555 req-72bb0030-5302-4529-a2e3-fd0221764045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d206d4fc-4472-4b36-b6df-4921c211051d", "name": "network-vif-deleted", "tag": "5fe07c2b-f3ca-4267-8880-bf0958145073"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:37:02.487955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-9852482a-40f2-4cc8-b0f0-87e4c3c74555 req-72bb0030-5302-4529-a2e3-fd0221764045 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:02.488436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-9852482a-40f2-4cc8-b0f0-87e4c3c74555 req-72bb0030-5302-4529-a2e3-fd0221764045 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:02.488864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-9852482a-40f2-4cc8-b0f0-87e4c3c74555 req-72bb0030-5302-4529-a2e3-fd0221764045 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:02.499660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-9852482a-40f2-4cc8-b0f0-87e4c3c74555 req-72bb0030-5302-4529-a2e3-fd0221764045 service nova] Creating event network-vif-deleted:5fe07c2b-f3ca-4267-8880-bf0958145073 for instance d206d4fc-4472-4b36-b6df-4921c211051d on hv-cinder-85083 Sep 02 09:37:02.504991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-9852482a-40f2-4cc8-b0f0-87e4c3c74555 req-72bb0030-5302-4529-a2e3-fd0221764045 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029958 Sep 02 09:37:02.505502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 227/454] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:37:02.965123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:02.965738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:02.988924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:02.989611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:02.990045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:02.991161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:02.991612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:02.992197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:03.034281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:03.035266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:03.035842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:03.036114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lazy-loading 'fault' on Instance uuid d206d4fc-4472-4b36-b6df-4921c211051d {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:37:03.078698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:03.087491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a56cac03-328d-4359-aec1-fc698dc76f61 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 200 len: 1303 microversion: 2.1 time: 0.127687 Sep 02 09:37:03.088057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 228/455] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:02 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:03.525867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e5205d9b-bf37-4b7d-be3e-aecb45140164 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:37:03.532284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5205d9b-bf37-4b7d-be3e-aecb45140164 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:03.532762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5205d9b-bf37-4b7d-be3e-aecb45140164 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:03.533221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5205d9b-bf37-4b7d-be3e-aecb45140164 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:03.598362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e5205d9b-bf37-4b7d-be3e-aecb45140164 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Going to try to stop instance {{(pid=127531) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 02 09:37:03.802012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e5205d9b-bf37-4b7d-be3e-aecb45140164 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "POST /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/action" status: 202 len: 0 microversion: 2.1 time: 0.280113 Sep 02 09:37:03.802638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 228/456] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 09:37:03 2022] POST /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:37:03.811959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b6ffab9c-8e8c-4339-b13a-3bf8d287e35d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:03.820657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b6ffab9c-8e8c-4339-b13a-3bf8d287e35d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:03.826852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6ffab9c-8e8c-4339-b13a-3bf8d287e35d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:03.827342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6ffab9c-8e8c-4339-b13a-3bf8d287e35d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:03.827783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6ffab9c-8e8c-4339-b13a-3bf8d287e35d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:03.828481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6ffab9c-8e8c-4339-b13a-3bf8d287e35d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:03.828938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6ffab9c-8e8c-4339-b13a-3bf8d287e35d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:03.829363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6ffab9c-8e8c-4339-b13a-3bf8d287e35d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:03.965071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b6ffab9c-8e8c-4339-b13a-3bf8d287e35d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:03.967292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:03.974026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b6ffab9c-8e8c-4339-b13a-3bf8d287e35d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.165975 Sep 02 09:37:03.974578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 229/457] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:03 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:04.109207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:04.109900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: d206d4fc-4472-4b36-b6df-4921c211051d] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:04.116670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:04.117152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:04.117586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:04.118270 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:04.118739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:04.119166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:04.134292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] HTTP exception thrown: Instance d206d4fc-4472-4b36-b6df-4921c211051d could not be found. Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Request method failure captured: Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d HTTP/1.1 Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc6jG4V-ChFqRoLGQ74hjVYwNgn4PYvztbOsCbmjtzZ0GkVyOdMUutN9GOQvDj7lZ7rrv3jjb8z5D39uWH7rSVgqRkYoiksSsoCuRt00wAUIxBFP4ozKpRUlMc_IzitIhuBFTgbVVkzC6AKJuqWIhrqzq_59EXkmSYgMoYthC0Zn3Rg Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: aa4bc1ecdf7543ea9777b69428329986 Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesActionsTest-184803632 Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:37:04.136262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa4bc1ecdf7543ea9777b69428329986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa4bc1ecdf7543ea9777b69428329986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa4bc1ecdf7543ea9777b69428329986"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa4bc1ecdf7543ea9777b69428329986", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesActionsTest-184803632 Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: aa4bc1ecdf7543ea9777b69428329986 Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesActionsTest-184803632 Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesActionsTest-184803632-project Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: a9c034fcd0ed4825b5661a7bc3d37719 Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesActionsTest-184803632-project Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance d206d4fc-4472-4b36-b6df-4921c211051d could not be found. Sep 02 09:37:04.137835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'd206d4fc-4472-4b36-b6df-4921c211051d'} Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d206d4fc-4472-4b36-b6df-4921c211051d could not be found. Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:37:04.138792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d206d4fc-4472-4b36-b6df-4921c211051d could not be found. Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d206d4fc-4472-4b36-b6df-4921c211051d could not be found. Sep 02 09:37:04.140474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:37:04.141865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Returning 404 to user: Instance d206d4fc-4472-4b36-b6df-4921c211051d could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:37:04.141865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d249d832-ce51-4a28-9df8-6a17114413dd tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d" status: 404 len: 111 microversion: 2.1 time: 0.032671 Sep 02 09:37:04.141865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 229/458] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:04 2022] GET /compute/v2.1/servers/d206d4fc-4472-4b36-b6df-4921c211051d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:37:04.248096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-861486643", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "networks": [{"uuid": "6ecff31c-e278-4e1c-9b6e-53dacab1210c"}]}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:37:04.301989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.network.neutron [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] validate_networks() for [('6ecff31c-e278-4e1c-9b6e-53dacab1210c', None, None, None, None, None)] {{(pid=127533) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 09:37:04.654122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Flavor limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 09:37:04.654547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Image limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 09:37:04.655091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Flavor pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 09:37:04.655500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Image pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 09:37:04.655915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 09:37:04.664651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:04.665131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:04.665565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:04.666285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:04.666770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:04.667210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:04.684881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Getting quotas for project aa4bc1ecdf7543ea9777b69428329986. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:37:04.688848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Getting quotas for user a9c034fcd0ed4825b5661a7bc3d37719 and project aa4bc1ecdf7543ea9777b69428329986. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:37:04.700239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Going to run 1 instances... {{(pid=127533) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 09:37:04.702524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127533) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 09:37:04.822815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a9d2442e-cdf7-440b-be44-039e9d59c364 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578841 Sep 02 09:37:04.823584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 230/459] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 09:37:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 09:37:04.834848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-241c7d89-1a14-4982-8866-f8ff04dad413 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:04.836411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-241c7d89-1a14-4982-8866-f8ff04dad413 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:04.914140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-241c7d89-1a14-4982-8866-f8ff04dad413 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:04.921087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-241c7d89-1a14-4982-8866-f8ff04dad413 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1213 microversion: 2.1 time: 0.090918 Sep 02 09:37:04.921642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 230/460] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:04 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:04.995196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-71237cda-ef61-47ac-80cb-680892503798 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:04.995810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-71237cda-ef61-47ac-80cb-680892503798 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:05.005061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71237cda-ef61-47ac-80cb-680892503798 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:05.006034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71237cda-ef61-47ac-80cb-680892503798 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:05.006768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71237cda-ef61-47ac-80cb-680892503798 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:05.007877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71237cda-ef61-47ac-80cb-680892503798 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:05.008491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71237cda-ef61-47ac-80cb-680892503798 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:05.009071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71237cda-ef61-47ac-80cb-680892503798 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:05.157281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-71237cda-ef61-47ac-80cb-680892503798 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:05.165875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-71237cda-ef61-47ac-80cb-680892503798 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.174585 Sep 02 09:37:05.166436 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 231/461] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:04 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:37:05.941487 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b0f011d6-51df-4429-9d09-b5bf72693927 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:05.942664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b0f011d6-51df-4429-9d09-b5bf72693927 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:05.949516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0f011d6-51df-4429-9d09-b5bf72693927 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:05.950005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0f011d6-51df-4429-9d09-b5bf72693927 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:05.950441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0f011d6-51df-4429-9d09-b5bf72693927 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:05.951152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0f011d6-51df-4429-9d09-b5bf72693927 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:05.951611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0f011d6-51df-4429-9d09-b5bf72693927 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:05.952093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0f011d6-51df-4429-9d09-b5bf72693927 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:06.014452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b0f011d6-51df-4429-9d09-b5bf72693927 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:06.023159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b0f011d6-51df-4429-9d09-b5bf72693927 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1217 microversion: 2.1 time: 0.085356 Sep 02 09:37:06.023770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 231/462] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:05 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:06.187035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e1cf4c38-1f2d-487d-9623-b761756fde8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:06.187644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e1cf4c38-1f2d-487d-9623-b761756fde8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:06.194795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c38-1f2d-487d-9623-b761756fde8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:06.195292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c38-1f2d-487d-9623-b761756fde8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:06.195782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c38-1f2d-487d-9623-b761756fde8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:06.196473 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c38-1f2d-487d-9623-b761756fde8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:06.196928 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c38-1f2d-487d-9623-b761756fde8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:06.197352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1cf4c38-1f2d-487d-9623-b761756fde8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:06.335341 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e1cf4c38-1f2d-487d-9623-b761756fde8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:06.343645 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e1cf4c38-1f2d-487d-9623-b761756fde8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.160586 Sep 02 09:37:06.344270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 232/463] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:06 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:07.043943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2d87f428-45f5-46cd-9a9a-60d983d305d6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:07.044556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2d87f428-45f5-46cd-9a9a-60d983d305d6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:07.050637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d87f428-45f5-46cd-9a9a-60d983d305d6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:07.051156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d87f428-45f5-46cd-9a9a-60d983d305d6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:07.051599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d87f428-45f5-46cd-9a9a-60d983d305d6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:07.052284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d87f428-45f5-46cd-9a9a-60d983d305d6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:07.052735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d87f428-45f5-46cd-9a9a-60d983d305d6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:07.053159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d87f428-45f5-46cd-9a9a-60d983d305d6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:07.114149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2d87f428-45f5-46cd-9a9a-60d983d305d6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:07.121836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2d87f428-45f5-46cd-9a9a-60d983d305d6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1265 microversion: 2.1 time: 0.081801 Sep 02 09:37:07.122393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 232/464] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:07 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:07.366129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-32471597-8678-4cd5-88f3-6fafa98fc004 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:07.366725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-32471597-8678-4cd5-88f3-6fafa98fc004 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:07.373135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32471597-8678-4cd5-88f3-6fafa98fc004 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:07.373629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32471597-8678-4cd5-88f3-6fafa98fc004 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:07.374066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32471597-8678-4cd5-88f3-6fafa98fc004 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:07.374777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32471597-8678-4cd5-88f3-6fafa98fc004 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:07.375237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32471597-8678-4cd5-88f3-6fafa98fc004 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:07.375696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32471597-8678-4cd5-88f3-6fafa98fc004 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:07.514912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-32471597-8678-4cd5-88f3-6fafa98fc004 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:07.524637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-32471597-8678-4cd5-88f3-6fafa98fc004 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.163215 Sep 02 09:37:07.525546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 233/465] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:07 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:08.143642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1f80e691-0d61-4d5c-a173-7ec9d208cc53 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:08.144259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1f80e691-0d61-4d5c-a173-7ec9d208cc53 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:08.151005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f80e691-0d61-4d5c-a173-7ec9d208cc53 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:08.151480 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f80e691-0d61-4d5c-a173-7ec9d208cc53 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:08.151905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f80e691-0d61-4d5c-a173-7ec9d208cc53 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:08.152575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f80e691-0d61-4d5c-a173-7ec9d208cc53 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:08.153017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f80e691-0d61-4d5c-a173-7ec9d208cc53 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:08.153432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f80e691-0d61-4d5c-a173-7ec9d208cc53 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:08.393323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1f80e691-0d61-4d5c-a173-7ec9d208cc53 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:08.402752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1f80e691-0d61-4d5c-a173-7ec9d208cc53 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1313 microversion: 2.1 time: 0.263028 Sep 02 09:37:08.403499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 233/466] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:08 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:08.547232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-eed682c6-d575-4188-a38f-999cd0d93bf8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:08.547879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-eed682c6-d575-4188-a38f-999cd0d93bf8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:08.555674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed682c6-d575-4188-a38f-999cd0d93bf8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:08.559438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed682c6-d575-4188-a38f-999cd0d93bf8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:08.559438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed682c6-d575-4188-a38f-999cd0d93bf8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:08.559438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed682c6-d575-4188-a38f-999cd0d93bf8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:08.559438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed682c6-d575-4188-a38f-999cd0d93bf8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:08.559809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eed682c6-d575-4188-a38f-999cd0d93bf8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:08.700076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eed682c6-d575-4188-a38f-999cd0d93bf8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:08.710197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-eed682c6-d575-4188-a38f-999cd0d93bf8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.166825 Sep 02 09:37:08.711106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 234/467] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:08 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:09.246906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-5f8bd501-89ae-4eb7-a6a7-c4d8a94a02d7 req-da31ed5f-8b5c-4b19-ba8a-29ec1b372c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adfebd12-b9af-43a2-86f8-7208f1039507", "tag": "f5d2e6d2-1108-43fe-b4ba-2d4925fa0e35"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:37:09.257433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-5f8bd501-89ae-4eb7-a6a7-c4d8a94a02d7 req-da31ed5f-8b5c-4b19-ba8a-29ec1b372c9c service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:09.258322 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-5f8bd501-89ae-4eb7-a6a7-c4d8a94a02d7 req-da31ed5f-8b5c-4b19-ba8a-29ec1b372c9c service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:09.258770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-5f8bd501-89ae-4eb7-a6a7-c4d8a94a02d7 req-da31ed5f-8b5c-4b19-ba8a-29ec1b372c9c service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:09.270214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-5f8bd501-89ae-4eb7-a6a7-c4d8a94a02d7 req-da31ed5f-8b5c-4b19-ba8a-29ec1b372c9c service nova] Creating event network-changed:f5d2e6d2-1108-43fe-b4ba-2d4925fa0e35 for instance adfebd12-b9af-43a2-86f8-7208f1039507 on hv-cinder-85083 Sep 02 09:37:09.275534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-5f8bd501-89ae-4eb7-a6a7-c4d8a94a02d7 req-da31ed5f-8b5c-4b19-ba8a-29ec1b372c9c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033638 Sep 02 09:37:09.276199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 234/468] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:37:09.425500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e5cd4d5d-ad25-4bbc-a034-c8deea468b12 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:09.426173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e5cd4d5d-ad25-4bbc-a034-c8deea468b12 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:09.432631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5cd4d5d-ad25-4bbc-a034-c8deea468b12 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:09.433153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5cd4d5d-ad25-4bbc-a034-c8deea468b12 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:09.433595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5cd4d5d-ad25-4bbc-a034-c8deea468b12 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:09.434280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5cd4d5d-ad25-4bbc-a034-c8deea468b12 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:09.434794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5cd4d5d-ad25-4bbc-a034-c8deea468b12 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:09.435177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5cd4d5d-ad25-4bbc-a034-c8deea468b12 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:09.570473 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e5cd4d5d-ad25-4bbc-a034-c8deea468b12 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:09.578213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e5cd4d5d-ad25-4bbc-a034-c8deea468b12 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1313 microversion: 2.1 time: 0.156725 Sep 02 09:37:09.578799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 235/469] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:09 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:09.732428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c893820f-3128-48d1-b000-d212b3f53740 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:09.733167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c893820f-3128-48d1-b000-d212b3f53740 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:09.739567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c893820f-3128-48d1-b000-d212b3f53740 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:09.740129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c893820f-3128-48d1-b000-d212b3f53740 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:09.740580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c893820f-3128-48d1-b000-d212b3f53740 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:09.741274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c893820f-3128-48d1-b000-d212b3f53740 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:09.741737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c893820f-3128-48d1-b000-d212b3f53740 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:09.742180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c893820f-3128-48d1-b000-d212b3f53740 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:09.982203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c893820f-3128-48d1-b000-d212b3f53740 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:09.992724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c893820f-3128-48d1-b000-d212b3f53740 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.263750 Sep 02 09:37:09.993203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 235/470] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:09 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:37:10.599458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7940995f-a8b1-4efb-8cb6-7de54db77ef6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:10.599990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7940995f-a8b1-4efb-8cb6-7de54db77ef6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:10.607263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7940995f-a8b1-4efb-8cb6-7de54db77ef6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:10.607751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7940995f-a8b1-4efb-8cb6-7de54db77ef6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:10.608220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7940995f-a8b1-4efb-8cb6-7de54db77ef6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:10.608912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7940995f-a8b1-4efb-8cb6-7de54db77ef6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:10.609378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7940995f-a8b1-4efb-8cb6-7de54db77ef6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:10.609810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7940995f-a8b1-4efb-8cb6-7de54db77ef6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:10.741845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7940995f-a8b1-4efb-8cb6-7de54db77ef6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:10.749431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7940995f-a8b1-4efb-8cb6-7de54db77ef6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1313 microversion: 2.1 time: 0.153931 Sep 02 09:37:10.749991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 236/471] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:10 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:11.014507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-abf3d8a5-9008-4368-9215-9461649ba9a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:11.015072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-abf3d8a5-9008-4368-9215-9461649ba9a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:11.020939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abf3d8a5-9008-4368-9215-9461649ba9a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:11.021421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abf3d8a5-9008-4368-9215-9461649ba9a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:11.021854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abf3d8a5-9008-4368-9215-9461649ba9a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:11.022545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abf3d8a5-9008-4368-9215-9461649ba9a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:11.023028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abf3d8a5-9008-4368-9215-9461649ba9a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:11.024078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abf3d8a5-9008-4368-9215-9461649ba9a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:11.161437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-abf3d8a5-9008-4368-9215-9461649ba9a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:11.170352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-abf3d8a5-9008-4368-9215-9461649ba9a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.159855 Sep 02 09:37:11.170945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 236/472] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:11 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:11.771121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-72718717-2039-43d8-9392-1628c5d2244e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:11.771642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-72718717-2039-43d8-9392-1628c5d2244e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:11.778676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72718717-2039-43d8-9392-1628c5d2244e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:11.779185 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72718717-2039-43d8-9392-1628c5d2244e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:11.779615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72718717-2039-43d8-9392-1628c5d2244e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:11.780296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72718717-2039-43d8-9392-1628c5d2244e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:11.780866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72718717-2039-43d8-9392-1628c5d2244e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:11.781289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72718717-2039-43d8-9392-1628c5d2244e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:11.918301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-72718717-2039-43d8-9392-1628c5d2244e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:11.926096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-72718717-2039-43d8-9392-1628c5d2244e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1313 microversion: 2.1 time: 0.159017 Sep 02 09:37:11.926665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 237/473] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:11 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:12.191749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-811b5444-c52c-4ae4-9c3f-50fad51fab36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:12.192391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-811b5444-c52c-4ae4-9c3f-50fad51fab36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:12.198515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-811b5444-c52c-4ae4-9c3f-50fad51fab36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:12.199028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-811b5444-c52c-4ae4-9c3f-50fad51fab36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:12.199483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-811b5444-c52c-4ae4-9c3f-50fad51fab36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:12.200236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-811b5444-c52c-4ae4-9c3f-50fad51fab36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:12.200685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-811b5444-c52c-4ae4-9c3f-50fad51fab36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:12.201101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-811b5444-c52c-4ae4-9c3f-50fad51fab36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:12.331126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-811b5444-c52c-4ae4-9c3f-50fad51fab36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:12.340383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-811b5444-c52c-4ae4-9c3f-50fad51fab36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.152555 Sep 02 09:37:12.340972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 237/474] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:12 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:12.947552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-93f545cf-de4a-4049-82da-83ca3efeb85a tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:12.948153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-93f545cf-de4a-4049-82da-83ca3efeb85a tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:12.954421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93f545cf-de4a-4049-82da-83ca3efeb85a tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:12.955003 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93f545cf-de4a-4049-82da-83ca3efeb85a tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:12.955434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93f545cf-de4a-4049-82da-83ca3efeb85a tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:12.956114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93f545cf-de4a-4049-82da-83ca3efeb85a tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:12.956561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93f545cf-de4a-4049-82da-83ca3efeb85a tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:12.956978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93f545cf-de4a-4049-82da-83ca3efeb85a tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:13.094096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-93f545cf-de4a-4049-82da-83ca3efeb85a tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:13.101810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-93f545cf-de4a-4049-82da-83ca3efeb85a tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1313 microversion: 2.1 time: 0.158688 Sep 02 09:37:13.102381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 238/475] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:12 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:13.361663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0512c125-e4fc-4006-9be8-ff209b7f200f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:13.362279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0512c125-e4fc-4006-9be8-ff209b7f200f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:13.368812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0512c125-e4fc-4006-9be8-ff209b7f200f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:13.369295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0512c125-e4fc-4006-9be8-ff209b7f200f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:13.369734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0512c125-e4fc-4006-9be8-ff209b7f200f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:13.370418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0512c125-e4fc-4006-9be8-ff209b7f200f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:13.370915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0512c125-e4fc-4006-9be8-ff209b7f200f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:13.371344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0512c125-e4fc-4006-9be8-ff209b7f200f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:13.498984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0512c125-e4fc-4006-9be8-ff209b7f200f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:13.507229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0512c125-e4fc-4006-9be8-ff209b7f200f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.149423 Sep 02 09:37:13.508403 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 238/476] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:13 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:14.122091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dae50718-786c-4b1e-88a9-1846987c974c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:14.122746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dae50718-786c-4b1e-88a9-1846987c974c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:14.129149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dae50718-786c-4b1e-88a9-1846987c974c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:14.129633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dae50718-786c-4b1e-88a9-1846987c974c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:14.130074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dae50718-786c-4b1e-88a9-1846987c974c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:14.130780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dae50718-786c-4b1e-88a9-1846987c974c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:14.131237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dae50718-786c-4b1e-88a9-1846987c974c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:14.131663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dae50718-786c-4b1e-88a9-1846987c974c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:14.257774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dae50718-786c-4b1e-88a9-1846987c974c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:14.265906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dae50718-786c-4b1e-88a9-1846987c974c tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1313 microversion: 2.1 time: 0.147700 Sep 02 09:37:14.266479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 239/477] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:14 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:14.528869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5e2bad30-aa80-4cfc-be18-739af0645f29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:14.529405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5e2bad30-aa80-4cfc-be18-739af0645f29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:14.535478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e2bad30-aa80-4cfc-be18-739af0645f29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:14.535953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e2bad30-aa80-4cfc-be18-739af0645f29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:14.536384 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e2bad30-aa80-4cfc-be18-739af0645f29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:14.537058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e2bad30-aa80-4cfc-be18-739af0645f29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:14.537504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e2bad30-aa80-4cfc-be18-739af0645f29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:14.537922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5e2bad30-aa80-4cfc-be18-739af0645f29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:14.663398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5e2bad30-aa80-4cfc-be18-739af0645f29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:14.672087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5e2bad30-aa80-4cfc-be18-739af0645f29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.147151 Sep 02 09:37:14.672647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 239/478] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:14 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:15.286882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-08cffe2e-44c4-48a1-b6e4-c54973e79cdf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:15.287496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-08cffe2e-44c4-48a1-b6e4-c54973e79cdf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:15.289859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:15.290527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=6 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:15.295815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08cffe2e-44c4-48a1-b6e4-c54973e79cdf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:15.310857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08cffe2e-44c4-48a1-b6e4-c54973e79cdf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:15.310857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08cffe2e-44c4-48a1-b6e4-c54973e79cdf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:15.310857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08cffe2e-44c4-48a1-b6e4-c54973e79cdf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:15.310857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08cffe2e-44c4-48a1-b6e4-c54973e79cdf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:15.311275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08cffe2e-44c4-48a1-b6e4-c54973e79cdf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:15.432441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-08cffe2e-44c4-48a1-b6e4-c54973e79cdf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:15.440584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-08cffe2e-44c4-48a1-b6e4-c54973e79cdf tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1313 microversion: 2.1 time: 0.157647 Sep 02 09:37:15.441256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 240/479] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:15 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:15.502195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-ceb3f1bf-92bc-440a-84dc-082262a93a5f req-0abae7cd-5646-48b3-8cb6-9734cb998033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfebd12-b9af-43a2-86f8-7208f1039507", "name": "network-vif-plugged", "status": "completed", "tag": "f5d2e6d2-1108-43fe-b4ba-2d4925fa0e35"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:37:15.507470 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:15.512998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ceb3f1bf-92bc-440a-84dc-082262a93a5f req-0abae7cd-5646-48b3-8cb6-9734cb998033 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:15.513480 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ceb3f1bf-92bc-440a-84dc-082262a93a5f req-0abae7cd-5646-48b3-8cb6-9734cb998033 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:15.513910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ceb3f1bf-92bc-440a-84dc-082262a93a5f req-0abae7cd-5646-48b3-8cb6-9734cb998033 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:15.525075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-ceb3f1bf-92bc-440a-84dc-082262a93a5f req-0abae7cd-5646-48b3-8cb6-9734cb998033 service nova] Creating event network-vif-plugged:f5d2e6d2-1108-43fe-b4ba-2d4925fa0e35 for instance adfebd12-b9af-43a2-86f8-7208f1039507 on hv-cinder-85083 Sep 02 09:37:15.530023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-ceb3f1bf-92bc-440a-84dc-082262a93a5f req-0abae7cd-5646-48b3-8cb6-9734cb998033 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Sep 02 09:37:15.530690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 240/480] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:37:15.693850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-253cbea6-88a7-4e58-9e5f-b753aed398eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:15.694393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-253cbea6-88a7-4e58-9e5f-b753aed398eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:15.700425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-253cbea6-88a7-4e58-9e5f-b753aed398eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:15.700915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-253cbea6-88a7-4e58-9e5f-b753aed398eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:15.701352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-253cbea6-88a7-4e58-9e5f-b753aed398eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:15.702040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-253cbea6-88a7-4e58-9e5f-b753aed398eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:15.702501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-253cbea6-88a7-4e58-9e5f-b753aed398eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:15.702956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-253cbea6-88a7-4e58-9e5f-b753aed398eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:15.833103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-253cbea6-88a7-4e58-9e5f-b753aed398eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:15.842085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-253cbea6-88a7-4e58-9e5f-b753aed398eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.152563 Sep 02 09:37:15.842652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 241/481] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:15 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:16.462317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8bd87c0c-9e72-47a6-adc9-ea3d6dbdf18d tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:16.463043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8bd87c0c-9e72-47a6-adc9-ea3d6dbdf18d tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:16.469182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bd87c0c-9e72-47a6-adc9-ea3d6dbdf18d tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:16.469658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bd87c0c-9e72-47a6-adc9-ea3d6dbdf18d tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:16.470085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bd87c0c-9e72-47a6-adc9-ea3d6dbdf18d tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:16.470780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bd87c0c-9e72-47a6-adc9-ea3d6dbdf18d tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:16.471231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bd87c0c-9e72-47a6-adc9-ea3d6dbdf18d tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:16.471648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8bd87c0c-9e72-47a6-adc9-ea3d6dbdf18d tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:16.600525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8bd87c0c-9e72-47a6-adc9-ea3d6dbdf18d tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:16.603482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:16.609479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8bd87c0c-9e72-47a6-adc9-ea3d6dbdf18d tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1313 microversion: 2.1 time: 0.152188 Sep 02 09:37:16.610047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 241/482] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:16 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:16.864012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-64669959-2437-4535-95c1-cdabaf219037 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:16.864629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-64669959-2437-4535-95c1-cdabaf219037 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:16.872627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64669959-2437-4535-95c1-cdabaf219037 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:16.873388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64669959-2437-4535-95c1-cdabaf219037 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:16.873916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64669959-2437-4535-95c1-cdabaf219037 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:16.874628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64669959-2437-4535-95c1-cdabaf219037 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:16.875648 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64669959-2437-4535-95c1-cdabaf219037 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:16.876311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64669959-2437-4535-95c1-cdabaf219037 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:17.009332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-64669959-2437-4535-95c1-cdabaf219037 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:17.017542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-64669959-2437-4535-95c1-cdabaf219037 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.157447 Sep 02 09:37:17.018111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 242/483] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:16 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:17.630369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-868717eb-a368-4e6a-b551-61922998b86e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:17.631006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-868717eb-a368-4e6a-b551-61922998b86e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:17.637617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-868717eb-a368-4e6a-b551-61922998b86e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:17.638106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-868717eb-a368-4e6a-b551-61922998b86e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:17.638835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-868717eb-a368-4e6a-b551-61922998b86e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:17.639523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-868717eb-a368-4e6a-b551-61922998b86e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:17.639981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-868717eb-a368-4e6a-b551-61922998b86e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:17.640409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-868717eb-a368-4e6a-b551-61922998b86e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:17.768724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-868717eb-a368-4e6a-b551-61922998b86e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:17.776388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-868717eb-a368-4e6a-b551-61922998b86e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1313 microversion: 2.1 time: 0.150360 Sep 02 09:37:17.776944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 242/484] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:17 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:18.038786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5999dcee-6746-4c27-9a65-e5bf3165eae4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:18.039316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5999dcee-6746-4c27-9a65-e5bf3165eae4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:18.045731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5999dcee-6746-4c27-9a65-e5bf3165eae4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:18.046212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5999dcee-6746-4c27-9a65-e5bf3165eae4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:18.046784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5999dcee-6746-4c27-9a65-e5bf3165eae4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:18.047474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5999dcee-6746-4c27-9a65-e5bf3165eae4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:18.047922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5999dcee-6746-4c27-9a65-e5bf3165eae4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:18.048340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5999dcee-6746-4c27-9a65-e5bf3165eae4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:18.173738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5999dcee-6746-4c27-9a65-e5bf3165eae4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:18.182478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5999dcee-6746-4c27-9a65-e5bf3165eae4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.147855 Sep 02 09:37:18.183078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 243/485] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:18 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:18.796631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a5ac0ccf-86da-4bc4-8660-588ed99b831f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:18.797235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a5ac0ccf-86da-4bc4-8660-588ed99b831f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:18.803311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5ac0ccf-86da-4bc4-8660-588ed99b831f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:18.803792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5ac0ccf-86da-4bc4-8660-588ed99b831f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:18.804220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5ac0ccf-86da-4bc4-8660-588ed99b831f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:18.804892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5ac0ccf-86da-4bc4-8660-588ed99b831f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:18.805831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5ac0ccf-86da-4bc4-8660-588ed99b831f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:18.806247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a5ac0ccf-86da-4bc4-8660-588ed99b831f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:18.934788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a5ac0ccf-86da-4bc4-8660-588ed99b831f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:18.942345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a5ac0ccf-86da-4bc4-8660-588ed99b831f tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1496 microversion: 2.1 time: 0.149561 Sep 02 09:37:18.942937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 243/486] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:18 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:19.202478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f5973585-9f1f-4280-b867-66b3c9623438 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:19.203123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f5973585-9f1f-4280-b867-66b3c9623438 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:19.209472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5973585-9f1f-4280-b867-66b3c9623438 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:19.209956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5973585-9f1f-4280-b867-66b3c9623438 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:19.210393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5973585-9f1f-4280-b867-66b3c9623438 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:19.211110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5973585-9f1f-4280-b867-66b3c9623438 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:19.211569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5973585-9f1f-4280-b867-66b3c9623438 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:19.211997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5973585-9f1f-4280-b867-66b3c9623438 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:19.342639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f5973585-9f1f-4280-b867-66b3c9623438 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:19.350791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f5973585-9f1f-4280-b867-66b3c9623438 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.152237 Sep 02 09:37:19.351496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 244/487] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:19 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:20.010811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-14e9d4da-3976-4c1f-823d-3f25ac0210a6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:20.011301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-14e9d4da-3976-4c1f-823d-3f25ac0210a6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:20.017114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14e9d4da-3976-4c1f-823d-3f25ac0210a6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:20.017592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14e9d4da-3976-4c1f-823d-3f25ac0210a6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:20.018022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14e9d4da-3976-4c1f-823d-3f25ac0210a6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:20.018694 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14e9d4da-3976-4c1f-823d-3f25ac0210a6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:20.019162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14e9d4da-3976-4c1f-823d-3f25ac0210a6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:20.019580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14e9d4da-3976-4c1f-823d-3f25ac0210a6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:20.046387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-14e9d4da-3976-4c1f-823d-3f25ac0210a6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:37:20.363871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-14e9d4da-3976-4c1f-823d-3f25ac0210a6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "DELETE /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 204 len: 0 microversion: 2.1 time: 0.356865 Sep 02 09:37:20.364455 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 244/488] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:37:20 2022] DELETE /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:37:20.372737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6bd039de-7894-4593-8634-09b16924e047 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:20.373810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6bd039de-7894-4593-8634-09b16924e047 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:20.373934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b4d17251-3eba-436b-a902-ad6dc8e8d15b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:20.374149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b4d17251-3eba-436b-a902-ad6dc8e8d15b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:20.380021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4d17251-3eba-436b-a902-ad6dc8e8d15b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:20.380501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4d17251-3eba-436b-a902-ad6dc8e8d15b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:20.380612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd039de-7894-4593-8634-09b16924e047 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:20.380934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4d17251-3eba-436b-a902-ad6dc8e8d15b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:20.381048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd039de-7894-4593-8634-09b16924e047 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:20.381426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd039de-7894-4593-8634-09b16924e047 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:20.381617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4d17251-3eba-436b-a902-ad6dc8e8d15b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:20.382066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4d17251-3eba-436b-a902-ad6dc8e8d15b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:20.382173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd039de-7894-4593-8634-09b16924e047 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:20.382485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4d17251-3eba-436b-a902-ad6dc8e8d15b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:20.382583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd039de-7894-4593-8634-09b16924e047 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:20.383077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd039de-7894-4593-8634-09b16924e047 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:20.514002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b4d17251-3eba-436b-a902-ad6dc8e8d15b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:20.516777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6bd039de-7894-4593-8634-09b16924e047 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:20.521749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b4d17251-3eba-436b-a902-ad6dc8e8d15b tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1502 microversion: 2.1 time: 0.152277 Sep 02 09:37:20.522326 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 245/489] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:20 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:20.525149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6bd039de-7894-4593-8634-09b16924e047 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.156811 Sep 02 09:37:20.525716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 245/490] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:20 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:21.542061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f67419bd-c359-400f-b35b-d4d60847e393 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:21.542675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f67419bd-c359-400f-b35b-d4d60847e393 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:21.545165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5db17a21-255d-4445-ace8-e093bf478af0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:21.545807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5db17a21-255d-4445-ace8-e093bf478af0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:21.548812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f67419bd-c359-400f-b35b-d4d60847e393 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:21.549297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f67419bd-c359-400f-b35b-d4d60847e393 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:21.549728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f67419bd-c359-400f-b35b-d4d60847e393 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:21.550407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f67419bd-c359-400f-b35b-d4d60847e393 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:21.550885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f67419bd-c359-400f-b35b-d4d60847e393 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:21.551310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f67419bd-c359-400f-b35b-d4d60847e393 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:21.552106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17a21-255d-4445-ace8-e093bf478af0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:21.552592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17a21-255d-4445-ace8-e093bf478af0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:21.553028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17a21-255d-4445-ace8-e093bf478af0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:21.553711 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17a21-255d-4445-ace8-e093bf478af0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:21.554166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17a21-255d-4445-ace8-e093bf478af0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:21.554742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5db17a21-255d-4445-ace8-e093bf478af0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:21.681717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5db17a21-255d-4445-ace8-e093bf478af0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:21.684219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f67419bd-c359-400f-b35b-d4d60847e393 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:21.690326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5db17a21-255d-4445-ace8-e093bf478af0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.149027 Sep 02 09:37:21.690923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 246/491] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:21 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:37:21.692313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f67419bd-c359-400f-b35b-d4d60847e393 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1502 microversion: 2.1 time: 0.153908 Sep 02 09:37:21.692882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 246/492] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:21 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:22.712024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7b06f02a-9393-46ff-afb2-d4af915086c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:22.712619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9cdd0031-02ac-44f4-83cc-08eb2bf24507 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:22.712980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7b06f02a-9393-46ff-afb2-d4af915086c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:22.713218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9cdd0031-02ac-44f4-83cc-08eb2bf24507 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:22.715192 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:22.719152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b06f02a-9393-46ff-afb2-d4af915086c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:22.719638 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b06f02a-9393-46ff-afb2-d4af915086c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:22.719860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cdd0031-02ac-44f4-83cc-08eb2bf24507 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:22.720076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b06f02a-9393-46ff-afb2-d4af915086c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:22.720343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cdd0031-02ac-44f4-83cc-08eb2bf24507 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:22.720764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b06f02a-9393-46ff-afb2-d4af915086c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:22.720862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cdd0031-02ac-44f4-83cc-08eb2bf24507 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:22.721273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b06f02a-9393-46ff-afb2-d4af915086c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:22.721437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cdd0031-02ac-44f4-83cc-08eb2bf24507 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:22.721702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b06f02a-9393-46ff-afb2-d4af915086c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:22.721997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cdd0031-02ac-44f4-83cc-08eb2bf24507 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:22.722417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9cdd0031-02ac-44f4-83cc-08eb2bf24507 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:22.725674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:22.856240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9cdd0031-02ac-44f4-83cc-08eb2bf24507 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:22.857413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7b06f02a-9393-46ff-afb2-d4af915086c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:22.864147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9cdd0031-02ac-44f4-83cc-08eb2bf24507 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1502 microversion: 2.1 time: 0.155206 Sep 02 09:37:22.864706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 247/493] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:22 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:37:22.865647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7b06f02a-9393-46ff-afb2-d4af915086c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.157490 Sep 02 09:37:22.866211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 247/494] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:22 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:23.472066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-08a609a4-7da3-4eeb-8901-76d71f3e36b0 req-8d506880-5b26-497d-911f-62ef3c04af53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfebd12-b9af-43a2-86f8-7208f1039507", "name": "network-vif-deleted", "tag": "f5d2e6d2-1108-43fe-b4ba-2d4925fa0e35"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:37:23.481806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-08a609a4-7da3-4eeb-8901-76d71f3e36b0 req-8d506880-5b26-497d-911f-62ef3c04af53 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:23.482274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-08a609a4-7da3-4eeb-8901-76d71f3e36b0 req-8d506880-5b26-497d-911f-62ef3c04af53 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:23.482697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-08a609a4-7da3-4eeb-8901-76d71f3e36b0 req-8d506880-5b26-497d-911f-62ef3c04af53 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:23.494302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-08a609a4-7da3-4eeb-8901-76d71f3e36b0 req-8d506880-5b26-497d-911f-62ef3c04af53 service nova] Creating event network-vif-deleted:f5d2e6d2-1108-43fe-b4ba-2d4925fa0e35 for instance adfebd12-b9af-43a2-86f8-7208f1039507 on hv-cinder-85083 Sep 02 09:37:23.499127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-08a609a4-7da3-4eeb-8901-76d71f3e36b0 req-8d506880-5b26-497d-911f-62ef3c04af53 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030708 Sep 02 09:37:23.499705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 248/495] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:37:23.885574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:23.886185 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:23.887762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-13e21fe6-056d-4249-866b-9d512fde24a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:23.888451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-13e21fe6-056d-4249-866b-9d512fde24a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:23.892913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:23.895640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:23.895640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:23.895640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:23.895953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13e21fe6-056d-4249-866b-9d512fde24a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:23.896058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:23.896158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13e21fe6-056d-4249-866b-9d512fde24a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:23.896158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13e21fe6-056d-4249-866b-9d512fde24a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:23.896339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:23.896432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13e21fe6-056d-4249-866b-9d512fde24a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:23.896744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13e21fe6-056d-4249-866b-9d512fde24a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:23.897193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-13e21fe6-056d-4249-866b-9d512fde24a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:23.931622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:23.932127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:23.932565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:23.933011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lazy-loading 'fault' on Instance uuid adfebd12-b9af-43a2-86f8-7208f1039507 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:37:23.979426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c034fcd0ed4825b5661a7bc3d37719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4bc1ecdf7543ea9777b69428329986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:23.990120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-891f8b89-5d1f-4aa8-81d9-f43da7f2335e tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 200 len: 1303 microversion: 2.1 time: 0.108963 Sep 02 09:37:24.001373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 248/496] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:23 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:37:24.040735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-13e21fe6-056d-4249-866b-9d512fde24a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:24.049085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-13e21fe6-056d-4249-866b-9d512fde24a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1721 microversion: 2.1 time: 0.166279 Sep 02 09:37:24.049653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 249/497] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:23 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:37:25.012610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:25.013166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] [instance: adfebd12-b9af-43a2-86f8-7208f1039507] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:25.019900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:25.020380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:25.020811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:25.021730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:25.022286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:25.022588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:25.036691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] HTTP exception thrown: Instance adfebd12-b9af-43a2-86f8-7208f1039507 could not be found. Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Request method failure captured: Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 HTTP/1.1 Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc6jG4V-ChFqRoLGQ74hjVYwNgn4PYvztbOsCbmjtzZ0GkVyOdMUutN9GOQvDj7lZ7rrv3jjb8z5D39uWH7rSVgqRkYoiksSsoCuRt00wAUIxBFP4ozKpRUlMc_IzitIhuBFTgbVVkzC6AKJuqWIhrqzq_59EXkmSYgMoYthC0Zn3Rg Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: aa4bc1ecdf7543ea9777b69428329986 Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesActionsTest-184803632 Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:37:25.038372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa4bc1ecdf7543ea9777b69428329986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aa4bc1ecdf7543ea9777b69428329986"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aa4bc1ecdf7543ea9777b69428329986"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aa4bc1ecdf7543ea9777b69428329986", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesActionsTest-184803632 Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: aa4bc1ecdf7543ea9777b69428329986 Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesActionsTest-184803632 Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesActionsTest-184803632-project Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: a9c034fcd0ed4825b5661a7bc3d37719 Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesActionsTest-184803632-project Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance adfebd12-b9af-43a2-86f8-7208f1039507 could not be found. Sep 02 09:37:25.040052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': 'adfebd12-b9af-43a2-86f8-7208f1039507'} Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adfebd12-b9af-43a2-86f8-7208f1039507 could not be found. Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:37:25.041683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adfebd12-b9af-43a2-86f8-7208f1039507 could not be found. Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adfebd12-b9af-43a2-86f8-7208f1039507 could not be found. Sep 02 09:37:25.043244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:37:25.045049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] Returning 404 to user: Instance adfebd12-b9af-43a2-86f8-7208f1039507 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:37:25.045049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c475f7d4-31bf-4084-a26b-486f70847cd6 tempest-VolumesActionsTest-184803632 tempest-VolumesActionsTest-184803632-project] 10.222.0.57 "GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507" status: 404 len: 111 microversion: 2.1 time: 0.031608 Sep 02 09:37:25.045049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 249/498] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:25 2022] GET /compute/v2.1/servers/adfebd12-b9af-43a2-86f8-7208f1039507 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:37:25.070152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-89ba357a-7255-4ae3-9f9d-cf95a9d987b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:25.070152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-89ba357a-7255-4ae3-9f9d-cf95a9d987b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:25.075777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89ba357a-7255-4ae3-9f9d-cf95a9d987b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:25.076368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89ba357a-7255-4ae3-9f9d-cf95a9d987b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:25.076747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89ba357a-7255-4ae3-9f9d-cf95a9d987b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:25.077427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89ba357a-7255-4ae3-9f9d-cf95a9d987b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:25.078134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89ba357a-7255-4ae3-9f9d-cf95a9d987b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:25.078282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89ba357a-7255-4ae3-9f9d-cf95a9d987b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:25.135976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c43005d0-c4de-423c-b2ea-c9b8ece27feb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb57c32f-94b5-417f-bfad-902604e338b4", "device": "/dev/sdb"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:37:25.139210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c43005d0-c4de-423c-b2ea-c9b8ece27feb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:25.145267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43005d0-c4de-423c-b2ea-c9b8ece27feb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:25.145754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43005d0-c4de-423c-b2ea-c9b8ece27feb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:25.146191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43005d0-c4de-423c-b2ea-c9b8ece27feb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:25.146906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43005d0-c4de-423c-b2ea-c9b8ece27feb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:25.147357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43005d0-c4de-423c-b2ea-c9b8ece27feb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:25.147782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43005d0-c4de-423c-b2ea-c9b8ece27feb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:25.216075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-89ba357a-7255-4ae3-9f9d-cf95a9d987b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:25.224914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-89ba357a-7255-4ae3-9f9d-cf95a9d987b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1698 microversion: 2.1 time: 0.159515 Sep 02 09:37:25.225753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 250/499] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:25.246845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d8d89f59-af30-4722-b297-addb41452961 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:37:25.252842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8d89f59-af30-4722-b297-addb41452961 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:25.253325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8d89f59-af30-4722-b297-addb41452961 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:25.253757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8d89f59-af30-4722-b297-addb41452961 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:25.280220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d8d89f59-af30-4722-b297-addb41452961 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Going to try to start instance {{(pid=127531) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 02 09:37:25.527643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d8d89f59-af30-4722-b297-addb41452961 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "POST /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/action" status: 202 len: 0 microversion: 2.1 time: 0.284519 Sep 02 09:37:25.533197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 251/500] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 09:37:25 2022] POST /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:37:25.536849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c6a61cd5-ea20-4c7d-8ead-49599b4d0dd3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:25.537560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c6a61cd5-ea20-4c7d-8ead-49599b4d0dd3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:25.544277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6a61cd5-ea20-4c7d-8ead-49599b4d0dd3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:25.544770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6a61cd5-ea20-4c7d-8ead-49599b4d0dd3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:25.545205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6a61cd5-ea20-4c7d-8ead-49599b4d0dd3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:25.545898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6a61cd5-ea20-4c7d-8ead-49599b4d0dd3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:25.546346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6a61cd5-ea20-4c7d-8ead-49599b4d0dd3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:25.546818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6a61cd5-ea20-4c7d-8ead-49599b4d0dd3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:25.690692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c6a61cd5-ea20-4c7d-8ead-49599b4d0dd3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:25.699904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c6a61cd5-ea20-4c7d-8ead-49599b4d0dd3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1707 microversion: 2.1 time: 0.167332 Sep 02 09:37:25.700658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 252/501] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1707 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:37:26.067625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c43005d0-c4de-423c-b2ea-c9b8ece27feb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "POST /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.936251 Sep 02 09:37:26.073193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 250/502] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 09:37:25 2022] POST /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:37:26.721678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2fd44925-7a7c-4bf6-800a-94da87feaf84 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:26.722223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2fd44925-7a7c-4bf6-800a-94da87feaf84 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:26.728864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fd44925-7a7c-4bf6-800a-94da87feaf84 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:26.731215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fd44925-7a7c-4bf6-800a-94da87feaf84 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:26.731215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fd44925-7a7c-4bf6-800a-94da87feaf84 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:26.731215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fd44925-7a7c-4bf6-800a-94da87feaf84 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:26.731215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fd44925-7a7c-4bf6-800a-94da87feaf84 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:26.731657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fd44925-7a7c-4bf6-800a-94da87feaf84 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:26.861444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2fd44925-7a7c-4bf6-800a-94da87feaf84 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:26.869554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2fd44925-7a7c-4bf6-800a-94da87feaf84 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1707 microversion: 2.1 time: 0.151871 Sep 02 09:37:26.870787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 253/503] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:26 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1707 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:27.892729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f2339907-8f56-486d-8510-d50938ee2136 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:27.893452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f2339907-8f56-486d-8510-d50938ee2136 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:27.895378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:27.900867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2339907-8f56-486d-8510-d50938ee2136 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:27.901440 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2339907-8f56-486d-8510-d50938ee2136 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:27.901783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2339907-8f56-486d-8510-d50938ee2136 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:27.902469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2339907-8f56-486d-8510-d50938ee2136 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:27.902939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2339907-8f56-486d-8510-d50938ee2136 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:27.909516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2339907-8f56-486d-8510-d50938ee2136 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:28.030581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f2339907-8f56-486d-8510-d50938ee2136 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:28.038747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f2339907-8f56-486d-8510-d50938ee2136 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1707 microversion: 2.1 time: 0.150653 Sep 02 09:37:28.039311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 251/504] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:27 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1707 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:37:29.060052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6eb094cc-8144-48e1-9c98-85ffa66b670a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:29.060661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6eb094cc-8144-48e1-9c98-85ffa66b670a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:29.066627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6eb094cc-8144-48e1-9c98-85ffa66b670a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:29.067154 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6eb094cc-8144-48e1-9c98-85ffa66b670a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:29.067588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6eb094cc-8144-48e1-9c98-85ffa66b670a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:29.068267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6eb094cc-8144-48e1-9c98-85ffa66b670a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:29.068721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6eb094cc-8144-48e1-9c98-85ffa66b670a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:29.069143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6eb094cc-8144-48e1-9c98-85ffa66b670a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:29.305019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6eb094cc-8144-48e1-9c98-85ffa66b670a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:29.313331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6eb094cc-8144-48e1-9c98-85ffa66b670a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1707 microversion: 2.1 time: 0.257648 Sep 02 09:37:29.313888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 254/505] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:29 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1707 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:30.334805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4f8e54f7-45e7-4e92-bf24-4264d3f3b414 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:30.335417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4f8e54f7-45e7-4e92-bf24-4264d3f3b414 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:30.342327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4f8e54f7-45e7-4e92-bf24-4264d3f3b414 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:30.342877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4f8e54f7-45e7-4e92-bf24-4264d3f3b414 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:30.343313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4f8e54f7-45e7-4e92-bf24-4264d3f3b414 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:30.344003 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4f8e54f7-45e7-4e92-bf24-4264d3f3b414 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:30.344454 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4f8e54f7-45e7-4e92-bf24-4264d3f3b414 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:30.344878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4f8e54f7-45e7-4e92-bf24-4264d3f3b414 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:30.526381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4f8e54f7-45e7-4e92-bf24-4264d3f3b414 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:30.534494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4f8e54f7-45e7-4e92-bf24-4264d3f3b414 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1707 microversion: 2.1 time: 0.203536 Sep 02 09:37:30.535111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 252/506] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:30 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1707 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:37:31.469787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aa72a04a-29d6-4e8d-a7a2-1c4936200970 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aefd94e-dc9d-4a48-9b8a-97e273701412"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:37:31.472141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aa72a04a-29d6-4e8d-a7a2-1c4936200970 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:31.478198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa72a04a-29d6-4e8d-a7a2-1c4936200970 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:31.478678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa72a04a-29d6-4e8d-a7a2-1c4936200970 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:31.479134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa72a04a-29d6-4e8d-a7a2-1c4936200970 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:31.479805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa72a04a-29d6-4e8d-a7a2-1c4936200970 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:31.480250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa72a04a-29d6-4e8d-a7a2-1c4936200970 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:31.480666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa72a04a-29d6-4e8d-a7a2-1c4936200970 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:31.556019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c69e4de2-76dd-4467-9bad-1f917aaa678e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:31.556632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c69e4de2-76dd-4467-9bad-1f917aaa678e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:31.563989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c69e4de2-76dd-4467-9bad-1f917aaa678e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:31.564479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c69e4de2-76dd-4467-9bad-1f917aaa678e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:31.564917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c69e4de2-76dd-4467-9bad-1f917aaa678e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:31.565606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c69e4de2-76dd-4467-9bad-1f917aaa678e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:31.566049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c69e4de2-76dd-4467-9bad-1f917aaa678e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:31.566656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c69e4de2-76dd-4467-9bad-1f917aaa678e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:31.695353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c69e4de2-76dd-4467-9bad-1f917aaa678e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:31.704022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c69e4de2-76dd-4467-9bad-1f917aaa678e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1707 microversion: 2.1 time: 0.151917 Sep 02 09:37:31.704578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 253/507] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:31 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1707 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:37:32.200682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:37:32.725203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a82638d7-1c74-424f-b78d-4416c42a9ac4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:37:32.725827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a82638d7-1c74-424f-b78d-4416c42a9ac4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:37:32.732944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a82638d7-1c74-424f-b78d-4416c42a9ac4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:32.733432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a82638d7-1c74-424f-b78d-4416c42a9ac4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:32.733872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a82638d7-1c74-424f-b78d-4416c42a9ac4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:32.734588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a82638d7-1c74-424f-b78d-4416c42a9ac4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:37:32.735086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a82638d7-1c74-424f-b78d-4416c42a9ac4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:37:32.735515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a82638d7-1c74-424f-b78d-4416c42a9ac4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:37:32.774718 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aa72a04a-29d6-4e8d-a7a2-1c4936200970 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.308697 Sep 02 09:37:32.776228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 255/508] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 09:37:31 2022] POST /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 194 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:37:32.876348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a82638d7-1c74-424f-b78d-4416c42a9ac4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:37:32.884707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a82638d7-1c74-424f-b78d-4416c42a9ac4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1711 microversion: 2.1 time: 0.163311 Sep 02 09:37:32.886026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 254/509] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:37:32 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:38:40.419215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:38:40.419806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:38:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments/2e002e4a-ad01-4f0d-bc79-7c25ac6987e3 (ip 10.222.0.57) !!! Sep 02 09:38:40.420337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=17 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:40.421260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=3,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:40.533572 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ae6e15b0-889d-4280-afca-fff250963701 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:40.534155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ae6e15b0-889d-4280-afca-fff250963701 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:40.541358 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ae6e15b0-889d-4280-afca-fff250963701 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:40.541840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ae6e15b0-889d-4280-afca-fff250963701 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:40.542267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ae6e15b0-889d-4280-afca-fff250963701 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:40.542987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ae6e15b0-889d-4280-afca-fff250963701 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:40.543436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ae6e15b0-889d-4280-afca-fff250963701 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:40.543857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ae6e15b0-889d-4280-afca-fff250963701 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:40.665248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-ae6e15b0-889d-4280-afca-fff250963701 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lazy-loading 'services' on Instance uuid ae283fdc-e807-415c-a156-8ec24163c45f {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:38:40.907937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ae6e15b0-889d-4280-afca-fff250963701 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments/2e002e4a-ad01-4f0d-bc79-7c25ac6987e3" status: 202 len: 0 microversion: 2.1 time: 0.490941 Sep 02 09:38:40.911627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 256/510] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:38:40 2022] DELETE /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments/2e002e4a-ad01-4f0d-bc79-7c25ac6987e3 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:38:42.744315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=7 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:42.745058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:38:42.749781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e591bdcc-fa33-4a2c-a64e-639d90fd0ece tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:38:42.752077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e591bdcc-fa33-4a2c-a64e-639d90fd0ece tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:42.758223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e591bdcc-fa33-4a2c-a64e-639d90fd0ece tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:42.760381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e591bdcc-fa33-4a2c-a64e-639d90fd0ece tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:42.760381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e591bdcc-fa33-4a2c-a64e-639d90fd0ece tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:42.760381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e591bdcc-fa33-4a2c-a64e-639d90fd0ece tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:42.760381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e591bdcc-fa33-4a2c-a64e-639d90fd0ece tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:42.760920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e591bdcc-fa33-4a2c-a64e-639d90fd0ece tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:42.784624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-e591bdcc-fa33-4a2c-a64e-639d90fd0ece tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'flavor' on Instance uuid a2bccc75-d837-4a98-8a78-841b2edb8ce5 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:38:43.104906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e591bdcc-fa33-4a2c-a64e-639d90fd0ece tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/action" status: 200 len: 32 microversion: 2.1 time: 0.362061 Sep 02 09:38:43.112596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 255/511] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 09:38:42 2022] POST /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 09:38:43.121582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-42f03247-95d5-46af-80ce-07e873e3a7fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:43.122386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-42f03247-95d5-46af-80ce-07e873e3a7fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:43.128637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f03247-95d5-46af-80ce-07e873e3a7fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:43.129124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f03247-95d5-46af-80ce-07e873e3a7fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:43.129664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f03247-95d5-46af-80ce-07e873e3a7fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:43.130285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f03247-95d5-46af-80ce-07e873e3a7fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:43.130768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f03247-95d5-46af-80ce-07e873e3a7fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:43.131696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f03247-95d5-46af-80ce-07e873e3a7fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:43.269027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-42f03247-95d5-46af-80ce-07e873e3a7fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:43.277309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-42f03247-95d5-46af-80ce-07e873e3a7fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.160453 Sep 02 09:38:43.278205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 257/512] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:38:44.299061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-24463899-7a81-4b1c-b563-a493b871e16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:44.299752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-24463899-7a81-4b1c-b563-a493b871e16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:44.306640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24463899-7a81-4b1c-b563-a493b871e16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:44.307155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24463899-7a81-4b1c-b563-a493b871e16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:44.307587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24463899-7a81-4b1c-b563-a493b871e16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:44.308269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24463899-7a81-4b1c-b563-a493b871e16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:44.308717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24463899-7a81-4b1c-b563-a493b871e16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:44.309134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24463899-7a81-4b1c-b563-a493b871e16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:44.437209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-24463899-7a81-4b1c-b563-a493b871e16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:44.445823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-24463899-7a81-4b1c-b563-a493b871e16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.151016 Sep 02 09:38:44.446394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 256/513] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:45.467086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1ebba2a4-3683-4f2b-854f-7dc2cc88435b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:45.467621 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1ebba2a4-3683-4f2b-854f-7dc2cc88435b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:45.473937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ebba2a4-3683-4f2b-854f-7dc2cc88435b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:45.474418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ebba2a4-3683-4f2b-854f-7dc2cc88435b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:45.475381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ebba2a4-3683-4f2b-854f-7dc2cc88435b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:45.476065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ebba2a4-3683-4f2b-854f-7dc2cc88435b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:45.476518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ebba2a4-3683-4f2b-854f-7dc2cc88435b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:45.476938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ebba2a4-3683-4f2b-854f-7dc2cc88435b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:45.602513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1ebba2a4-3683-4f2b-854f-7dc2cc88435b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:45.610597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1ebba2a4-3683-4f2b-854f-7dc2cc88435b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.147512 Sep 02 09:38:45.611199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 258/514] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:46.632103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5ee06f2e-8ccc-489b-84d5-19f88da2c9b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:46.632709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5ee06f2e-8ccc-489b-84d5-19f88da2c9b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:46.639150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ee06f2e-8ccc-489b-84d5-19f88da2c9b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:46.639636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ee06f2e-8ccc-489b-84d5-19f88da2c9b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:46.640073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ee06f2e-8ccc-489b-84d5-19f88da2c9b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:46.640755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ee06f2e-8ccc-489b-84d5-19f88da2c9b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:46.641203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ee06f2e-8ccc-489b-84d5-19f88da2c9b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:46.641623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ee06f2e-8ccc-489b-84d5-19f88da2c9b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:46.773071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ee06f2e-8ccc-489b-84d5-19f88da2c9b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:46.781469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5ee06f2e-8ccc-489b-84d5-19f88da2c9b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.153720 Sep 02 09:38:46.782062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 257/515] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:47.802404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c5945eb5-8393-4365-80ac-0f74561e8a44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:47.803109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c5945eb5-8393-4365-80ac-0f74561e8a44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:47.810393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5945eb5-8393-4365-80ac-0f74561e8a44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:47.810906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5945eb5-8393-4365-80ac-0f74561e8a44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:47.811337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5945eb5-8393-4365-80ac-0f74561e8a44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:47.812013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5945eb5-8393-4365-80ac-0f74561e8a44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:47.812464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5945eb5-8393-4365-80ac-0f74561e8a44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:47.812881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5945eb5-8393-4365-80ac-0f74561e8a44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:47.941659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c5945eb5-8393-4365-80ac-0f74561e8a44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:47.950438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c5945eb5-8393-4365-80ac-0f74561e8a44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.151886 Sep 02 09:38:47.951043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 259/516] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:48.971678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-68cec37c-16d7-462a-915f-e92cdeccb348 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:49.072258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-68cec37c-16d7-462a-915f-e92cdeccb348 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:49.072258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68cec37c-16d7-462a-915f-e92cdeccb348 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:49.072258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68cec37c-16d7-462a-915f-e92cdeccb348 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:49.072258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68cec37c-16d7-462a-915f-e92cdeccb348 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:49.073339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68cec37c-16d7-462a-915f-e92cdeccb348 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:49.073339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68cec37c-16d7-462a-915f-e92cdeccb348 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:49.073339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68cec37c-16d7-462a-915f-e92cdeccb348 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:49.111902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-68cec37c-16d7-462a-915f-e92cdeccb348 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:49.120040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-68cec37c-16d7-462a-915f-e92cdeccb348 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.152399 Sep 02 09:38:49.120774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 258/517] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:50.141397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7b0aa3ae-8731-4731-9d41-dcc2769717f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:50.142051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7b0aa3ae-8731-4731-9d41-dcc2769717f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:50.149359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0aa3ae-8731-4731-9d41-dcc2769717f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:50.149846 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0aa3ae-8731-4731-9d41-dcc2769717f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:50.150285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0aa3ae-8731-4731-9d41-dcc2769717f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:50.151041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0aa3ae-8731-4731-9d41-dcc2769717f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:50.151500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0aa3ae-8731-4731-9d41-dcc2769717f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:50.151930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0aa3ae-8731-4731-9d41-dcc2769717f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:50.279100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7b0aa3ae-8731-4731-9d41-dcc2769717f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:50.289187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7b0aa3ae-8731-4731-9d41-dcc2769717f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.149610 Sep 02 09:38:50.289187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 260/518] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:51.307784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2aeb07c1-e77c-41df-add7-2c944fad28ca tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:51.308399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2aeb07c1-e77c-41df-add7-2c944fad28ca tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:51.314728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2aeb07c1-e77c-41df-add7-2c944fad28ca tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:51.315242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2aeb07c1-e77c-41df-add7-2c944fad28ca tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:51.315680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2aeb07c1-e77c-41df-add7-2c944fad28ca tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:51.316398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2aeb07c1-e77c-41df-add7-2c944fad28ca tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:51.316859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2aeb07c1-e77c-41df-add7-2c944fad28ca tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:51.317288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2aeb07c1-e77c-41df-add7-2c944fad28ca tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:51.441684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2aeb07c1-e77c-41df-add7-2c944fad28ca tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:51.450477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2aeb07c1-e77c-41df-add7-2c944fad28ca tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.146622 Sep 02 09:38:51.451164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 259/519] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:52.472157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fdd13189-76b5-4dac-a990-edf65dedb167 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:52.472760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fdd13189-76b5-4dac-a990-edf65dedb167 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:52.481659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd13189-76b5-4dac-a990-edf65dedb167 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:52.482136 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd13189-76b5-4dac-a990-edf65dedb167 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:52.482561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd13189-76b5-4dac-a990-edf65dedb167 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:52.483262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd13189-76b5-4dac-a990-edf65dedb167 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:52.483711 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd13189-76b5-4dac-a990-edf65dedb167 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:52.484126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fdd13189-76b5-4dac-a990-edf65dedb167 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:52.613955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fdd13189-76b5-4dac-a990-edf65dedb167 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:52.621981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fdd13189-76b5-4dac-a990-edf65dedb167 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.153640 Sep 02 09:38:52.622537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 261/520] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:53.642840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bd82cfd6-5119-4b17-bf1e-6c2a3e6aeb05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:53.643716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bd82cfd6-5119-4b17-bf1e-6c2a3e6aeb05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:53.650884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd82cfd6-5119-4b17-bf1e-6c2a3e6aeb05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:53.651379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd82cfd6-5119-4b17-bf1e-6c2a3e6aeb05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:53.651824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd82cfd6-5119-4b17-bf1e-6c2a3e6aeb05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:53.652516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd82cfd6-5119-4b17-bf1e-6c2a3e6aeb05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:53.652976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd82cfd6-5119-4b17-bf1e-6c2a3e6aeb05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:53.653405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd82cfd6-5119-4b17-bf1e-6c2a3e6aeb05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:53.783603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bd82cfd6-5119-4b17-bf1e-6c2a3e6aeb05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:53.791729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bd82cfd6-5119-4b17-bf1e-6c2a3e6aeb05 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.152693 Sep 02 09:38:53.792377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 260/521] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:54.813226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-442d9319-f6d4-4565-adb0-85161e0b0d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:54.813858 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-442d9319-f6d4-4565-adb0-85161e0b0d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:54.821095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-442d9319-f6d4-4565-adb0-85161e0b0d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:54.821586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-442d9319-f6d4-4565-adb0-85161e0b0d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:54.822017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-442d9319-f6d4-4565-adb0-85161e0b0d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:54.822730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-442d9319-f6d4-4565-adb0-85161e0b0d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:54.823194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-442d9319-f6d4-4565-adb0-85161e0b0d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:54.823641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-442d9319-f6d4-4565-adb0-85161e0b0d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:54.953862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-442d9319-f6d4-4565-adb0-85161e0b0d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:54.961994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-442d9319-f6d4-4565-adb0-85161e0b0d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.152662 Sep 02 09:38:54.962547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 262/522] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:55.981884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7a5a580d-90c2-4465-a891-76e5d122fe13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:55.982534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7a5a580d-90c2-4465-a891-76e5d122fe13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:55.988986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a5a580d-90c2-4465-a891-76e5d122fe13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:55.989471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a5a580d-90c2-4465-a891-76e5d122fe13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:55.989909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a5a580d-90c2-4465-a891-76e5d122fe13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:55.990596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a5a580d-90c2-4465-a891-76e5d122fe13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:55.991077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a5a580d-90c2-4465-a891-76e5d122fe13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:55.991500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a5a580d-90c2-4465-a891-76e5d122fe13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:56.115956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7a5a580d-90c2-4465-a891-76e5d122fe13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:56.124597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7a5a580d-90c2-4465-a891-76e5d122fe13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.146538 Sep 02 09:38:56.125163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 261/523] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:57.146410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-527fe2cd-ed1f-402b-9dbb-92d401774682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:57.147046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-527fe2cd-ed1f-402b-9dbb-92d401774682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:57.154174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-527fe2cd-ed1f-402b-9dbb-92d401774682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:57.154653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-527fe2cd-ed1f-402b-9dbb-92d401774682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:57.155113 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-527fe2cd-ed1f-402b-9dbb-92d401774682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:57.155789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-527fe2cd-ed1f-402b-9dbb-92d401774682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:57.156238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-527fe2cd-ed1f-402b-9dbb-92d401774682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:57.156654 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-527fe2cd-ed1f-402b-9dbb-92d401774682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:57.283437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-527fe2cd-ed1f-402b-9dbb-92d401774682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:57.291410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-527fe2cd-ed1f-402b-9dbb-92d401774682 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.149077 Sep 02 09:38:57.291980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 263/524] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:58.312543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-24112c8c-7d25-4f26-88f7-71792d45a4e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:58.313149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-24112c8c-7d25-4f26-88f7-71792d45a4e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:58.319695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24112c8c-7d25-4f26-88f7-71792d45a4e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:58.320174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24112c8c-7d25-4f26-88f7-71792d45a4e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:58.320607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24112c8c-7d25-4f26-88f7-71792d45a4e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:58.321287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24112c8c-7d25-4f26-88f7-71792d45a4e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:58.321768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24112c8c-7d25-4f26-88f7-71792d45a4e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:58.322193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24112c8c-7d25-4f26-88f7-71792d45a4e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:58.452632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-24112c8c-7d25-4f26-88f7-71792d45a4e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:58.460912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-24112c8c-7d25-4f26-88f7-71792d45a4e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.152038 Sep 02 09:38:58.461477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 262/525] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:38:59.482493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-73df68fe-512a-498d-a70f-5b98017eccbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:38:59.483061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-73df68fe-512a-498d-a70f-5b98017eccbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:38:59.489390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73df68fe-512a-498d-a70f-5b98017eccbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:59.489869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73df68fe-512a-498d-a70f-5b98017eccbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:59.490298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73df68fe-512a-498d-a70f-5b98017eccbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:59.491007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73df68fe-512a-498d-a70f-5b98017eccbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:38:59.491460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73df68fe-512a-498d-a70f-5b98017eccbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:38:59.491882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73df68fe-512a-498d-a70f-5b98017eccbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:38:59.620118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-73df68fe-512a-498d-a70f-5b98017eccbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:38:59.628284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-73df68fe-512a-498d-a70f-5b98017eccbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.150216 Sep 02 09:38:59.628852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 264/526] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:38:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:00.649492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-67137d16-ec3a-4b21-b956-4d11a7902f09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:00.650595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-67137d16-ec3a-4b21-b956-4d11a7902f09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:00.657051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67137d16-ec3a-4b21-b956-4d11a7902f09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:00.657682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67137d16-ec3a-4b21-b956-4d11a7902f09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:00.658125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67137d16-ec3a-4b21-b956-4d11a7902f09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:00.658841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67137d16-ec3a-4b21-b956-4d11a7902f09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:00.659290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67137d16-ec3a-4b21-b956-4d11a7902f09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:00.659711 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67137d16-ec3a-4b21-b956-4d11a7902f09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:00.786777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67137d16-ec3a-4b21-b956-4d11a7902f09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:00.795688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-67137d16-ec3a-4b21-b956-4d11a7902f09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.150050 Sep 02 09:39:00.796280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 263/527] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:01.816727 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e571fb7b-02ea-4668-bb39-ce483d21f002 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:01.817338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e571fb7b-02ea-4668-bb39-ce483d21f002 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:01.823277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e571fb7b-02ea-4668-bb39-ce483d21f002 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:01.823755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e571fb7b-02ea-4668-bb39-ce483d21f002 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:01.824215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e571fb7b-02ea-4668-bb39-ce483d21f002 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:01.824892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e571fb7b-02ea-4668-bb39-ce483d21f002 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:01.825343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e571fb7b-02ea-4668-bb39-ce483d21f002 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:01.825763 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e571fb7b-02ea-4668-bb39-ce483d21f002 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:01.955714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e571fb7b-02ea-4668-bb39-ce483d21f002 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:01.964227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e571fb7b-02ea-4668-bb39-ce483d21f002 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.151483 Sep 02 09:39:01.964782 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 265/528] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:02.985563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-003bcb53-a01d-4dc5-b309-60caca10d5fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:02.986163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-003bcb53-a01d-4dc5-b309-60caca10d5fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:02.992522 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-003bcb53-a01d-4dc5-b309-60caca10d5fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:02.998155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-003bcb53-a01d-4dc5-b309-60caca10d5fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:02.998155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-003bcb53-a01d-4dc5-b309-60caca10d5fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:02.998155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-003bcb53-a01d-4dc5-b309-60caca10d5fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:02.998155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-003bcb53-a01d-4dc5-b309-60caca10d5fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:02.998639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-003bcb53-a01d-4dc5-b309-60caca10d5fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:03.128142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-003bcb53-a01d-4dc5-b309-60caca10d5fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:03.139343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-003bcb53-a01d-4dc5-b309-60caca10d5fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.155178 Sep 02 09:39:03.139343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 264/529] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:04.158510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-723ae77e-1db8-499b-afe0-ecfe96b4136c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:04.159128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-723ae77e-1db8-499b-afe0-ecfe96b4136c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:04.165679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-723ae77e-1db8-499b-afe0-ecfe96b4136c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:04.166651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-723ae77e-1db8-499b-afe0-ecfe96b4136c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:04.167107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-723ae77e-1db8-499b-afe0-ecfe96b4136c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:04.167793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-723ae77e-1db8-499b-afe0-ecfe96b4136c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:04.168244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-723ae77e-1db8-499b-afe0-ecfe96b4136c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:04.168666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-723ae77e-1db8-499b-afe0-ecfe96b4136c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:04.301388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-723ae77e-1db8-499b-afe0-ecfe96b4136c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:04.309520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-723ae77e-1db8-499b-afe0-ecfe96b4136c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1715 microversion: 2.1 time: 0.154831 Sep 02 09:39:04.310087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 266/530] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:04.369222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:04.369705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:04.376290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:04.376772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:04.377231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:04.377997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:04.378468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:04.378928 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:04.501393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Cannot 'detach_volume' instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 while it is in vm_state rescued Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 HTTP/1.1 Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:39:04.503052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:39:04.504477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Cannot 'detach_volume' instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 while it is in vm_state rescued Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'server_id': 'a2bccc75-d837-4a98-8a78-841b2edb8ce5', 'id': '6aefd94e-dc9d-4a48-9b8a-97e273701412'} Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:39:04.505180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 while it is in vm_state rescued Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 while it is in vm_state rescued Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:39:04.506550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 409 to user: Cannot 'detach_volume' instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 while it is in vm_state rescued {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:39:04.507588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6d3b7d97-9524-45da-bf27-7484505fa308 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412" status: 409 len: 152 microversion: 2.1 time: 0.139508 Sep 02 09:39:04.507588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 265/531] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:39:04 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 09:39:04.513327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cd16aa95-1ca2-4076-9caf-51f56d841c4e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:39:04.513851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cd16aa95-1ca2-4076-9caf-51f56d841c4e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:04.519960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd16aa95-1ca2-4076-9caf-51f56d841c4e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:04.520437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd16aa95-1ca2-4076-9caf-51f56d841c4e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:04.520866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd16aa95-1ca2-4076-9caf-51f56d841c4e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:04.521536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd16aa95-1ca2-4076-9caf-51f56d841c4e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:04.521983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd16aa95-1ca2-4076-9caf-51f56d841c4e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:04.522400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd16aa95-1ca2-4076-9caf-51f56d841c4e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:04.777219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cd16aa95-1ca2-4076-9caf-51f56d841c4e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/action" status: 202 len: 0 microversion: 2.1 time: 0.267385 Sep 02 09:39:04.777768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 267/532] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 09:39:04 2022] POST /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:39:04.789380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-07e9bc73-7113-41db-b943-25151309d81b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:04.790042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-07e9bc73-7113-41db-b943-25151309d81b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:04.796093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-07e9bc73-7113-41db-b943-25151309d81b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:04.796582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-07e9bc73-7113-41db-b943-25151309d81b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:04.797012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-07e9bc73-7113-41db-b943-25151309d81b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:04.797704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-07e9bc73-7113-41db-b943-25151309d81b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:04.798154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-07e9bc73-7113-41db-b943-25151309d81b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:04.798574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-07e9bc73-7113-41db-b943-25151309d81b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:04.933722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-07e9bc73-7113-41db-b943-25151309d81b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:04.942264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-07e9bc73-7113-41db-b943-25151309d81b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1723 microversion: 2.1 time: 0.160085 Sep 02 09:39:04.946743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 266/533] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:05.965723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4ad21677-4907-455b-a77d-7c7b51cbc221 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:05.966415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4ad21677-4907-455b-a77d-7c7b51cbc221 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:05.972487 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ad21677-4907-455b-a77d-7c7b51cbc221 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:05.972973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ad21677-4907-455b-a77d-7c7b51cbc221 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:05.973406 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ad21677-4907-455b-a77d-7c7b51cbc221 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:05.974096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ad21677-4907-455b-a77d-7c7b51cbc221 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:05.974553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ad21677-4907-455b-a77d-7c7b51cbc221 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:05.975003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ad21677-4907-455b-a77d-7c7b51cbc221 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:06.104130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4ad21677-4907-455b-a77d-7c7b51cbc221 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:06.112284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4ad21677-4907-455b-a77d-7c7b51cbc221 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1723 microversion: 2.1 time: 0.151708 Sep 02 09:39:06.112848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 268/534] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:07.133029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f790f490-ada9-4b9b-96b0-353ed9655742 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:07.133666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f790f490-ada9-4b9b-96b0-353ed9655742 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:07.140231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f790f490-ada9-4b9b-96b0-353ed9655742 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:07.140745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f790f490-ada9-4b9b-96b0-353ed9655742 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:07.141183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f790f490-ada9-4b9b-96b0-353ed9655742 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:07.141866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f790f490-ada9-4b9b-96b0-353ed9655742 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:07.142315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f790f490-ada9-4b9b-96b0-353ed9655742 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:07.142754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f790f490-ada9-4b9b-96b0-353ed9655742 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:07.269824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f790f490-ada9-4b9b-96b0-353ed9655742 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:07.278541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f790f490-ada9-4b9b-96b0-353ed9655742 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1723 microversion: 2.1 time: 0.149376 Sep 02 09:39:07.279127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 267/535] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:08.300396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b2da81b4-cf37-47b1-a4de-34f09438c0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:08.300926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b2da81b4-cf37-47b1-a4de-34f09438c0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:08.307804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da81b4-cf37-47b1-a4de-34f09438c0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:08.308290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da81b4-cf37-47b1-a4de-34f09438c0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:08.308731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da81b4-cf37-47b1-a4de-34f09438c0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:08.309413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da81b4-cf37-47b1-a4de-34f09438c0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:08.309871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da81b4-cf37-47b1-a4de-34f09438c0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:08.310299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b2da81b4-cf37-47b1-a4de-34f09438c0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:08.444874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b2da81b4-cf37-47b1-a4de-34f09438c0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:08.453101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b2da81b4-cf37-47b1-a4de-34f09438c0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1723 microversion: 2.1 time: 0.156649 Sep 02 09:39:08.453650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 269/536] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:09.473381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0452e789-3f78-4d64-837a-6e82c6b0ba87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:09.473998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0452e789-3f78-4d64-837a-6e82c6b0ba87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:09.480083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0452e789-3f78-4d64-837a-6e82c6b0ba87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:09.480429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0452e789-3f78-4d64-837a-6e82c6b0ba87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:09.481031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0452e789-3f78-4d64-837a-6e82c6b0ba87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:09.481553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0452e789-3f78-4d64-837a-6e82c6b0ba87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:09.482006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0452e789-3f78-4d64-837a-6e82c6b0ba87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:09.482430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0452e789-3f78-4d64-837a-6e82c6b0ba87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:09.611172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0452e789-3f78-4d64-837a-6e82c6b0ba87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:09.619272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0452e789-3f78-4d64-837a-6e82c6b0ba87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1729 microversion: 2.1 time: 0.149879 Sep 02 09:39:09.620279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 268/537] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:09.640651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fab82ca7-0fcd-45e6-96cf-5b035243c192 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:09.641235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fab82ca7-0fcd-45e6-96cf-5b035243c192 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:09.647858 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab82ca7-0fcd-45e6-96cf-5b035243c192 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:09.648342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab82ca7-0fcd-45e6-96cf-5b035243c192 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:09.648781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab82ca7-0fcd-45e6-96cf-5b035243c192 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:09.649471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab82ca7-0fcd-45e6-96cf-5b035243c192 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:09.649926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab82ca7-0fcd-45e6-96cf-5b035243c192 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:09.650354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fab82ca7-0fcd-45e6-96cf-5b035243c192 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:09.724839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fab82ca7-0fcd-45e6-96cf-5b035243c192 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088052 Sep 02 09:39:09.725438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 270/538] 10.222.0.57 () {58 vars in 1275 bytes} [Fri Sep 2 09:39:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:39:10.765470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-c1c2af60-46b1-413c-896b-05792c4ae934 req-04f0ef5c-8e17-4de7-acdd-80c63c803ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bccc75-d837-4a98-8a78-841b2edb8ce5", "tag": "72e00e01-0226-481d-9c3e-f109d75f21d1"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:39:10.775199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-c1c2af60-46b1-413c-896b-05792c4ae934 req-04f0ef5c-8e17-4de7-acdd-80c63c803ea5 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:10.775754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-c1c2af60-46b1-413c-896b-05792c4ae934 req-04f0ef5c-8e17-4de7-acdd-80c63c803ea5 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:10.776257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-c1c2af60-46b1-413c-896b-05792c4ae934 req-04f0ef5c-8e17-4de7-acdd-80c63c803ea5 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:10.787619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-c1c2af60-46b1-413c-896b-05792c4ae934 req-04f0ef5c-8e17-4de7-acdd-80c63c803ea5 service nova] Creating event network-changed:72e00e01-0226-481d-9c3e-f109d75f21d1 for instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 on hv-cinder-85083 Sep 02 09:39:10.793321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-c1c2af60-46b1-413c-896b-05792c4ae934 req-04f0ef5c-8e17-4de7-acdd-80c63c803ea5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094429 Sep 02 09:39:10.794006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 269/539] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:39:11.189561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-534552e8-3cca-48d5-9501-9ef16128a5c3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:11.190951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-534552e8-3cca-48d5-9501-9ef16128a5c3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:11.197071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=31 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:11.198651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534552e8-3cca-48d5-9501-9ef16128a5c3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:11.199341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534552e8-3cca-48d5-9501-9ef16128a5c3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:11.199745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534552e8-3cca-48d5-9501-9ef16128a5c3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:11.200440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534552e8-3cca-48d5-9501-9ef16128a5c3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:11.201007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534552e8-3cca-48d5-9501-9ef16128a5c3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:11.201433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534552e8-3cca-48d5-9501-9ef16128a5c3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:11.207428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:11.236145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-534552e8-3cca-48d5-9501-9ef16128a5c3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:39:11.488078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-534552e8-3cca-48d5-9501-9ef16128a5c3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 204 len: 0 microversion: 2.1 time: 0.302728 Sep 02 09:39:11.488692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 271/540] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:39:11 2022] DELETE /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:39:11.497596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5c1323f4-332e-4e99-9f70-d54eb02912d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:11.499445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5c1323f4-332e-4e99-9f70-d54eb02912d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:11.504779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c1323f4-332e-4e99-9f70-d54eb02912d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:11.505269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c1323f4-332e-4e99-9f70-d54eb02912d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:11.505708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c1323f4-332e-4e99-9f70-d54eb02912d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:11.506406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c1323f4-332e-4e99-9f70-d54eb02912d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:11.506899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c1323f4-332e-4e99-9f70-d54eb02912d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:11.507333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c1323f4-332e-4e99-9f70-d54eb02912d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:11.512109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:11.643431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5c1323f4-332e-4e99-9f70-d54eb02912d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:11.651837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5c1323f4-332e-4e99-9f70-d54eb02912d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1575 microversion: 2.1 time: 0.158753 Sep 02 09:39:11.652400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 270/541] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:11 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:12.674580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a0c35c80-8d7b-4054-a9bf-1dce79521ed4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:12.675407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a0c35c80-8d7b-4054-a9bf-1dce79521ed4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:12.681985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0c35c80-8d7b-4054-a9bf-1dce79521ed4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:12.682469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0c35c80-8d7b-4054-a9bf-1dce79521ed4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:12.682954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0c35c80-8d7b-4054-a9bf-1dce79521ed4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:12.683666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0c35c80-8d7b-4054-a9bf-1dce79521ed4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:12.684127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0c35c80-8d7b-4054-a9bf-1dce79521ed4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:12.684554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0c35c80-8d7b-4054-a9bf-1dce79521ed4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:12.809277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-2551e857-aca7-4369-bff6-facd786f6d1a req-5f7e9fbb-6692-408c-b559-0a0ecacb2d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2bccc75-d837-4a98-8a78-841b2edb8ce5", "tag": "72e00e01-0226-481d-9c3e-f109d75f21d1"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:39:12.814476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=33 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:12.820025 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-2551e857-aca7-4369-bff6-facd786f6d1a req-5f7e9fbb-6692-408c-b559-0a0ecacb2d96 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:12.820538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-2551e857-aca7-4369-bff6-facd786f6d1a req-5f7e9fbb-6692-408c-b559-0a0ecacb2d96 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:12.820676 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a0c35c80-8d7b-4054-a9bf-1dce79521ed4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:12.820974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-2551e857-aca7-4369-bff6-facd786f6d1a req-5f7e9fbb-6692-408c-b559-0a0ecacb2d96 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:12.829012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a0c35c80-8d7b-4054-a9bf-1dce79521ed4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1575 microversion: 2.1 time: 0.159316 Sep 02 09:39:12.829576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 272/542] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:12 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:12.832625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-2551e857-aca7-4369-bff6-facd786f6d1a req-5f7e9fbb-6692-408c-b559-0a0ecacb2d96 service nova] Creating event network-changed:72e00e01-0226-481d-9c3e-f109d75f21d1 for instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 on hv-cinder-85083 Sep 02 09:39:12.837624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-2551e857-aca7-4369-bff6-facd786f6d1a req-5f7e9fbb-6692-408c-b559-0a0ecacb2d96 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032287 Sep 02 09:39:12.838246 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 271/543] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:39:13.858346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-20366eb4-8346-4bec-bf64-44af19c7c688 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:13.859000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-20366eb4-8346-4bec-bf64-44af19c7c688 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:13.865617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20366eb4-8346-4bec-bf64-44af19c7c688 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:13.866429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20366eb4-8346-4bec-bf64-44af19c7c688 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:13.866901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20366eb4-8346-4bec-bf64-44af19c7c688 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:13.867761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20366eb4-8346-4bec-bf64-44af19c7c688 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:13.868410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20366eb4-8346-4bec-bf64-44af19c7c688 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:13.869025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-20366eb4-8346-4bec-bf64-44af19c7c688 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:14.054776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-20366eb4-8346-4bec-bf64-44af19c7c688 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:14.063925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-20366eb4-8346-4bec-bf64-44af19c7c688 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1575 microversion: 2.1 time: 0.210003 Sep 02 09:39:14.064501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 273/544] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:13 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:14.750190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-599f5e38-3d7b-495d-9987-794a245a8227 req-c2be1b07-34fa-4459-b726-de838386d92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c278bb-a399-4a52-bb7a-6d1782711406", "name": "network-vif-deleted", "tag": "992ffb61-2296-4bd8-bec8-1499e9e418f4"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:39:14.761198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-599f5e38-3d7b-495d-9987-794a245a8227 req-c2be1b07-34fa-4459-b726-de838386d92e service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:14.761678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-599f5e38-3d7b-495d-9987-794a245a8227 req-c2be1b07-34fa-4459-b726-de838386d92e service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:14.762119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-599f5e38-3d7b-495d-9987-794a245a8227 req-c2be1b07-34fa-4459-b726-de838386d92e service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:14.776182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-599f5e38-3d7b-495d-9987-794a245a8227 req-c2be1b07-34fa-4459-b726-de838386d92e service nova] Creating event network-vif-deleted:992ffb61-2296-4bd8-bec8-1499e9e418f4 for instance 99c278bb-a399-4a52-bb7a-6d1782711406 on hv-cinder-85083 Sep 02 09:39:14.779169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-599f5e38-3d7b-495d-9987-794a245a8227 req-c2be1b07-34fa-4459-b726-de838386d92e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093881 Sep 02 09:39:14.779864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 272/545] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:39:15.084845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1584a107-b326-4dce-aa8f-b4eed3bf56c9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:15.086071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1584a107-b326-4dce-aa8f-b4eed3bf56c9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:15.092533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1584a107-b326-4dce-aa8f-b4eed3bf56c9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:15.093018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1584a107-b326-4dce-aa8f-b4eed3bf56c9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:15.093453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1584a107-b326-4dce-aa8f-b4eed3bf56c9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:15.094147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1584a107-b326-4dce-aa8f-b4eed3bf56c9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:15.094833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1584a107-b326-4dce-aa8f-b4eed3bf56c9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:15.095262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1584a107-b326-4dce-aa8f-b4eed3bf56c9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:15.160357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1584a107-b326-4dce-aa8f-b4eed3bf56c9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:15.169119 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1584a107-b326-4dce-aa8f-b4eed3bf56c9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.088084 Sep 02 09:39:15.169887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 274/546] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:15 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:16.190479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b322b356-eaa5-4872-bcc3-9cc9e96d7af5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:16.191195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b322b356-eaa5-4872-bcc3-9cc9e96d7af5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:16.197307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b322b356-eaa5-4872-bcc3-9cc9e96d7af5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:16.197789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b322b356-eaa5-4872-bcc3-9cc9e96d7af5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:16.198221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b322b356-eaa5-4872-bcc3-9cc9e96d7af5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:16.198940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b322b356-eaa5-4872-bcc3-9cc9e96d7af5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:16.199389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b322b356-eaa5-4872-bcc3-9cc9e96d7af5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:16.199809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b322b356-eaa5-4872-bcc3-9cc9e96d7af5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:16.264976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b322b356-eaa5-4872-bcc3-9cc9e96d7af5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:16.273175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b322b356-eaa5-4872-bcc3-9cc9e96d7af5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.087408 Sep 02 09:39:16.273742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 273/547] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:16 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:17.294163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ff2b95ed-81f6-424c-a3a5-336da7fc44a9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:17.294793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ff2b95ed-81f6-424c-a3a5-336da7fc44a9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:17.301266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff2b95ed-81f6-424c-a3a5-336da7fc44a9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:17.301744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff2b95ed-81f6-424c-a3a5-336da7fc44a9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:17.302173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff2b95ed-81f6-424c-a3a5-336da7fc44a9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:17.302892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff2b95ed-81f6-424c-a3a5-336da7fc44a9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:17.303346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff2b95ed-81f6-424c-a3a5-336da7fc44a9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:17.303768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff2b95ed-81f6-424c-a3a5-336da7fc44a9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:17.365554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ff2b95ed-81f6-424c-a3a5-336da7fc44a9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:17.373807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ff2b95ed-81f6-424c-a3a5-336da7fc44a9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083499 Sep 02 09:39:17.374364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 275/548] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:17 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:18.393742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bbd30ff6-1f41-48d5-aa3a-d990be4ae47a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:18.394348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bbd30ff6-1f41-48d5-aa3a-d990be4ae47a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:18.401120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bbd30ff6-1f41-48d5-aa3a-d990be4ae47a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:18.401598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bbd30ff6-1f41-48d5-aa3a-d990be4ae47a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:18.402033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bbd30ff6-1f41-48d5-aa3a-d990be4ae47a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:18.402734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bbd30ff6-1f41-48d5-aa3a-d990be4ae47a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:18.403196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bbd30ff6-1f41-48d5-aa3a-d990be4ae47a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:18.403614 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bbd30ff6-1f41-48d5-aa3a-d990be4ae47a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:18.464979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bbd30ff6-1f41-48d5-aa3a-d990be4ae47a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:18.472460 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bbd30ff6-1f41-48d5-aa3a-d990be4ae47a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082537 Sep 02 09:39:18.473023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 274/549] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:18 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:19.493352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-256f0c07-3582-4958-95ce-c42000f4b159 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:19.493877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-256f0c07-3582-4958-95ce-c42000f4b159 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:19.500776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-256f0c07-3582-4958-95ce-c42000f4b159 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:19.501260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-256f0c07-3582-4958-95ce-c42000f4b159 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:19.501695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-256f0c07-3582-4958-95ce-c42000f4b159 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:19.502375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-256f0c07-3582-4958-95ce-c42000f4b159 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:19.502851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-256f0c07-3582-4958-95ce-c42000f4b159 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:19.503274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-256f0c07-3582-4958-95ce-c42000f4b159 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:19.562669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-256f0c07-3582-4958-95ce-c42000f4b159 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:19.570610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-256f0c07-3582-4958-95ce-c42000f4b159 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081146 Sep 02 09:39:19.571221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 276/550] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:19 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:20.591521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-79cb1f12-4796-438d-abee-a9ba0f3cde52 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:20.592182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-79cb1f12-4796-438d-abee-a9ba0f3cde52 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:20.598500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79cb1f12-4796-438d-abee-a9ba0f3cde52 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:20.599010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79cb1f12-4796-438d-abee-a9ba0f3cde52 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:20.599440 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79cb1f12-4796-438d-abee-a9ba0f3cde52 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:20.600118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79cb1f12-4796-438d-abee-a9ba0f3cde52 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:20.600565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79cb1f12-4796-438d-abee-a9ba0f3cde52 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:20.600982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79cb1f12-4796-438d-abee-a9ba0f3cde52 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:20.661387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-79cb1f12-4796-438d-abee-a9ba0f3cde52 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:20.669404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-79cb1f12-4796-438d-abee-a9ba0f3cde52 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081722 Sep 02 09:39:20.669964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 275/551] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:20 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:21.689625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b37eef88-806c-4d8f-93ca-1a81f38fd25c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:21.690266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b37eef88-806c-4d8f-93ca-1a81f38fd25c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:21.696772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37eef88-806c-4d8f-93ca-1a81f38fd25c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:21.697256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37eef88-806c-4d8f-93ca-1a81f38fd25c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:21.697690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37eef88-806c-4d8f-93ca-1a81f38fd25c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:21.698962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37eef88-806c-4d8f-93ca-1a81f38fd25c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:21.699443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37eef88-806c-4d8f-93ca-1a81f38fd25c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:21.699868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37eef88-806c-4d8f-93ca-1a81f38fd25c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:21.758860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b37eef88-806c-4d8f-93ca-1a81f38fd25c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:21.767034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b37eef88-806c-4d8f-93ca-1a81f38fd25c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081256 Sep 02 09:39:21.767590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 277/552] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:21 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:22.787509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-09166026-54bc-4766-bec7-02d8a913cd39 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:22.788030 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-09166026-54bc-4766-bec7-02d8a913cd39 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:22.795041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09166026-54bc-4766-bec7-02d8a913cd39 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:22.795695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09166026-54bc-4766-bec7-02d8a913cd39 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:22.796119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09166026-54bc-4766-bec7-02d8a913cd39 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:22.796965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09166026-54bc-4766-bec7-02d8a913cd39 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:22.797427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09166026-54bc-4766-bec7-02d8a913cd39 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:22.797857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09166026-54bc-4766-bec7-02d8a913cd39 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:22.858914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-09166026-54bc-4766-bec7-02d8a913cd39 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:22.866517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-09166026-54bc-4766-bec7-02d8a913cd39 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082941 Sep 02 09:39:22.867117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 276/553] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:22 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:23.887905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d75a68b2-1530-4fda-9c41-ccb06e0606d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:23.888511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d75a68b2-1530-4fda-9c41-ccb06e0606d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:23.894943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d75a68b2-1530-4fda-9c41-ccb06e0606d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:23.895678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d75a68b2-1530-4fda-9c41-ccb06e0606d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:23.896109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d75a68b2-1530-4fda-9c41-ccb06e0606d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:23.896786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d75a68b2-1530-4fda-9c41-ccb06e0606d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:23.897251 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d75a68b2-1530-4fda-9c41-ccb06e0606d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:23.897656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d75a68b2-1530-4fda-9c41-ccb06e0606d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:23.957106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d75a68b2-1530-4fda-9c41-ccb06e0606d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:23.964864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d75a68b2-1530-4fda-9c41-ccb06e0606d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081507 Sep 02 09:39:23.965438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 278/554] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:23 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:24.985570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fe309eeb-0d09-412b-a445-6b172b5f69c4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:24.986178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fe309eeb-0d09-412b-a445-6b172b5f69c4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:24.992821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe309eeb-0d09-412b-a445-6b172b5f69c4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:24.993305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe309eeb-0d09-412b-a445-6b172b5f69c4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:24.993738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe309eeb-0d09-412b-a445-6b172b5f69c4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:24.994418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe309eeb-0d09-412b-a445-6b172b5f69c4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:24.994919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe309eeb-0d09-412b-a445-6b172b5f69c4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:24.995374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe309eeb-0d09-412b-a445-6b172b5f69c4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:25.057822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fe309eeb-0d09-412b-a445-6b172b5f69c4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:25.065379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fe309eeb-0d09-412b-a445-6b172b5f69c4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083879 Sep 02 09:39:25.065968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 277/555] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:24 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:26.086635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-684f60ed-a185-40f9-abdf-ee12b8b0c4f3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:26.087279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-684f60ed-a185-40f9-abdf-ee12b8b0c4f3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:26.093854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-684f60ed-a185-40f9-abdf-ee12b8b0c4f3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:26.094338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-684f60ed-a185-40f9-abdf-ee12b8b0c4f3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:26.094808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-684f60ed-a185-40f9-abdf-ee12b8b0c4f3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:26.095500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-684f60ed-a185-40f9-abdf-ee12b8b0c4f3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:26.095951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-684f60ed-a185-40f9-abdf-ee12b8b0c4f3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:26.096420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-684f60ed-a185-40f9-abdf-ee12b8b0c4f3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:26.158476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-684f60ed-a185-40f9-abdf-ee12b8b0c4f3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:26.166112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-684f60ed-a185-40f9-abdf-ee12b8b0c4f3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083503 Sep 02 09:39:26.166677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 279/556] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:26 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:27.186799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c89010ad-1975-4919-8e03-e68c149c7792 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:27.187327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c89010ad-1975-4919-8e03-e68c149c7792 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:27.193666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c89010ad-1975-4919-8e03-e68c149c7792 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:27.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c89010ad-1975-4919-8e03-e68c149c7792 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:27.194592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c89010ad-1975-4919-8e03-e68c149c7792 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:27.195299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c89010ad-1975-4919-8e03-e68c149c7792 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:27.195753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c89010ad-1975-4919-8e03-e68c149c7792 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:27.196182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c89010ad-1975-4919-8e03-e68c149c7792 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:27.257107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c89010ad-1975-4919-8e03-e68c149c7792 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:27.265330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c89010ad-1975-4919-8e03-e68c149c7792 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082542 Sep 02 09:39:27.265893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 278/557] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:27 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:28.286760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-32c53c76-02fe-42f4-abd9-1072090af6b4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:28.287372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-32c53c76-02fe-42f4-abd9-1072090af6b4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:28.294343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32c53c76-02fe-42f4-abd9-1072090af6b4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:28.294847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32c53c76-02fe-42f4-abd9-1072090af6b4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:28.295287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32c53c76-02fe-42f4-abd9-1072090af6b4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:28.295962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32c53c76-02fe-42f4-abd9-1072090af6b4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:28.296412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32c53c76-02fe-42f4-abd9-1072090af6b4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:28.296831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32c53c76-02fe-42f4-abd9-1072090af6b4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:28.356581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-32c53c76-02fe-42f4-abd9-1072090af6b4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:28.364113 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-32c53c76-02fe-42f4-abd9-1072090af6b4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081218 Sep 02 09:39:28.364673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 280/558] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:28 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:29.384315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7ce662f9-911f-47d0-89c6-1f88a0c449bf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:29.384930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7ce662f9-911f-47d0-89c6-1f88a0c449bf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:29.391397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ce662f9-911f-47d0-89c6-1f88a0c449bf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:29.391883 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ce662f9-911f-47d0-89c6-1f88a0c449bf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:29.392323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ce662f9-911f-47d0-89c6-1f88a0c449bf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:29.393038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ce662f9-911f-47d0-89c6-1f88a0c449bf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:29.393499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ce662f9-911f-47d0-89c6-1f88a0c449bf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:29.393923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ce662f9-911f-47d0-89c6-1f88a0c449bf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:29.453503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7ce662f9-911f-47d0-89c6-1f88a0c449bf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:29.461065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7ce662f9-911f-47d0-89c6-1f88a0c449bf tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080626 Sep 02 09:39:29.461626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 279/559] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:29 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:30.481390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6fc8fdd8-2038-4dca-81dd-7b52c9003dfb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:30.481981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6fc8fdd8-2038-4dca-81dd-7b52c9003dfb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:30.488366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6fc8fdd8-2038-4dca-81dd-7b52c9003dfb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:30.488892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6fc8fdd8-2038-4dca-81dd-7b52c9003dfb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:30.489325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6fc8fdd8-2038-4dca-81dd-7b52c9003dfb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:30.490009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6fc8fdd8-2038-4dca-81dd-7b52c9003dfb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:30.490461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6fc8fdd8-2038-4dca-81dd-7b52c9003dfb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:30.490921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6fc8fdd8-2038-4dca-81dd-7b52c9003dfb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:30.550241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6fc8fdd8-2038-4dca-81dd-7b52c9003dfb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:30.557757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6fc8fdd8-2038-4dca-81dd-7b52c9003dfb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080300 Sep 02 09:39:30.558317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 281/560] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:30 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:31.579200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1c33cded-2514-4d76-88b3-1c4436f7c975 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:31.579748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1c33cded-2514-4d76-88b3-1c4436f7c975 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:31.586065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c33cded-2514-4d76-88b3-1c4436f7c975 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:31.586557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c33cded-2514-4d76-88b3-1c4436f7c975 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:31.587020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c33cded-2514-4d76-88b3-1c4436f7c975 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:31.587705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c33cded-2514-4d76-88b3-1c4436f7c975 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:31.588157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c33cded-2514-4d76-88b3-1c4436f7c975 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:31.588581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c33cded-2514-4d76-88b3-1c4436f7c975 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:31.650999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1c33cded-2514-4d76-88b3-1c4436f7c975 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:31.659380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1c33cded-2514-4d76-88b3-1c4436f7c975 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084666 Sep 02 09:39:31.659943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 280/561] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:31 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:32.679521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-89eb81c6-2002-4020-abc5-512d09a2929c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:32.680130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-89eb81c6-2002-4020-abc5-512d09a2929c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:32.686842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89eb81c6-2002-4020-abc5-512d09a2929c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:32.687325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89eb81c6-2002-4020-abc5-512d09a2929c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:32.687757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89eb81c6-2002-4020-abc5-512d09a2929c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:32.688438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89eb81c6-2002-4020-abc5-512d09a2929c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:32.688888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89eb81c6-2002-4020-abc5-512d09a2929c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:32.689307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89eb81c6-2002-4020-abc5-512d09a2929c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:32.750061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-89eb81c6-2002-4020-abc5-512d09a2929c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:32.757650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-89eb81c6-2002-4020-abc5-512d09a2929c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082036 Sep 02 09:39:32.758218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 282/562] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:32 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:33.778439 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-31310042-6507-4726-bce7-00b3669e1ffd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:33.779063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-31310042-6507-4726-bce7-00b3669e1ffd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:33.785615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31310042-6507-4726-bce7-00b3669e1ffd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:33.786092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31310042-6507-4726-bce7-00b3669e1ffd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:33.786524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31310042-6507-4726-bce7-00b3669e1ffd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:33.787232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31310042-6507-4726-bce7-00b3669e1ffd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:33.787681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31310042-6507-4726-bce7-00b3669e1ffd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:33.788104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31310042-6507-4726-bce7-00b3669e1ffd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:33.851353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-31310042-6507-4726-bce7-00b3669e1ffd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:33.860316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-31310042-6507-4726-bce7-00b3669e1ffd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.086095 Sep 02 09:39:33.860891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 281/563] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:33 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:34.881324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9e4fc413-4c60-4857-8c96-4a3e19d649d9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:34.881920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9e4fc413-4c60-4857-8c96-4a3e19d649d9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:34.888831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e4fc413-4c60-4857-8c96-4a3e19d649d9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:34.889299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e4fc413-4c60-4857-8c96-4a3e19d649d9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:34.889724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e4fc413-4c60-4857-8c96-4a3e19d649d9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:34.890396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e4fc413-4c60-4857-8c96-4a3e19d649d9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:34.890890 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e4fc413-4c60-4857-8c96-4a3e19d649d9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:34.891308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e4fc413-4c60-4857-8c96-4a3e19d649d9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:34.954397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e4fc413-4c60-4857-8c96-4a3e19d649d9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:34.962032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9e4fc413-4c60-4857-8c96-4a3e19d649d9 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084571 Sep 02 09:39:34.962588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 283/564] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:34 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:35.981969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d0807a2f-dab5-47c4-a2cc-27893a826d65 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:35.982569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d0807a2f-dab5-47c4-a2cc-27893a826d65 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:35.989057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0807a2f-dab5-47c4-a2cc-27893a826d65 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:35.989818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0807a2f-dab5-47c4-a2cc-27893a826d65 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:35.990259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0807a2f-dab5-47c4-a2cc-27893a826d65 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:35.990965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0807a2f-dab5-47c4-a2cc-27893a826d65 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:35.991417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0807a2f-dab5-47c4-a2cc-27893a826d65 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:35.991845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0807a2f-dab5-47c4-a2cc-27893a826d65 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:36.052767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d0807a2f-dab5-47c4-a2cc-27893a826d65 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:36.060363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d0807a2f-dab5-47c4-a2cc-27893a826d65 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082892 Sep 02 09:39:36.060951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 282/565] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:35 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:37.080449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-95572d8b-d32d-42e9-89bc-1899cc593851 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:37.081054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-95572d8b-d32d-42e9-89bc-1899cc593851 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:37.087546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95572d8b-d32d-42e9-89bc-1899cc593851 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:37.088022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95572d8b-d32d-42e9-89bc-1899cc593851 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:37.088454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95572d8b-d32d-42e9-89bc-1899cc593851 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:37.089130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95572d8b-d32d-42e9-89bc-1899cc593851 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:37.089583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95572d8b-d32d-42e9-89bc-1899cc593851 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:37.090005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95572d8b-d32d-42e9-89bc-1899cc593851 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:37.149989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-95572d8b-d32d-42e9-89bc-1899cc593851 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:37.157648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-95572d8b-d32d-42e9-89bc-1899cc593851 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081056 Sep 02 09:39:37.158202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 284/566] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:37 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:38.179776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-22caec1c-4798-4edb-b63e-e68879185d72 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:38.180347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-22caec1c-4798-4edb-b63e-e68879185d72 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:38.186834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22caec1c-4798-4edb-b63e-e68879185d72 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:38.187322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22caec1c-4798-4edb-b63e-e68879185d72 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:38.187755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22caec1c-4798-4edb-b63e-e68879185d72 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:38.188443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22caec1c-4798-4edb-b63e-e68879185d72 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:38.189223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22caec1c-4798-4edb-b63e-e68879185d72 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:38.189650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22caec1c-4798-4edb-b63e-e68879185d72 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:38.248875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-22caec1c-4798-4edb-b63e-e68879185d72 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:38.256554 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-22caec1c-4798-4edb-b63e-e68879185d72 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080756 Sep 02 09:39:38.257121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 283/567] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:38 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:39.279939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b4a220ff-f5fd-4f61-8108-3f5346bf598a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:39.280550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b4a220ff-f5fd-4f61-8108-3f5346bf598a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:39.287248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a220ff-f5fd-4f61-8108-3f5346bf598a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:39.287723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a220ff-f5fd-4f61-8108-3f5346bf598a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:39.288151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a220ff-f5fd-4f61-8108-3f5346bf598a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:39.288836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a220ff-f5fd-4f61-8108-3f5346bf598a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:39.289309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a220ff-f5fd-4f61-8108-3f5346bf598a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:39.289724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a220ff-f5fd-4f61-8108-3f5346bf598a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:39.349096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b4a220ff-f5fd-4f61-8108-3f5346bf598a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:39.356555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b4a220ff-f5fd-4f61-8108-3f5346bf598a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081042 Sep 02 09:39:39.357111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 285/568] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:39 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:40.376987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f76b151f-cce3-426a-a40d-eec214dfbb4f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:40.377523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f76b151f-cce3-426a-a40d-eec214dfbb4f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:40.383856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f76b151f-cce3-426a-a40d-eec214dfbb4f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:40.384348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f76b151f-cce3-426a-a40d-eec214dfbb4f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:40.384809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f76b151f-cce3-426a-a40d-eec214dfbb4f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:40.385491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f76b151f-cce3-426a-a40d-eec214dfbb4f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:40.385937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f76b151f-cce3-426a-a40d-eec214dfbb4f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:40.386360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f76b151f-cce3-426a-a40d-eec214dfbb4f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:40.446262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f76b151f-cce3-426a-a40d-eec214dfbb4f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:40.453816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f76b151f-cce3-426a-a40d-eec214dfbb4f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080845 Sep 02 09:39:40.454361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 284/569] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:40 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:41.474652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2ab50da0-784e-4902-b047-c89e55c9e2fe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:41.475276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2ab50da0-784e-4902-b047-c89e55c9e2fe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:41.477687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:41.482802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ab50da0-784e-4902-b047-c89e55c9e2fe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:41.483284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ab50da0-784e-4902-b047-c89e55c9e2fe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:41.483719 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ab50da0-784e-4902-b047-c89e55c9e2fe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:41.484407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ab50da0-784e-4902-b047-c89e55c9e2fe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:41.484847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ab50da0-784e-4902-b047-c89e55c9e2fe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:41.485268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ab50da0-784e-4902-b047-c89e55c9e2fe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:41.487864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:41.547540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2ab50da0-784e-4902-b047-c89e55c9e2fe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:41.555125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2ab50da0-784e-4902-b047-c89e55c9e2fe tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084252 Sep 02 09:39:41.555790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 286/570] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:41 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:42.577005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-191e448c-e8ca-493e-a3c3-0bffb409e4d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:42.577887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-191e448c-e8ca-493e-a3c3-0bffb409e4d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:42.584392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-191e448c-e8ca-493e-a3c3-0bffb409e4d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:42.584875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-191e448c-e8ca-493e-a3c3-0bffb409e4d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:42.585310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-191e448c-e8ca-493e-a3c3-0bffb409e4d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:42.585994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-191e448c-e8ca-493e-a3c3-0bffb409e4d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:42.586477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-191e448c-e8ca-493e-a3c3-0bffb409e4d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:42.586938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-191e448c-e8ca-493e-a3c3-0bffb409e4d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:42.650730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-191e448c-e8ca-493e-a3c3-0bffb409e4d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:42.658421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-191e448c-e8ca-493e-a3c3-0bffb409e4d5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085934 Sep 02 09:39:42.659029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 285/571] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:42 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:43.678822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-177b9ac6-6cf6-43dd-8947-6ede60859590 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:43.679452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-177b9ac6-6cf6-43dd-8947-6ede60859590 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:43.687565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-177b9ac6-6cf6-43dd-8947-6ede60859590 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:43.688043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-177b9ac6-6cf6-43dd-8947-6ede60859590 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:43.688510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-177b9ac6-6cf6-43dd-8947-6ede60859590 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:43.689145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-177b9ac6-6cf6-43dd-8947-6ede60859590 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:43.689589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-177b9ac6-6cf6-43dd-8947-6ede60859590 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:43.690007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-177b9ac6-6cf6-43dd-8947-6ede60859590 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:43.753396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-177b9ac6-6cf6-43dd-8947-6ede60859590 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:43.760964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-177b9ac6-6cf6-43dd-8947-6ede60859590 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.086068 Sep 02 09:39:43.761516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 287/572] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:43 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:44.781573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0d1d4c80-0ef3-4f0a-add9-48c2f6766f37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:44.782185 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0d1d4c80-0ef3-4f0a-add9-48c2f6766f37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:44.784652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=30 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:44.789316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1d4c80-0ef3-4f0a-add9-48c2f6766f37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:44.789802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1d4c80-0ef3-4f0a-add9-48c2f6766f37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:44.790243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1d4c80-0ef3-4f0a-add9-48c2f6766f37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:44.790956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1d4c80-0ef3-4f0a-add9-48c2f6766f37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:44.791412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1d4c80-0ef3-4f0a-add9-48c2f6766f37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:44.791837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1d4c80-0ef3-4f0a-add9-48c2f6766f37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:44.795756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=87 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:39:44.854254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0d1d4c80-0ef3-4f0a-add9-48c2f6766f37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:44.862197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0d1d4c80-0ef3-4f0a-add9-48c2f6766f37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084488 Sep 02 09:39:44.862779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 286/573] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:44 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:45.883161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-67cacd41-6dc2-49b1-814e-4dae6d1c5da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:45.883766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-67cacd41-6dc2-49b1-814e-4dae6d1c5da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:45.890698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67cacd41-6dc2-49b1-814e-4dae6d1c5da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:45.891206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67cacd41-6dc2-49b1-814e-4dae6d1c5da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:45.891637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67cacd41-6dc2-49b1-814e-4dae6d1c5da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:45.892320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67cacd41-6dc2-49b1-814e-4dae6d1c5da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:45.892768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67cacd41-6dc2-49b1-814e-4dae6d1c5da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:45.893190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67cacd41-6dc2-49b1-814e-4dae6d1c5da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:45.954822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-67cacd41-6dc2-49b1-814e-4dae6d1c5da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:45.962339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-67cacd41-6dc2-49b1-814e-4dae6d1c5da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083079 Sep 02 09:39:45.962930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 288/574] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:45 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:46.984047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-72f51b13-1b49-49ff-be5c-66567790e8b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:46.984578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-72f51b13-1b49-49ff-be5c-66567790e8b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:46.991161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72f51b13-1b49-49ff-be5c-66567790e8b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:46.994125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72f51b13-1b49-49ff-be5c-66567790e8b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:46.994125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72f51b13-1b49-49ff-be5c-66567790e8b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:46.994125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72f51b13-1b49-49ff-be5c-66567790e8b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:46.994125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72f51b13-1b49-49ff-be5c-66567790e8b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:46.994492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72f51b13-1b49-49ff-be5c-66567790e8b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:47.055698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-72f51b13-1b49-49ff-be5c-66567790e8b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:47.063313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-72f51b13-1b49-49ff-be5c-66567790e8b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083859 Sep 02 09:39:47.063877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 287/575] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:46 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:48.084004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-551a43a6-1a68-4eea-90e7-0c5542469fc0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:48.085361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-551a43a6-1a68-4eea-90e7-0c5542469fc0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:48.092799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-551a43a6-1a68-4eea-90e7-0c5542469fc0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:48.093325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-551a43a6-1a68-4eea-90e7-0c5542469fc0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:48.093762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-551a43a6-1a68-4eea-90e7-0c5542469fc0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:48.094452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-551a43a6-1a68-4eea-90e7-0c5542469fc0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:48.094935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-551a43a6-1a68-4eea-90e7-0c5542469fc0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:48.095362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-551a43a6-1a68-4eea-90e7-0c5542469fc0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:48.154489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-551a43a6-1a68-4eea-90e7-0c5542469fc0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:48.162755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-551a43a6-1a68-4eea-90e7-0c5542469fc0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082719 Sep 02 09:39:48.163319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 289/576] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:48 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:49.282719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c963a5f5-1d70-4136-8833-23bf3964c1bd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:49.283344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c963a5f5-1d70-4136-8833-23bf3964c1bd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:49.289317 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c963a5f5-1d70-4136-8833-23bf3964c1bd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:49.289803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c963a5f5-1d70-4136-8833-23bf3964c1bd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:49.290245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c963a5f5-1d70-4136-8833-23bf3964c1bd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:49.290960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c963a5f5-1d70-4136-8833-23bf3964c1bd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:49.291420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c963a5f5-1d70-4136-8833-23bf3964c1bd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:49.291852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c963a5f5-1d70-4136-8833-23bf3964c1bd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:49.350977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c963a5f5-1d70-4136-8833-23bf3964c1bd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:49.358686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c963a5f5-1d70-4136-8833-23bf3964c1bd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.179710 Sep 02 09:39:49.359285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 288/577] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:49 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:50.379294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c3d4776e-3f6b-45ff-bdf2-3f849dce9794 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:50.379891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c3d4776e-3f6b-45ff-bdf2-3f849dce9794 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:50.386265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3d4776e-3f6b-45ff-bdf2-3f849dce9794 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:50.386775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3d4776e-3f6b-45ff-bdf2-3f849dce9794 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:50.387213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3d4776e-3f6b-45ff-bdf2-3f849dce9794 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:50.387895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3d4776e-3f6b-45ff-bdf2-3f849dce9794 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:50.388882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3d4776e-3f6b-45ff-bdf2-3f849dce9794 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:50.389297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3d4776e-3f6b-45ff-bdf2-3f849dce9794 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:50.449210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c3d4776e-3f6b-45ff-bdf2-3f849dce9794 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:50.457724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c3d4776e-3f6b-45ff-bdf2-3f849dce9794 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082308 Sep 02 09:39:50.458282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 290/578] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:50 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:51.535813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cacecf82-0f68-42f2-a479-e8447e4861d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:51.536413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cacecf82-0f68-42f2-a479-e8447e4861d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:51.542737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cacecf82-0f68-42f2-a479-e8447e4861d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:51.543218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cacecf82-0f68-42f2-a479-e8447e4861d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:51.543651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cacecf82-0f68-42f2-a479-e8447e4861d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:51.544397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cacecf82-0f68-42f2-a479-e8447e4861d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:51.545403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cacecf82-0f68-42f2-a479-e8447e4861d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:51.545824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cacecf82-0f68-42f2-a479-e8447e4861d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:51.609726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cacecf82-0f68-42f2-a479-e8447e4861d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:51.617434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cacecf82-0f68-42f2-a479-e8447e4861d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085655 Sep 02 09:39:51.618030 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 289/579] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:51 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:52.637237 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6e67026e-40be-4aed-b6cb-33eca984d2db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:52.637840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6e67026e-40be-4aed-b6cb-33eca984d2db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:52.644261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e67026e-40be-4aed-b6cb-33eca984d2db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:52.644737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e67026e-40be-4aed-b6cb-33eca984d2db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:52.645167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e67026e-40be-4aed-b6cb-33eca984d2db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:52.645842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e67026e-40be-4aed-b6cb-33eca984d2db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:52.646285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e67026e-40be-4aed-b6cb-33eca984d2db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:52.646990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e67026e-40be-4aed-b6cb-33eca984d2db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:52.709406 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6e67026e-40be-4aed-b6cb-33eca984d2db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:52.717426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6e67026e-40be-4aed-b6cb-33eca984d2db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084077 Sep 02 09:39:52.718025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 291/580] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:52 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:53.737913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e956271c-8617-4123-a658-9ef02a34d748 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:53.738522 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e956271c-8617-4123-a658-9ef02a34d748 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:53.744938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e956271c-8617-4123-a658-9ef02a34d748 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:53.745422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e956271c-8617-4123-a658-9ef02a34d748 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:53.745857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e956271c-8617-4123-a658-9ef02a34d748 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:53.746541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e956271c-8617-4123-a658-9ef02a34d748 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:53.747026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e956271c-8617-4123-a658-9ef02a34d748 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:53.747449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e956271c-8617-4123-a658-9ef02a34d748 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:53.817577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e956271c-8617-4123-a658-9ef02a34d748 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:53.817577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e956271c-8617-4123-a658-9ef02a34d748 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081975 Sep 02 09:39:53.817577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 290/581] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:53 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:54.837396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0ccf4a94-b67c-4476-9314-1f96b24ae33d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:54.838004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0ccf4a94-b67c-4476-9314-1f96b24ae33d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:54.845135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccf4a94-b67c-4476-9314-1f96b24ae33d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:54.848539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccf4a94-b67c-4476-9314-1f96b24ae33d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:54.848539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccf4a94-b67c-4476-9314-1f96b24ae33d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:54.848539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccf4a94-b67c-4476-9314-1f96b24ae33d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:54.848539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccf4a94-b67c-4476-9314-1f96b24ae33d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:54.849408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0ccf4a94-b67c-4476-9314-1f96b24ae33d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:54.909050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0ccf4a94-b67c-4476-9314-1f96b24ae33d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:54.916824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0ccf4a94-b67c-4476-9314-1f96b24ae33d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083327 Sep 02 09:39:54.917381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 292/582] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:54 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:55.937960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8f4804ce-b2a4-4e11-9da9-33a99ff999a4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:55.938572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8f4804ce-b2a4-4e11-9da9-33a99ff999a4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:55.945009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8f4804ce-b2a4-4e11-9da9-33a99ff999a4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:55.945494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8f4804ce-b2a4-4e11-9da9-33a99ff999a4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:55.945929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8f4804ce-b2a4-4e11-9da9-33a99ff999a4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:55.946610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8f4804ce-b2a4-4e11-9da9-33a99ff999a4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:55.947092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8f4804ce-b2a4-4e11-9da9-33a99ff999a4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:55.947517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8f4804ce-b2a4-4e11-9da9-33a99ff999a4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:56.007143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8f4804ce-b2a4-4e11-9da9-33a99ff999a4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:56.015464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8f4804ce-b2a4-4e11-9da9-33a99ff999a4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081870 Sep 02 09:39:56.016021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 291/583] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:55 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:57.036267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6cc1e0c0-ba62-4010-b110-f9712d057441 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:57.036790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6cc1e0c0-ba62-4010-b110-f9712d057441 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:57.043174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc1e0c0-ba62-4010-b110-f9712d057441 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:57.043660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc1e0c0-ba62-4010-b110-f9712d057441 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:57.044091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc1e0c0-ba62-4010-b110-f9712d057441 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:57.045371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc1e0c0-ba62-4010-b110-f9712d057441 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:57.045831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc1e0c0-ba62-4010-b110-f9712d057441 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:57.046254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cc1e0c0-ba62-4010-b110-f9712d057441 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:57.105552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6cc1e0c0-ba62-4010-b110-f9712d057441 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:57.113107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6cc1e0c0-ba62-4010-b110-f9712d057441 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080817 Sep 02 09:39:57.113662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 293/584] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:57 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:58.133710 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6f47e49c-3762-47db-a3c5-5552ff97b071 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:58.134249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6f47e49c-3762-47db-a3c5-5552ff97b071 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:58.141381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f47e49c-3762-47db-a3c5-5552ff97b071 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:58.141866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f47e49c-3762-47db-a3c5-5552ff97b071 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:58.142307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f47e49c-3762-47db-a3c5-5552ff97b071 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:58.143016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f47e49c-3762-47db-a3c5-5552ff97b071 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:58.143474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f47e49c-3762-47db-a3c5-5552ff97b071 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:58.143898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f47e49c-3762-47db-a3c5-5552ff97b071 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:58.204392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6f47e49c-3762-47db-a3c5-5552ff97b071 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:58.212077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6f47e49c-3762-47db-a3c5-5552ff97b071 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082309 Sep 02 09:39:58.222050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 292/585] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:58 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:39:59.242748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6992f484-0b14-4152-8224-b5cc58235467 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:39:59.242748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6992f484-0b14-4152-8224-b5cc58235467 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:39:59.248225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6992f484-0b14-4152-8224-b5cc58235467 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:59.248710 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6992f484-0b14-4152-8224-b5cc58235467 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:59.249141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6992f484-0b14-4152-8224-b5cc58235467 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:59.249823 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6992f484-0b14-4152-8224-b5cc58235467 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:39:59.250276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6992f484-0b14-4152-8224-b5cc58235467 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:39:59.250818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6992f484-0b14-4152-8224-b5cc58235467 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:39:59.311474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6992f484-0b14-4152-8224-b5cc58235467 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:39:59.319050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6992f484-0b14-4152-8224-b5cc58235467 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082166 Sep 02 09:39:59.319616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 294/586] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:39:59 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:00.339989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bdcd8e6d-fb0b-41aa-94e0-f0357fe52a6c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:00.340539 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bdcd8e6d-fb0b-41aa-94e0-f0357fe52a6c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:00.346908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdcd8e6d-fb0b-41aa-94e0-f0357fe52a6c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:00.347396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdcd8e6d-fb0b-41aa-94e0-f0357fe52a6c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:00.347830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdcd8e6d-fb0b-41aa-94e0-f0357fe52a6c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:00.348516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdcd8e6d-fb0b-41aa-94e0-f0357fe52a6c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:00.348967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdcd8e6d-fb0b-41aa-94e0-f0357fe52a6c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:00.349391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdcd8e6d-fb0b-41aa-94e0-f0357fe52a6c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:00.411673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bdcd8e6d-fb0b-41aa-94e0-f0357fe52a6c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:00.419269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bdcd8e6d-fb0b-41aa-94e0-f0357fe52a6c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083254 Sep 02 09:40:00.420314 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 293/587] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:00 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:01.440475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4522ab2a-862f-42ae-bc22-c554c1face63 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:01.441074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4522ab2a-862f-42ae-bc22-c554c1face63 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:01.447574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4522ab2a-862f-42ae-bc22-c554c1face63 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:01.448051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4522ab2a-862f-42ae-bc22-c554c1face63 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:01.448476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4522ab2a-862f-42ae-bc22-c554c1face63 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:01.449148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4522ab2a-862f-42ae-bc22-c554c1face63 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:01.449592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4522ab2a-862f-42ae-bc22-c554c1face63 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:01.450005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4522ab2a-862f-42ae-bc22-c554c1face63 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:01.514624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4522ab2a-862f-42ae-bc22-c554c1face63 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:01.522468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4522ab2a-862f-42ae-bc22-c554c1face63 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085600 Sep 02 09:40:01.523046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 295/588] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:01 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:02.542858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7bcad56c-2fa5-4e74-8c0b-5c926d7657e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:02.543392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7bcad56c-2fa5-4e74-8c0b-5c926d7657e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:02.549704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bcad56c-2fa5-4e74-8c0b-5c926d7657e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:02.550179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bcad56c-2fa5-4e74-8c0b-5c926d7657e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:02.550604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bcad56c-2fa5-4e74-8c0b-5c926d7657e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:02.551304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bcad56c-2fa5-4e74-8c0b-5c926d7657e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:02.551748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bcad56c-2fa5-4e74-8c0b-5c926d7657e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:02.552163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bcad56c-2fa5-4e74-8c0b-5c926d7657e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:02.615911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7bcad56c-2fa5-4e74-8c0b-5c926d7657e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:02.623616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7bcad56c-2fa5-4e74-8c0b-5c926d7657e1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084724 Sep 02 09:40:02.624172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 294/589] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:02 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:03.644036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3deef3d4-a245-4e18-a58a-66b47a9923c2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:03.650643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3deef3d4-a245-4e18-a58a-66b47a9923c2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:03.650939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3deef3d4-a245-4e18-a58a-66b47a9923c2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:03.651419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3deef3d4-a245-4e18-a58a-66b47a9923c2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:03.651848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3deef3d4-a245-4e18-a58a-66b47a9923c2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:03.652522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3deef3d4-a245-4e18-a58a-66b47a9923c2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:03.652968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3deef3d4-a245-4e18-a58a-66b47a9923c2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:03.653385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3deef3d4-a245-4e18-a58a-66b47a9923c2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:03.712757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3deef3d4-a245-4e18-a58a-66b47a9923c2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:03.720994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3deef3d4-a245-4e18-a58a-66b47a9923c2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080839 Sep 02 09:40:03.721554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 296/590] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:03 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:04.741392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-143ca579-a30b-4c46-85a7-3f272aa9f8b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:04.741984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-143ca579-a30b-4c46-85a7-3f272aa9f8b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:04.748368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-143ca579-a30b-4c46-85a7-3f272aa9f8b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:04.748849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-143ca579-a30b-4c46-85a7-3f272aa9f8b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:04.749281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-143ca579-a30b-4c46-85a7-3f272aa9f8b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:04.749957 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-143ca579-a30b-4c46-85a7-3f272aa9f8b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:04.750403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-143ca579-a30b-4c46-85a7-3f272aa9f8b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:04.750851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-143ca579-a30b-4c46-85a7-3f272aa9f8b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:04.810784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-143ca579-a30b-4c46-85a7-3f272aa9f8b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:04.818321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-143ca579-a30b-4c46-85a7-3f272aa9f8b7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080878 Sep 02 09:40:04.818908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 295/591] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:04 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:05.838146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f17fbcdb-9fc2-47fd-8cc8-fc2eee84821a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:05.838891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f17fbcdb-9fc2-47fd-8cc8-fc2eee84821a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:05.845177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f17fbcdb-9fc2-47fd-8cc8-fc2eee84821a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:05.845610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f17fbcdb-9fc2-47fd-8cc8-fc2eee84821a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:05.846044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f17fbcdb-9fc2-47fd-8cc8-fc2eee84821a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:05.846755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f17fbcdb-9fc2-47fd-8cc8-fc2eee84821a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:05.847211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f17fbcdb-9fc2-47fd-8cc8-fc2eee84821a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:05.847632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f17fbcdb-9fc2-47fd-8cc8-fc2eee84821a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:05.907710 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f17fbcdb-9fc2-47fd-8cc8-fc2eee84821a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:05.915325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f17fbcdb-9fc2-47fd-8cc8-fc2eee84821a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081074 Sep 02 09:40:05.915893 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 297/592] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:05 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:06.936842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d295393e-4263-4bf4-bc71-22f44c4e01d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:06.937446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d295393e-4263-4bf4-bc71-22f44c4e01d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:06.943964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d295393e-4263-4bf4-bc71-22f44c4e01d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:06.944444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d295393e-4263-4bf4-bc71-22f44c4e01d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:06.944878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d295393e-4263-4bf4-bc71-22f44c4e01d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:06.945624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d295393e-4263-4bf4-bc71-22f44c4e01d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:06.946073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d295393e-4263-4bf4-bc71-22f44c4e01d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:06.946513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d295393e-4263-4bf4-bc71-22f44c4e01d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:07.006856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d295393e-4263-4bf4-bc71-22f44c4e01d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:07.015123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d295393e-4263-4bf4-bc71-22f44c4e01d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082721 Sep 02 09:40:07.015689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 296/593] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:06 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:08.036308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3d8c52d1-e111-48cc-b04f-4d2437ade324 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:08.036972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3d8c52d1-e111-48cc-b04f-4d2437ade324 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:08.043450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d8c52d1-e111-48cc-b04f-4d2437ade324 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:08.043971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d8c52d1-e111-48cc-b04f-4d2437ade324 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:08.044410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d8c52d1-e111-48cc-b04f-4d2437ade324 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:08.045096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d8c52d1-e111-48cc-b04f-4d2437ade324 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:08.045551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d8c52d1-e111-48cc-b04f-4d2437ade324 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:08.045974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d8c52d1-e111-48cc-b04f-4d2437ade324 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:08.106613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3d8c52d1-e111-48cc-b04f-4d2437ade324 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:08.114392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3d8c52d1-e111-48cc-b04f-4d2437ade324 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081944 Sep 02 09:40:08.115189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 298/594] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:08 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:09.135239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c395a339-f054-4cff-a3e8-2650e472e562 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:09.135783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c395a339-f054-4cff-a3e8-2650e472e562 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:09.142046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c395a339-f054-4cff-a3e8-2650e472e562 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:09.142530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c395a339-f054-4cff-a3e8-2650e472e562 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:09.143006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c395a339-f054-4cff-a3e8-2650e472e562 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:09.143689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c395a339-f054-4cff-a3e8-2650e472e562 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:09.144162 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c395a339-f054-4cff-a3e8-2650e472e562 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:09.144570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c395a339-f054-4cff-a3e8-2650e472e562 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:09.206284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c395a339-f054-4cff-a3e8-2650e472e562 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:09.214071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c395a339-f054-4cff-a3e8-2650e472e562 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082769 Sep 02 09:40:09.216306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 297/595] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:09 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:10.234085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a538b589-108f-46ea-959c-1c501bc727d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:10.234618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a538b589-108f-46ea-959c-1c501bc727d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:10.241336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b589-108f-46ea-959c-1c501bc727d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:10.241821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b589-108f-46ea-959c-1c501bc727d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:10.242257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b589-108f-46ea-959c-1c501bc727d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:10.243059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b589-108f-46ea-959c-1c501bc727d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:10.243515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b589-108f-46ea-959c-1c501bc727d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:10.243936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b589-108f-46ea-959c-1c501bc727d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:10.307788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a538b589-108f-46ea-959c-1c501bc727d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:10.315939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a538b589-108f-46ea-959c-1c501bc727d6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085818 Sep 02 09:40:10.329904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 299/596] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:10 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:11.336533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-956edfd5-4a15-4518-8823-54588c06374a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:11.337154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-956edfd5-4a15-4518-8823-54588c06374a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:11.344170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-956edfd5-4a15-4518-8823-54588c06374a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:11.344655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-956edfd5-4a15-4518-8823-54588c06374a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:11.345093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-956edfd5-4a15-4518-8823-54588c06374a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:11.345777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-956edfd5-4a15-4518-8823-54588c06374a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:11.346229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-956edfd5-4a15-4518-8823-54588c06374a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:11.346653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-956edfd5-4a15-4518-8823-54588c06374a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:11.406992 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-956edfd5-4a15-4518-8823-54588c06374a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:11.414699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-956edfd5-4a15-4518-8823-54588c06374a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082076 Sep 02 09:40:11.415281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 298/597] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:11 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:12.435152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f0989422-850a-4754-ba16-a26e9641f2f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:12.435757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f0989422-850a-4754-ba16-a26e9641f2f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:12.442034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0989422-850a-4754-ba16-a26e9641f2f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:12.442512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0989422-850a-4754-ba16-a26e9641f2f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:12.443039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0989422-850a-4754-ba16-a26e9641f2f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:12.443717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0989422-850a-4754-ba16-a26e9641f2f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:12.444165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0989422-850a-4754-ba16-a26e9641f2f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:12.444583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0989422-850a-4754-ba16-a26e9641f2f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:12.505515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f0989422-850a-4754-ba16-a26e9641f2f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:12.513363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f0989422-850a-4754-ba16-a26e9641f2f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082132 Sep 02 09:40:12.513919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 300/598] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:12 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:13.534580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-32ed17c2-1586-4901-b08b-0ecc76617da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:13.535155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-32ed17c2-1586-4901-b08b-0ecc76617da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:13.541566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32ed17c2-1586-4901-b08b-0ecc76617da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:13.542047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32ed17c2-1586-4901-b08b-0ecc76617da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:13.542484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32ed17c2-1586-4901-b08b-0ecc76617da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:13.543191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32ed17c2-1586-4901-b08b-0ecc76617da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:13.543645 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32ed17c2-1586-4901-b08b-0ecc76617da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:13.544069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32ed17c2-1586-4901-b08b-0ecc76617da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:13.603446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-32ed17c2-1586-4901-b08b-0ecc76617da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:13.611415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-32ed17c2-1586-4901-b08b-0ecc76617da4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080740 Sep 02 09:40:13.611973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 299/599] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:13 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:14.632168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a98d3138-a8a9-47a3-9a47-1f7cac8c5728 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:14.637274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a98d3138-a8a9-47a3-9a47-1f7cac8c5728 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:14.637274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=30 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:14.639804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a98d3138-a8a9-47a3-9a47-1f7cac8c5728 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:14.640284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a98d3138-a8a9-47a3-9a47-1f7cac8c5728 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:14.640714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a98d3138-a8a9-47a3-9a47-1f7cac8c5728 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:14.641388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a98d3138-a8a9-47a3-9a47-1f7cac8c5728 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:14.641836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a98d3138-a8a9-47a3-9a47-1f7cac8c5728 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:14.642250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a98d3138-a8a9-47a3-9a47-1f7cac8c5728 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:14.646142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=90 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:14.703396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a98d3138-a8a9-47a3-9a47-1f7cac8c5728 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:14.711300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a98d3138-a8a9-47a3-9a47-1f7cac8c5728 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083026 Sep 02 09:40:14.711897 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 301/600] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:14 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:15.732142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9a293286-e095-4275-85c3-5ef878cd327f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:15.732747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9a293286-e095-4275-85c3-5ef878cd327f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:15.743224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=28 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:15.743224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a293286-e095-4275-85c3-5ef878cd327f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:15.743224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a293286-e095-4275-85c3-5ef878cd327f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:15.743224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a293286-e095-4275-85c3-5ef878cd327f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:15.743816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a293286-e095-4275-85c3-5ef878cd327f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:15.743816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a293286-e095-4275-85c3-5ef878cd327f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:15.743816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a293286-e095-4275-85c3-5ef878cd327f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:15.744587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=84 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:15.805813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9a293286-e095-4275-85c3-5ef878cd327f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:15.813741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9a293286-e095-4275-85c3-5ef878cd327f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085366 Sep 02 09:40:15.814306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 300/601] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:15 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:16.835075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cb23055b-a673-46cf-ba83-2e709695a2f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:16.835663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cb23055b-a673-46cf-ba83-2e709695a2f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:16.842734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb23055b-a673-46cf-ba83-2e709695a2f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:16.843226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb23055b-a673-46cf-ba83-2e709695a2f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:16.843652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb23055b-a673-46cf-ba83-2e709695a2f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:16.844334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb23055b-a673-46cf-ba83-2e709695a2f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:16.844781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb23055b-a673-46cf-ba83-2e709695a2f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:16.845438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb23055b-a673-46cf-ba83-2e709695a2f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:16.907530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cb23055b-a673-46cf-ba83-2e709695a2f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:16.915155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cb23055b-a673-46cf-ba83-2e709695a2f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083950 Sep 02 09:40:16.915709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 302/602] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:16 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:17.935797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-91bccf4a-b17c-415d-b58f-f66d549f2476 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:17.936412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-91bccf4a-b17c-415d-b58f-f66d549f2476 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:17.942866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bccf4a-b17c-415d-b58f-f66d549f2476 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:17.943365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bccf4a-b17c-415d-b58f-f66d549f2476 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:17.943805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bccf4a-b17c-415d-b58f-f66d549f2476 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:17.944496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bccf4a-b17c-415d-b58f-f66d549f2476 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:17.944953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bccf4a-b17c-415d-b58f-f66d549f2476 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:17.945380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bccf4a-b17c-415d-b58f-f66d549f2476 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:18.009755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-91bccf4a-b17c-415d-b58f-f66d549f2476 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:18.017972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-91bccf4a-b17c-415d-b58f-f66d549f2476 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.086047 Sep 02 09:40:18.018535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 301/603] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:17 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:19.038831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-88616b9a-88ef-440a-81e7-bcdef71b661b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:19.039432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-88616b9a-88ef-440a-81e7-bcdef71b661b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:19.045774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88616b9a-88ef-440a-81e7-bcdef71b661b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:19.046249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88616b9a-88ef-440a-81e7-bcdef71b661b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:19.046675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88616b9a-88ef-440a-81e7-bcdef71b661b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:19.047375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88616b9a-88ef-440a-81e7-bcdef71b661b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:19.047820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88616b9a-88ef-440a-81e7-bcdef71b661b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:19.048235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88616b9a-88ef-440a-81e7-bcdef71b661b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:19.110844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-88616b9a-88ef-440a-81e7-bcdef71b661b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:19.118391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-88616b9a-88ef-440a-81e7-bcdef71b661b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083499 Sep 02 09:40:19.118994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 303/604] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:19 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:20.139793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-248af5d2-1039-49b0-8eb0-7ad7c672eedc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:20.140399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-248af5d2-1039-49b0-8eb0-7ad7c672eedc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:20.146914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-248af5d2-1039-49b0-8eb0-7ad7c672eedc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:20.147395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-248af5d2-1039-49b0-8eb0-7ad7c672eedc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:20.147823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-248af5d2-1039-49b0-8eb0-7ad7c672eedc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:20.148753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-248af5d2-1039-49b0-8eb0-7ad7c672eedc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:20.149199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-248af5d2-1039-49b0-8eb0-7ad7c672eedc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:20.149619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-248af5d2-1039-49b0-8eb0-7ad7c672eedc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:20.212076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-248af5d2-1039-49b0-8eb0-7ad7c672eedc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:20.219915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-248af5d2-1039-49b0-8eb0-7ad7c672eedc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084062 Sep 02 09:40:20.220483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 302/605] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:20 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:21.244583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9d2fc166-f45c-45a9-8979-b2bed46121bb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:21.245138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9d2fc166-f45c-45a9-8979-b2bed46121bb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:21.247678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:40:21.247815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:40:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 (ip 10.222.0.57) !!! Sep 02 09:40:21.256273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d2fc166-f45c-45a9-8979-b2bed46121bb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:21.258498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d2fc166-f45c-45a9-8979-b2bed46121bb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:21.258498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d2fc166-f45c-45a9-8979-b2bed46121bb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:21.258498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d2fc166-f45c-45a9-8979-b2bed46121bb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:21.258498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d2fc166-f45c-45a9-8979-b2bed46121bb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:21.259039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d2fc166-f45c-45a9-8979-b2bed46121bb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:21.319803 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9d2fc166-f45c-45a9-8979-b2bed46121bb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:21.327378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9d2fc166-f45c-45a9-8979-b2bed46121bb tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.086872 Sep 02 09:40:21.327937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 304/606] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:21 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:22.348219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e1115f15-5eff-4a60-bb7e-9223bbc4e650 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:22.348835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e1115f15-5eff-4a60-bb7e-9223bbc4e650 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:22.355429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1115f15-5eff-4a60-bb7e-9223bbc4e650 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:22.355917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1115f15-5eff-4a60-bb7e-9223bbc4e650 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:22.356360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1115f15-5eff-4a60-bb7e-9223bbc4e650 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:22.357048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1115f15-5eff-4a60-bb7e-9223bbc4e650 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:22.357506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1115f15-5eff-4a60-bb7e-9223bbc4e650 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:22.357933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e1115f15-5eff-4a60-bb7e-9223bbc4e650 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:22.421880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e1115f15-5eff-4a60-bb7e-9223bbc4e650 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:22.429783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e1115f15-5eff-4a60-bb7e-9223bbc4e650 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085485 Sep 02 09:40:22.430355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 303/607] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:22 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:23.450896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2fa8b1ba-ac33-4e0f-9811-bb186edd6002 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:23.451569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2fa8b1ba-ac33-4e0f-9811-bb186edd6002 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:23.458367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fa8b1ba-ac33-4e0f-9811-bb186edd6002 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:23.458886 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fa8b1ba-ac33-4e0f-9811-bb186edd6002 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:23.459330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fa8b1ba-ac33-4e0f-9811-bb186edd6002 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:23.460016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fa8b1ba-ac33-4e0f-9811-bb186edd6002 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:23.460468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fa8b1ba-ac33-4e0f-9811-bb186edd6002 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:23.460889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fa8b1ba-ac33-4e0f-9811-bb186edd6002 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:23.520210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2fa8b1ba-ac33-4e0f-9811-bb186edd6002 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:23.528000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2fa8b1ba-ac33-4e0f-9811-bb186edd6002 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081057 Sep 02 09:40:23.528560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 305/608] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:23 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:24.549641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e7e5d8a0-adb3-40e4-a897-7db92cb81c1d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:24.550311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e7e5d8a0-adb3-40e4-a897-7db92cb81c1d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:24.552535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:40:24.552678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 09:40:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 (ip 10.222.0.57) !!! Sep 02 09:40:24.560004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7e5d8a0-adb3-40e4-a897-7db92cb81c1d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:24.560487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7e5d8a0-adb3-40e4-a897-7db92cb81c1d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:24.560924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7e5d8a0-adb3-40e4-a897-7db92cb81c1d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:24.561613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7e5d8a0-adb3-40e4-a897-7db92cb81c1d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:24.562065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7e5d8a0-adb3-40e4-a897-7db92cb81c1d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:24.562488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7e5d8a0-adb3-40e4-a897-7db92cb81c1d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:24.624456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e7e5d8a0-adb3-40e4-a897-7db92cb81c1d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:24.632215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e7e5d8a0-adb3-40e4-a897-7db92cb81c1d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.087065 Sep 02 09:40:24.632899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 304/609] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:24 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:25.653020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e5e7933d-0a9e-44ae-9e14-9ad80c4ba1dc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:25.653622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e5e7933d-0a9e-44ae-9e14-9ad80c4ba1dc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:25.659973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e7933d-0a9e-44ae-9e14-9ad80c4ba1dc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:25.660450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e7933d-0a9e-44ae-9e14-9ad80c4ba1dc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:25.660881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e7933d-0a9e-44ae-9e14-9ad80c4ba1dc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:25.661553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e7933d-0a9e-44ae-9e14-9ad80c4ba1dc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:25.662003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e7933d-0a9e-44ae-9e14-9ad80c4ba1dc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:25.662420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e7933d-0a9e-44ae-9e14-9ad80c4ba1dc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:25.721581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e5e7933d-0a9e-44ae-9e14-9ad80c4ba1dc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:25.729287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e5e7933d-0a9e-44ae-9e14-9ad80c4ba1dc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080125 Sep 02 09:40:25.729838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 306/610] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:25 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:26.754483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ea52478b-2d69-4c90-b08d-9201372291d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:26.755120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ea52478b-2d69-4c90-b08d-9201372291d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:26.761493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea52478b-2d69-4c90-b08d-9201372291d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:26.761988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea52478b-2d69-4c90-b08d-9201372291d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:26.762420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea52478b-2d69-4c90-b08d-9201372291d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:26.763231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea52478b-2d69-4c90-b08d-9201372291d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:26.763681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea52478b-2d69-4c90-b08d-9201372291d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:26.764100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea52478b-2d69-4c90-b08d-9201372291d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:26.828676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ea52478b-2d69-4c90-b08d-9201372291d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:26.837081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ea52478b-2d69-4c90-b08d-9201372291d8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.086962 Sep 02 09:40:26.837627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 305/611] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:26 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:27.857411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b1ab15c-8166-47b1-9258-d1f203c37edc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:27.858023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8b1ab15c-8166-47b1-9258-d1f203c37edc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:27.864468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ab15c-8166-47b1-9258-d1f203c37edc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:27.864953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ab15c-8166-47b1-9258-d1f203c37edc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:27.865385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ab15c-8166-47b1-9258-d1f203c37edc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:27.866066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ab15c-8166-47b1-9258-d1f203c37edc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:27.866520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ab15c-8166-47b1-9258-d1f203c37edc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:27.866970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ab15c-8166-47b1-9258-d1f203c37edc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:27.930786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8b1ab15c-8166-47b1-9258-d1f203c37edc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:27.938499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8b1ab15c-8166-47b1-9258-d1f203c37edc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085027 Sep 02 09:40:27.939100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 307/612] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:27 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:28.958801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-86584e98-f331-410b-96c0-b38cdabaaa02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:28.959416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-86584e98-f331-410b-96c0-b38cdabaaa02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:28.965771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86584e98-f331-410b-96c0-b38cdabaaa02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:28.966258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86584e98-f331-410b-96c0-b38cdabaaa02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:28.966689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86584e98-f331-410b-96c0-b38cdabaaa02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:28.967390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86584e98-f331-410b-96c0-b38cdabaaa02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:28.967842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86584e98-f331-410b-96c0-b38cdabaaa02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:28.968262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86584e98-f331-410b-96c0-b38cdabaaa02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:29.251207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-86584e98-f331-410b-96c0-b38cdabaaa02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:29.258938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-86584e98-f331-410b-96c0-b38cdabaaa02 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.303951 Sep 02 09:40:29.259501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 306/613] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:28 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:30.279473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb5f31f2-b9cf-4811-b131-0f59bf8c3e5c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:30.280058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb5f31f2-b9cf-4811-b131-0f59bf8c3e5c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:30.286422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb5f31f2-b9cf-4811-b131-0f59bf8c3e5c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:30.286945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb5f31f2-b9cf-4811-b131-0f59bf8c3e5c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:30.287381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb5f31f2-b9cf-4811-b131-0f59bf8c3e5c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:30.288069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb5f31f2-b9cf-4811-b131-0f59bf8c3e5c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:30.288523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb5f31f2-b9cf-4811-b131-0f59bf8c3e5c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:30.288943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb5f31f2-b9cf-4811-b131-0f59bf8c3e5c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:30.351401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb5f31f2-b9cf-4811-b131-0f59bf8c3e5c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:30.358970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb5f31f2-b9cf-4811-b131-0f59bf8c3e5c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083398 Sep 02 09:40:30.359533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 308/614] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:30 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:31.381011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9a6fba31-d8df-4cad-8975-7827972cecff tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:31.381622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9a6fba31-d8df-4cad-8975-7827972cecff tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:31.388266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a6fba31-d8df-4cad-8975-7827972cecff tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:31.388746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a6fba31-d8df-4cad-8975-7827972cecff tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:31.389184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a6fba31-d8df-4cad-8975-7827972cecff tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:31.389869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a6fba31-d8df-4cad-8975-7827972cecff tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:31.390321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a6fba31-d8df-4cad-8975-7827972cecff tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:31.390772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a6fba31-d8df-4cad-8975-7827972cecff tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:31.453004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9a6fba31-d8df-4cad-8975-7827972cecff tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:31.461184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9a6fba31-d8df-4cad-8975-7827972cecff tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084569 Sep 02 09:40:31.461745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 307/615] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:31 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:32.481665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5dca2126-34de-4353-8081-0209e3682358 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:32.482304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5dca2126-34de-4353-8081-0209e3682358 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:32.488374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dca2126-34de-4353-8081-0209e3682358 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:32.488964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dca2126-34de-4353-8081-0209e3682358 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:32.489395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dca2126-34de-4353-8081-0209e3682358 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:32.490064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dca2126-34de-4353-8081-0209e3682358 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:32.490509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dca2126-34de-4353-8081-0209e3682358 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:32.490963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5dca2126-34de-4353-8081-0209e3682358 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:32.550602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5dca2126-34de-4353-8081-0209e3682358 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:32.558160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5dca2126-34de-4353-8081-0209e3682358 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080523 Sep 02 09:40:32.558730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 309/616] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:32 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:33.578673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2080e5d5-2ac9-41cf-8cbe-62b45efe3d43 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:33.579242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2080e5d5-2ac9-41cf-8cbe-62b45efe3d43 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:33.585829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2080e5d5-2ac9-41cf-8cbe-62b45efe3d43 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:33.586312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2080e5d5-2ac9-41cf-8cbe-62b45efe3d43 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:33.586767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2080e5d5-2ac9-41cf-8cbe-62b45efe3d43 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:33.587454 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2080e5d5-2ac9-41cf-8cbe-62b45efe3d43 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:33.587901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2080e5d5-2ac9-41cf-8cbe-62b45efe3d43 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:33.588319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2080e5d5-2ac9-41cf-8cbe-62b45efe3d43 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:33.648331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2080e5d5-2ac9-41cf-8cbe-62b45efe3d43 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:33.656129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2080e5d5-2ac9-41cf-8cbe-62b45efe3d43 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081343 Sep 02 09:40:33.656682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 308/617] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:33 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:34.676532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b9cdbc4-4447-45fe-8649-164f4b211b67 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:34.677168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8b9cdbc4-4447-45fe-8649-164f4b211b67 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:34.683615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9cdbc4-4447-45fe-8649-164f4b211b67 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:34.684138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9cdbc4-4447-45fe-8649-164f4b211b67 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:34.684579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9cdbc4-4447-45fe-8649-164f4b211b67 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:34.685264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9cdbc4-4447-45fe-8649-164f4b211b67 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:34.685718 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9cdbc4-4447-45fe-8649-164f4b211b67 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:34.686146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9cdbc4-4447-45fe-8649-164f4b211b67 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:34.746097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8b9cdbc4-4447-45fe-8649-164f4b211b67 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:34.753691 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8b9cdbc4-4447-45fe-8649-164f4b211b67 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080999 Sep 02 09:40:34.754332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 310/618] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:34 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:35.774546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ea293d58-8e0c-4f07-90cf-8b7d84ad8fe8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:35.775183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ea293d58-8e0c-4f07-90cf-8b7d84ad8fe8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:35.781746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea293d58-8e0c-4f07-90cf-8b7d84ad8fe8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:35.782236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea293d58-8e0c-4f07-90cf-8b7d84ad8fe8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:35.782675 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea293d58-8e0c-4f07-90cf-8b7d84ad8fe8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:35.783392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea293d58-8e0c-4f07-90cf-8b7d84ad8fe8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:35.783848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea293d58-8e0c-4f07-90cf-8b7d84ad8fe8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:35.784312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea293d58-8e0c-4f07-90cf-8b7d84ad8fe8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:35.846129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ea293d58-8e0c-4f07-90cf-8b7d84ad8fe8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:35.854379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ea293d58-8e0c-4f07-90cf-8b7d84ad8fe8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084014 Sep 02 09:40:35.854962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 309/619] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:35 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:36.875670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7acdae4f-6b09-4e72-822d-afa56148a92a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:36.876292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7acdae4f-6b09-4e72-822d-afa56148a92a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:36.883496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7acdae4f-6b09-4e72-822d-afa56148a92a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:36.883928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7acdae4f-6b09-4e72-822d-afa56148a92a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:36.884368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7acdae4f-6b09-4e72-822d-afa56148a92a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:36.885056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7acdae4f-6b09-4e72-822d-afa56148a92a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:36.885514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7acdae4f-6b09-4e72-822d-afa56148a92a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:36.885944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7acdae4f-6b09-4e72-822d-afa56148a92a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:36.949736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7acdae4f-6b09-4e72-822d-afa56148a92a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:36.957530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7acdae4f-6b09-4e72-822d-afa56148a92a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085727 Sep 02 09:40:36.958100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 311/620] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:36 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:37.977360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9fb873e2-5ed5-4861-b96a-2e2385445f92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:37.977969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9fb873e2-5ed5-4861-b96a-2e2385445f92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:37.984020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fb873e2-5ed5-4861-b96a-2e2385445f92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:37.984508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fb873e2-5ed5-4861-b96a-2e2385445f92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:37.984941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fb873e2-5ed5-4861-b96a-2e2385445f92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:37.985621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fb873e2-5ed5-4861-b96a-2e2385445f92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:37.986074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fb873e2-5ed5-4861-b96a-2e2385445f92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:37.986495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fb873e2-5ed5-4861-b96a-2e2385445f92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:38.049241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9fb873e2-5ed5-4861-b96a-2e2385445f92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:38.056933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9fb873e2-5ed5-4861-b96a-2e2385445f92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083469 Sep 02 09:40:38.057502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 310/621] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:37 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:39.077293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c6fb13d7-7706-4ef0-8ebb-06e642ea7a9c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:39.077907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c6fb13d7-7706-4ef0-8ebb-06e642ea7a9c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:39.084433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fb13d7-7706-4ef0-8ebb-06e642ea7a9c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:39.084914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fb13d7-7706-4ef0-8ebb-06e642ea7a9c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:39.085360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fb13d7-7706-4ef0-8ebb-06e642ea7a9c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:39.086049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fb13d7-7706-4ef0-8ebb-06e642ea7a9c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:39.086508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fb13d7-7706-4ef0-8ebb-06e642ea7a9c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:39.086961 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fb13d7-7706-4ef0-8ebb-06e642ea7a9c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:39.146670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c6fb13d7-7706-4ef0-8ebb-06e642ea7a9c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:39.154628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c6fb13d7-7706-4ef0-8ebb-06e642ea7a9c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081185 Sep 02 09:40:39.155248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 312/622] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:39 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:40.175627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ea1f0968-42ac-44a8-86e6-6ac80dd4c31b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:40.176232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ea1f0968-42ac-44a8-86e6-6ac80dd4c31b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:40.183269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea1f0968-42ac-44a8-86e6-6ac80dd4c31b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:40.183761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea1f0968-42ac-44a8-86e6-6ac80dd4c31b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:40.184196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea1f0968-42ac-44a8-86e6-6ac80dd4c31b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:40.184886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea1f0968-42ac-44a8-86e6-6ac80dd4c31b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:40.185336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea1f0968-42ac-44a8-86e6-6ac80dd4c31b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:40.185758 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea1f0968-42ac-44a8-86e6-6ac80dd4c31b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:40.246103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ea1f0968-42ac-44a8-86e6-6ac80dd4c31b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:40.253943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ea1f0968-42ac-44a8-86e6-6ac80dd4c31b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082268 Sep 02 09:40:40.254505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 311/623] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:40 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:41.273768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9885b9ee-abf3-4037-a068-c777e401c584 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:41.274620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9885b9ee-abf3-4037-a068-c777e401c584 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:41.280894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9885b9ee-abf3-4037-a068-c777e401c584 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:41.281372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9885b9ee-abf3-4037-a068-c777e401c584 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:41.281796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9885b9ee-abf3-4037-a068-c777e401c584 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:41.282468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9885b9ee-abf3-4037-a068-c777e401c584 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:41.282943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9885b9ee-abf3-4037-a068-c777e401c584 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:41.283367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9885b9ee-abf3-4037-a068-c777e401c584 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:41.343176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9885b9ee-abf3-4037-a068-c777e401c584 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:41.351478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9885b9ee-abf3-4037-a068-c777e401c584 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081408 Sep 02 09:40:41.352035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 313/624] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:41 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:42.372344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d6b17540-60a1-4d42-a28c-da6825baf8f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:42.372850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d6b17540-60a1-4d42-a28c-da6825baf8f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:42.379660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6b17540-60a1-4d42-a28c-da6825baf8f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:42.380139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6b17540-60a1-4d42-a28c-da6825baf8f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:42.380568 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6b17540-60a1-4d42-a28c-da6825baf8f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:42.381251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6b17540-60a1-4d42-a28c-da6825baf8f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:42.382208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6b17540-60a1-4d42-a28c-da6825baf8f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:42.382625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6b17540-60a1-4d42-a28c-da6825baf8f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:42.460900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d6b17540-60a1-4d42-a28c-da6825baf8f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:42.468636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d6b17540-60a1-4d42-a28c-da6825baf8f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.100174 Sep 02 09:40:42.469206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 312/625] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:42 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:40:43.454234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bc1d3e6e-335d-40be-908d-71631e1483b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:43.454750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bc1d3e6e-335d-40be-908d-71631e1483b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:43.465036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc1d3e6e-335d-40be-908d-71631e1483b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:43.465523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc1d3e6e-335d-40be-908d-71631e1483b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:43.465954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc1d3e6e-335d-40be-908d-71631e1483b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:43.466637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc1d3e6e-335d-40be-908d-71631e1483b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:43.467132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc1d3e6e-335d-40be-908d-71631e1483b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:43.467552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc1d3e6e-335d-40be-908d-71631e1483b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:43.489081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-35277ee4-2844-48c8-98fc-a829bdad007b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:43.489692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-35277ee4-2844-48c8-98fc-a829bdad007b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:43.496739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35277ee4-2844-48c8-98fc-a829bdad007b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:43.497229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35277ee4-2844-48c8-98fc-a829bdad007b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:43.497667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35277ee4-2844-48c8-98fc-a829bdad007b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:43.498369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35277ee4-2844-48c8-98fc-a829bdad007b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:43.498852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35277ee4-2844-48c8-98fc-a829bdad007b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:43.499279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35277ee4-2844-48c8-98fc-a829bdad007b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:43.563008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-35277ee4-2844-48c8-98fc-a829bdad007b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:43.571407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-35277ee4-2844-48c8-98fc-a829bdad007b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.086138 Sep 02 09:40:43.572035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 313/626] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:43 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:44.591435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2ca11feb-6784-44b6-8efa-5c2b0cdee5f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:44.592106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2ca11feb-6784-44b6-8efa-5c2b0cdee5f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:44.598380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2ca11feb-6784-44b6-8efa-5c2b0cdee5f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:44.598901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2ca11feb-6784-44b6-8efa-5c2b0cdee5f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:44.599333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2ca11feb-6784-44b6-8efa-5c2b0cdee5f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:44.600009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2ca11feb-6784-44b6-8efa-5c2b0cdee5f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:44.600978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2ca11feb-6784-44b6-8efa-5c2b0cdee5f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:44.601398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2ca11feb-6784-44b6-8efa-5c2b0cdee5f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:44.663544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2ca11feb-6784-44b6-8efa-5c2b0cdee5f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:44.671043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2ca11feb-6784-44b6-8efa-5c2b0cdee5f0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083402 Sep 02 09:40:44.671600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 314/627] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:44 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:45.691132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3ce84010-3435-4281-aeca-923dd6126e4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:45.691858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3ce84010-3435-4281-aeca-923dd6126e4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:45.698730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ce84010-3435-4281-aeca-923dd6126e4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:45.699212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ce84010-3435-4281-aeca-923dd6126e4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:45.699650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ce84010-3435-4281-aeca-923dd6126e4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:45.700331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ce84010-3435-4281-aeca-923dd6126e4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:45.700780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ce84010-3435-4281-aeca-923dd6126e4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:45.701203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ce84010-3435-4281-aeca-923dd6126e4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:45.761229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3ce84010-3435-4281-aeca-923dd6126e4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:45.768801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3ce84010-3435-4281-aeca-923dd6126e4b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081603 Sep 02 09:40:45.769360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 315/628] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:45 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:46.789563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5f2a0957-0d1e-471f-8538-26cdd79bacc5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:46.790233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5f2a0957-0d1e-471f-8538-26cdd79bacc5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:46.792516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=32 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:46.797126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5f2a0957-0d1e-471f-8538-26cdd79bacc5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:46.797604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5f2a0957-0d1e-471f-8538-26cdd79bacc5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:46.798037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5f2a0957-0d1e-471f-8538-26cdd79bacc5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:46.798732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5f2a0957-0d1e-471f-8538-26cdd79bacc5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:46.799178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5f2a0957-0d1e-471f-8538-26cdd79bacc5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:46.799598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5f2a0957-0d1e-471f-8538-26cdd79bacc5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:46.804155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=96 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:46.866744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5f2a0957-0d1e-471f-8538-26cdd79bacc5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:46.873566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5f2a0957-0d1e-471f-8538-26cdd79bacc5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.088283 Sep 02 09:40:46.874135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 316/629] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:46 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:47.894196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-affd2d23-ad6c-4b95-8283-60bc50898ecd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:47.894827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-affd2d23-ad6c-4b95-8283-60bc50898ecd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:47.902022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-affd2d23-ad6c-4b95-8283-60bc50898ecd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:47.902511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-affd2d23-ad6c-4b95-8283-60bc50898ecd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:47.902971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-affd2d23-ad6c-4b95-8283-60bc50898ecd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:47.903666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-affd2d23-ad6c-4b95-8283-60bc50898ecd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:47.904118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-affd2d23-ad6c-4b95-8283-60bc50898ecd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:47.904540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-affd2d23-ad6c-4b95-8283-60bc50898ecd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:47.965237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-affd2d23-ad6c-4b95-8283-60bc50898ecd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:47.973051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-affd2d23-ad6c-4b95-8283-60bc50898ecd tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082901 Sep 02 09:40:47.973621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 317/630] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:47 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:48.993949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-25a0f232-d6c5-4cf0-abdb-56c56ab36b2e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:48.994574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-25a0f232-d6c5-4cf0-abdb-56c56ab36b2e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:49.000908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25a0f232-d6c5-4cf0-abdb-56c56ab36b2e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:49.001387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25a0f232-d6c5-4cf0-abdb-56c56ab36b2e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:49.001817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25a0f232-d6c5-4cf0-abdb-56c56ab36b2e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:49.002495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25a0f232-d6c5-4cf0-abdb-56c56ab36b2e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:49.002961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25a0f232-d6c5-4cf0-abdb-56c56ab36b2e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:49.003383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25a0f232-d6c5-4cf0-abdb-56c56ab36b2e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:49.064163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-25a0f232-d6c5-4cf0-abdb-56c56ab36b2e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:49.071822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-25a0f232-d6c5-4cf0-abdb-56c56ab36b2e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082322 Sep 02 09:40:49.072382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 318/631] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:48 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:50.092210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-85f20d41-4e75-4566-a868-7ad1234d27ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:50.092812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-85f20d41-4e75-4566-a868-7ad1234d27ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:50.099508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f20d41-4e75-4566-a868-7ad1234d27ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:50.099993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f20d41-4e75-4566-a868-7ad1234d27ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:50.100423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f20d41-4e75-4566-a868-7ad1234d27ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:50.101704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f20d41-4e75-4566-a868-7ad1234d27ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:50.102153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f20d41-4e75-4566-a868-7ad1234d27ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:50.102573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f20d41-4e75-4566-a868-7ad1234d27ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:50.162459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-85f20d41-4e75-4566-a868-7ad1234d27ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:50.171166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-85f20d41-4e75-4566-a868-7ad1234d27ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082870 Sep 02 09:40:50.171729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 319/632] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:50 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:51.191830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-559b1bf8-b7e1-4d5f-bfea-2b52513712d0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:51.192434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-559b1bf8-b7e1-4d5f-bfea-2b52513712d0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:51.198697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-559b1bf8-b7e1-4d5f-bfea-2b52513712d0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:51.199204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-559b1bf8-b7e1-4d5f-bfea-2b52513712d0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:51.199639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-559b1bf8-b7e1-4d5f-bfea-2b52513712d0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:51.200314 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-559b1bf8-b7e1-4d5f-bfea-2b52513712d0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:51.200759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-559b1bf8-b7e1-4d5f-bfea-2b52513712d0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:51.201177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-559b1bf8-b7e1-4d5f-bfea-2b52513712d0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:51.265031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-559b1bf8-b7e1-4d5f-bfea-2b52513712d0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:51.272444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-559b1bf8-b7e1-4d5f-bfea-2b52513712d0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084767 Sep 02 09:40:51.273098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 320/633] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:51 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:52.293363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-be90dd08-7a11-4665-af29-cd635b10e2ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:52.293974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-be90dd08-7a11-4665-af29-cd635b10e2ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:52.300458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be90dd08-7a11-4665-af29-cd635b10e2ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:52.300936 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be90dd08-7a11-4665-af29-cd635b10e2ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:52.301368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be90dd08-7a11-4665-af29-cd635b10e2ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:52.302047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be90dd08-7a11-4665-af29-cd635b10e2ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:52.302502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be90dd08-7a11-4665-af29-cd635b10e2ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:52.303027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be90dd08-7a11-4665-af29-cd635b10e2ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:52.365247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-be90dd08-7a11-4665-af29-cd635b10e2ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:52.373533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-be90dd08-7a11-4665-af29-cd635b10e2ac tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084136 Sep 02 09:40:52.374114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 321/634] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:52 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:53.394889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3da5cabe-c74a-4d42-a88f-379fa720ba49 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:53.395525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3da5cabe-c74a-4d42-a88f-379fa720ba49 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:53.402326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3da5cabe-c74a-4d42-a88f-379fa720ba49 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:53.402970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3da5cabe-c74a-4d42-a88f-379fa720ba49 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:53.403416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3da5cabe-c74a-4d42-a88f-379fa720ba49 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:53.404104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3da5cabe-c74a-4d42-a88f-379fa720ba49 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:53.404560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3da5cabe-c74a-4d42-a88f-379fa720ba49 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:53.404995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3da5cabe-c74a-4d42-a88f-379fa720ba49 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:53.461553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=27 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:53.465082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3da5cabe-c74a-4d42-a88f-379fa720ba49 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:53.473004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3da5cabe-c74a-4d42-a88f-379fa720ba49 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081995 Sep 02 09:40:53.473569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 322/635] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:53 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:53.486022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=81 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:40:54.494900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-57f1a94d-1b9e-4f59-9f2b-7e94961c810d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:54.495510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-57f1a94d-1b9e-4f59-9f2b-7e94961c810d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:54.501924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57f1a94d-1b9e-4f59-9f2b-7e94961c810d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:54.502400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57f1a94d-1b9e-4f59-9f2b-7e94961c810d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:54.502862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57f1a94d-1b9e-4f59-9f2b-7e94961c810d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:54.503541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57f1a94d-1b9e-4f59-9f2b-7e94961c810d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:54.503990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57f1a94d-1b9e-4f59-9f2b-7e94961c810d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:54.504408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57f1a94d-1b9e-4f59-9f2b-7e94961c810d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:54.564889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-57f1a94d-1b9e-4f59-9f2b-7e94961c810d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:54.573136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-57f1a94d-1b9e-4f59-9f2b-7e94961c810d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082633 Sep 02 09:40:54.573689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 323/636] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:54 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:55.593626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-70887ab2-1fe0-4678-a87d-3d1f9485c771 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:55.594239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-70887ab2-1fe0-4678-a87d-3d1f9485c771 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:55.601175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70887ab2-1fe0-4678-a87d-3d1f9485c771 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:55.601658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70887ab2-1fe0-4678-a87d-3d1f9485c771 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:55.602096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70887ab2-1fe0-4678-a87d-3d1f9485c771 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:55.602806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70887ab2-1fe0-4678-a87d-3d1f9485c771 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:55.603265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70887ab2-1fe0-4678-a87d-3d1f9485c771 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:55.603690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70887ab2-1fe0-4678-a87d-3d1f9485c771 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:55.666416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-70887ab2-1fe0-4678-a87d-3d1f9485c771 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:55.674085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-70887ab2-1fe0-4678-a87d-3d1f9485c771 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084319 Sep 02 09:40:55.674695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 324/637] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:55 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:56.695958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-58c0b3f1-6889-48ed-a842-821891200e80 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:56.696566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-58c0b3f1-6889-48ed-a842-821891200e80 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:56.702949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58c0b3f1-6889-48ed-a842-821891200e80 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:56.705560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58c0b3f1-6889-48ed-a842-821891200e80 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:56.705560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58c0b3f1-6889-48ed-a842-821891200e80 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:56.705560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58c0b3f1-6889-48ed-a842-821891200e80 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:56.705560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58c0b3f1-6889-48ed-a842-821891200e80 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:56.705925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58c0b3f1-6889-48ed-a842-821891200e80 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:56.766123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-58c0b3f1-6889-48ed-a842-821891200e80 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:56.773714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-58c0b3f1-6889-48ed-a842-821891200e80 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082254 Sep 02 09:40:56.774270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 325/638] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:56 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:57.794105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-660f8686-db9c-4b49-88c9-968a1df06350 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:57.794731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-660f8686-db9c-4b49-88c9-968a1df06350 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:57.801153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-660f8686-db9c-4b49-88c9-968a1df06350 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:57.801636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-660f8686-db9c-4b49-88c9-968a1df06350 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:57.802076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-660f8686-db9c-4b49-88c9-968a1df06350 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:57.802806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-660f8686-db9c-4b49-88c9-968a1df06350 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:57.803263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-660f8686-db9c-4b49-88c9-968a1df06350 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:57.803686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-660f8686-db9c-4b49-88c9-968a1df06350 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:57.865327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-660f8686-db9c-4b49-88c9-968a1df06350 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:57.873286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-660f8686-db9c-4b49-88c9-968a1df06350 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083624 Sep 02 09:40:57.873858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 326/639] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:57 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:58.893400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2974f99b-2585-4f43-ab69-9643d397868f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:58.894006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2974f99b-2585-4f43-ab69-9643d397868f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:40:58.901248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2974f99b-2585-4f43-ab69-9643d397868f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:58.901727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2974f99b-2585-4f43-ab69-9643d397868f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:58.902160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2974f99b-2585-4f43-ab69-9643d397868f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:58.902882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2974f99b-2585-4f43-ab69-9643d397868f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:40:58.903330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2974f99b-2585-4f43-ab69-9643d397868f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:40:58.903753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2974f99b-2585-4f43-ab69-9643d397868f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:40:58.965794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2974f99b-2585-4f43-ab69-9643d397868f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:40:58.973434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2974f99b-2585-4f43-ab69-9643d397868f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083872 Sep 02 09:40:58.973993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 327/640] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:58 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:40:59.993895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6cb48b8e-782e-44aa-80ca-6cd2fb2757e8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:40:59.994540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6cb48b8e-782e-44aa-80ca-6cd2fb2757e8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:00.001241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6cb48b8e-782e-44aa-80ca-6cd2fb2757e8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:00.001715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6cb48b8e-782e-44aa-80ca-6cd2fb2757e8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:00.002143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6cb48b8e-782e-44aa-80ca-6cd2fb2757e8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:00.002848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6cb48b8e-782e-44aa-80ca-6cd2fb2757e8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:00.003298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6cb48b8e-782e-44aa-80ca-6cd2fb2757e8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:00.003719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6cb48b8e-782e-44aa-80ca-6cd2fb2757e8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:00.066653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6cb48b8e-782e-44aa-80ca-6cd2fb2757e8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:00.074822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6cb48b8e-782e-44aa-80ca-6cd2fb2757e8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084790 Sep 02 09:41:00.075379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 328/641] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:40:59 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:01.095789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e73b690f-7ac8-4afa-9dba-849edfa7b29a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:01.096471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e73b690f-7ac8-4afa-9dba-849edfa7b29a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:01.103238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e73b690f-7ac8-4afa-9dba-849edfa7b29a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:01.103710 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e73b690f-7ac8-4afa-9dba-849edfa7b29a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:01.104145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e73b690f-7ac8-4afa-9dba-849edfa7b29a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:01.104831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e73b690f-7ac8-4afa-9dba-849edfa7b29a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:01.105281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e73b690f-7ac8-4afa-9dba-849edfa7b29a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:01.105708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e73b690f-7ac8-4afa-9dba-849edfa7b29a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:01.167337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e73b690f-7ac8-4afa-9dba-849edfa7b29a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:01.174910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e73b690f-7ac8-4afa-9dba-849edfa7b29a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083083 Sep 02 09:41:01.175474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 329/642] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:01 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:02.194983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-32e0e79b-0f06-4e5f-b608-26b3356e3ed0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:02.195600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-32e0e79b-0f06-4e5f-b608-26b3356e3ed0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:02.202472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32e0e79b-0f06-4e5f-b608-26b3356e3ed0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:02.202984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32e0e79b-0f06-4e5f-b608-26b3356e3ed0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:02.203423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32e0e79b-0f06-4e5f-b608-26b3356e3ed0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:02.204106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32e0e79b-0f06-4e5f-b608-26b3356e3ed0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:02.204559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32e0e79b-0f06-4e5f-b608-26b3356e3ed0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:02.204985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32e0e79b-0f06-4e5f-b608-26b3356e3ed0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:02.266352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-32e0e79b-0f06-4e5f-b608-26b3356e3ed0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:02.274160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-32e0e79b-0f06-4e5f-b608-26b3356e3ed0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083131 Sep 02 09:41:02.275019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 330/643] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:02 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:03.294829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-994e383c-2383-4c90-b08f-1f140bdacc14 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:03.295462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-994e383c-2383-4c90-b08f-1f140bdacc14 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:03.301817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-994e383c-2383-4c90-b08f-1f140bdacc14 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:03.302300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-994e383c-2383-4c90-b08f-1f140bdacc14 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:03.302753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-994e383c-2383-4c90-b08f-1f140bdacc14 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:03.303439 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-994e383c-2383-4c90-b08f-1f140bdacc14 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:03.303892 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-994e383c-2383-4c90-b08f-1f140bdacc14 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:03.304316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-994e383c-2383-4c90-b08f-1f140bdacc14 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:03.365389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-994e383c-2383-4c90-b08f-1f140bdacc14 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:03.373017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-994e383c-2383-4c90-b08f-1f140bdacc14 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082121 Sep 02 09:41:03.373577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 331/644] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:03 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:04.394135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1daa259c-98f9-4993-9af7-c56d621fa580 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:04.394782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1daa259c-98f9-4993-9af7-c56d621fa580 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:04.402010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1daa259c-98f9-4993-9af7-c56d621fa580 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:04.402468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1daa259c-98f9-4993-9af7-c56d621fa580 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:04.402933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1daa259c-98f9-4993-9af7-c56d621fa580 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:04.403615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1daa259c-98f9-4993-9af7-c56d621fa580 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:04.404067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1daa259c-98f9-4993-9af7-c56d621fa580 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:04.404491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1daa259c-98f9-4993-9af7-c56d621fa580 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:04.467204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1daa259c-98f9-4993-9af7-c56d621fa580 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:04.469337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:04.475425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1daa259c-98f9-4993-9af7-c56d621fa580 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085152 Sep 02 09:41:04.475994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 332/645] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:04 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:05.497338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c43433a4-9a0c-48ea-8710-2bfb2ecd29b0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:05.497929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c43433a4-9a0c-48ea-8710-2bfb2ecd29b0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:05.504360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43433a4-9a0c-48ea-8710-2bfb2ecd29b0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:05.504843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43433a4-9a0c-48ea-8710-2bfb2ecd29b0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:05.505278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43433a4-9a0c-48ea-8710-2bfb2ecd29b0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:05.505955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43433a4-9a0c-48ea-8710-2bfb2ecd29b0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:05.506405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43433a4-9a0c-48ea-8710-2bfb2ecd29b0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:05.506860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43433a4-9a0c-48ea-8710-2bfb2ecd29b0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:05.567233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c43433a4-9a0c-48ea-8710-2bfb2ecd29b0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:05.575157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c43433a4-9a0c-48ea-8710-2bfb2ecd29b0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082532 Sep 02 09:41:05.575720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 333/646] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:05 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:06.595717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bf733942-64ae-4d7c-b22a-e505bf4635a7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:06.596396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bf733942-64ae-4d7c-b22a-e505bf4635a7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:06.602753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bf733942-64ae-4d7c-b22a-e505bf4635a7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:06.603242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bf733942-64ae-4d7c-b22a-e505bf4635a7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:06.603674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bf733942-64ae-4d7c-b22a-e505bf4635a7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:06.604360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bf733942-64ae-4d7c-b22a-e505bf4635a7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:06.604811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bf733942-64ae-4d7c-b22a-e505bf4635a7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:06.605233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bf733942-64ae-4d7c-b22a-e505bf4635a7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:06.667351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bf733942-64ae-4d7c-b22a-e505bf4635a7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:06.675064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bf733942-64ae-4d7c-b22a-e505bf4635a7 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083202 Sep 02 09:41:06.675815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 334/647] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:06 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:07.696340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9b81c903-eb04-4f9c-a8ab-9ba3d0531315 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:07.697475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9b81c903-eb04-4f9c-a8ab-9ba3d0531315 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:07.703576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b81c903-eb04-4f9c-a8ab-9ba3d0531315 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:07.704047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b81c903-eb04-4f9c-a8ab-9ba3d0531315 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:07.704476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b81c903-eb04-4f9c-a8ab-9ba3d0531315 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:07.705151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b81c903-eb04-4f9c-a8ab-9ba3d0531315 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:07.705598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b81c903-eb04-4f9c-a8ab-9ba3d0531315 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:07.706018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b81c903-eb04-4f9c-a8ab-9ba3d0531315 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:07.766225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9b81c903-eb04-4f9c-a8ab-9ba3d0531315 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:07.774084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9b81c903-eb04-4f9c-a8ab-9ba3d0531315 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081755 Sep 02 09:41:07.778543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 335/648] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:07 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:08.795482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e2e06463-1779-4363-911e-5698c09ea4d1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:08.796117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e2e06463-1779-4363-911e-5698c09ea4d1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:08.802404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2e06463-1779-4363-911e-5698c09ea4d1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:08.802921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2e06463-1779-4363-911e-5698c09ea4d1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:08.803362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2e06463-1779-4363-911e-5698c09ea4d1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:08.804050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2e06463-1779-4363-911e-5698c09ea4d1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:08.804500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2e06463-1779-4363-911e-5698c09ea4d1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:08.804921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2e06463-1779-4363-911e-5698c09ea4d1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:08.868472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e2e06463-1779-4363-911e-5698c09ea4d1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:08.876724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e2e06463-1779-4363-911e-5698c09ea4d1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085074 Sep 02 09:41:08.877295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 336/649] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:08 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:09.897465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a18464de-13b5-4669-b009-42b80953d182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:09.898076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a18464de-13b5-4669-b009-42b80953d182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:09.905404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a18464de-13b5-4669-b009-42b80953d182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:09.905886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a18464de-13b5-4669-b009-42b80953d182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:09.906323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a18464de-13b5-4669-b009-42b80953d182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:09.907039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a18464de-13b5-4669-b009-42b80953d182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:09.907493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a18464de-13b5-4669-b009-42b80953d182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:09.907916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a18464de-13b5-4669-b009-42b80953d182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:09.967646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a18464de-13b5-4669-b009-42b80953d182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:09.975144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a18464de-13b5-4669-b009-42b80953d182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081595 Sep 02 09:41:09.975714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 337/650] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:09 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:10.994992 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d573629e-ad63-41b0-ad50-9f502a6e5e79 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:10.995627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d573629e-ad63-41b0-ad50-9f502a6e5e79 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:11.002040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d573629e-ad63-41b0-ad50-9f502a6e5e79 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:11.002524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d573629e-ad63-41b0-ad50-9f502a6e5e79 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:11.002996 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d573629e-ad63-41b0-ad50-9f502a6e5e79 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:11.003718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d573629e-ad63-41b0-ad50-9f502a6e5e79 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:11.004167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d573629e-ad63-41b0-ad50-9f502a6e5e79 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:11.004591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d573629e-ad63-41b0-ad50-9f502a6e5e79 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:11.065621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d573629e-ad63-41b0-ad50-9f502a6e5e79 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:11.073497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d573629e-ad63-41b0-ad50-9f502a6e5e79 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082417 Sep 02 09:41:11.074057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 338/651] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:10 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:12.094098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3b686e99-bd08-4de9-b781-4bcc3efb42fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:12.094680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3b686e99-bd08-4de9-b781-4bcc3efb42fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:12.101258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b686e99-bd08-4de9-b781-4bcc3efb42fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:12.101682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b686e99-bd08-4de9-b781-4bcc3efb42fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:12.102112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b686e99-bd08-4de9-b781-4bcc3efb42fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:12.102808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b686e99-bd08-4de9-b781-4bcc3efb42fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:12.103760 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b686e99-bd08-4de9-b781-4bcc3efb42fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:12.104176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b686e99-bd08-4de9-b781-4bcc3efb42fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:12.163803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3b686e99-bd08-4de9-b781-4bcc3efb42fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:12.171981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3b686e99-bd08-4de9-b781-4bcc3efb42fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081788 Sep 02 09:41:12.172535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 339/652] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:12 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:13.192936 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6f26fb6d-62dd-4302-89ed-63591ecf1d13 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:13.193557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6f26fb6d-62dd-4302-89ed-63591ecf1d13 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:13.200464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f26fb6d-62dd-4302-89ed-63591ecf1d13 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:13.200935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f26fb6d-62dd-4302-89ed-63591ecf1d13 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:13.201364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f26fb6d-62dd-4302-89ed-63591ecf1d13 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:13.202041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f26fb6d-62dd-4302-89ed-63591ecf1d13 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:13.202487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f26fb6d-62dd-4302-89ed-63591ecf1d13 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:13.202931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f26fb6d-62dd-4302-89ed-63591ecf1d13 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:13.265369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6f26fb6d-62dd-4302-89ed-63591ecf1d13 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:13.273044 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6f26fb6d-62dd-4302-89ed-63591ecf1d13 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084036 Sep 02 09:41:13.273714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 340/653] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:13 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:14.293944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-79b7ced0-ebe8-4346-80da-9b01eac42b29 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:14.294596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-79b7ced0-ebe8-4346-80da-9b01eac42b29 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:14.300877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79b7ced0-ebe8-4346-80da-9b01eac42b29 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:14.301361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79b7ced0-ebe8-4346-80da-9b01eac42b29 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:14.301792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79b7ced0-ebe8-4346-80da-9b01eac42b29 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:14.302493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79b7ced0-ebe8-4346-80da-9b01eac42b29 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:14.302969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79b7ced0-ebe8-4346-80da-9b01eac42b29 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:14.303390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79b7ced0-ebe8-4346-80da-9b01eac42b29 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:14.364538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-79b7ced0-ebe8-4346-80da-9b01eac42b29 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:14.372085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-79b7ced0-ebe8-4346-80da-9b01eac42b29 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082037 Sep 02 09:41:14.372640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 341/654] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:14 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:15.009730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-bc1d3e6e-335d-40be-908d-71631e1483b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'services' on Instance uuid a2bccc75-d837-4a98-8a78-841b2edb8ce5 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:41:15.393502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f0e3ca96-11ee-4b70-9be7-ffc73203670a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:15.394045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f0e3ca96-11ee-4b70-9be7-ffc73203670a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:15.401229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0e3ca96-11ee-4b70-9be7-ffc73203670a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:15.401710 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0e3ca96-11ee-4b70-9be7-ffc73203670a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:15.402136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0e3ca96-11ee-4b70-9be7-ffc73203670a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:15.402842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0e3ca96-11ee-4b70-9be7-ffc73203670a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:15.403289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0e3ca96-11ee-4b70-9be7-ffc73203670a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:15.403740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0e3ca96-11ee-4b70-9be7-ffc73203670a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:15.463551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f0e3ca96-11ee-4b70-9be7-ffc73203670a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:15.470980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f0e3ca96-11ee-4b70-9be7-ffc73203670a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081430 Sep 02 09:41:15.471537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 342/655] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:15 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:16.491736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2feb3775-d017-4fda-9753-d2fc5733c08b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:16.492384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2feb3775-d017-4fda-9753-d2fc5733c08b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:16.499220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2feb3775-d017-4fda-9753-d2fc5733c08b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:16.499699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2feb3775-d017-4fda-9753-d2fc5733c08b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:16.500134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2feb3775-d017-4fda-9753-d2fc5733c08b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:16.500816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2feb3775-d017-4fda-9753-d2fc5733c08b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:16.501267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2feb3775-d017-4fda-9753-d2fc5733c08b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:16.501689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2feb3775-d017-4fda-9753-d2fc5733c08b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:16.562183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2feb3775-d017-4fda-9753-d2fc5733c08b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:16.569722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2feb3775-d017-4fda-9753-d2fc5733c08b tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081939 Sep 02 09:41:16.570279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 343/656] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:16 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:17.591082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7c083044-5f54-47bb-ab42-5cb82c09f36d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:17.591632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7c083044-5f54-47bb-ab42-5cb82c09f36d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:17.593933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=56 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:17.598568 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c083044-5f54-47bb-ab42-5cb82c09f36d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:17.599083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c083044-5f54-47bb-ab42-5cb82c09f36d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:17.599517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c083044-5f54-47bb-ab42-5cb82c09f36d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:17.600198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c083044-5f54-47bb-ab42-5cb82c09f36d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:17.600644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c083044-5f54-47bb-ab42-5cb82c09f36d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:17.601066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c083044-5f54-47bb-ab42-5cb82c09f36d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:17.665581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7c083044-5f54-47bb-ab42-5cb82c09f36d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:17.673349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7c083044-5f54-47bb-ab42-5cb82c09f36d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.086809 Sep 02 09:41:17.673944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 344/657] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:17 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:18.694434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bedc89a0-1eee-4e04-bf36-e08a62aeee20 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:18.695075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bedc89a0-1eee-4e04-bf36-e08a62aeee20 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:18.701550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedc89a0-1eee-4e04-bf36-e08a62aeee20 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:18.702040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedc89a0-1eee-4e04-bf36-e08a62aeee20 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:18.702476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedc89a0-1eee-4e04-bf36-e08a62aeee20 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:18.703192 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedc89a0-1eee-4e04-bf36-e08a62aeee20 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:18.703645 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedc89a0-1eee-4e04-bf36-e08a62aeee20 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:18.704071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedc89a0-1eee-4e04-bf36-e08a62aeee20 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:18.765682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bedc89a0-1eee-4e04-bf36-e08a62aeee20 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:18.773651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bedc89a0-1eee-4e04-bf36-e08a62aeee20 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083119 Sep 02 09:41:18.774224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 345/658] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:18 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:19.802650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c9254d20-775f-4a2e-9b1c-be2eee78e9b1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:19.803282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c9254d20-775f-4a2e-9b1c-be2eee78e9b1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:19.809810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9254d20-775f-4a2e-9b1c-be2eee78e9b1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:19.810287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9254d20-775f-4a2e-9b1c-be2eee78e9b1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:19.810740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9254d20-775f-4a2e-9b1c-be2eee78e9b1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:19.811414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9254d20-775f-4a2e-9b1c-be2eee78e9b1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:19.811861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9254d20-775f-4a2e-9b1c-be2eee78e9b1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:19.812280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9254d20-775f-4a2e-9b1c-be2eee78e9b1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:19.873572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c9254d20-775f-4a2e-9b1c-be2eee78e9b1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:19.881480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c9254d20-775f-4a2e-9b1c-be2eee78e9b1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082676 Sep 02 09:41:19.881980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 346/659] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:19 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:20.902839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-349f54f7-baa4-468b-853d-68348d78b182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:20.903444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-349f54f7-baa4-468b-853d-68348d78b182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:20.909830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349f54f7-baa4-468b-853d-68348d78b182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:20.910310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349f54f7-baa4-468b-853d-68348d78b182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:20.910775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349f54f7-baa4-468b-853d-68348d78b182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:20.911464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349f54f7-baa4-468b-853d-68348d78b182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:20.911914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349f54f7-baa4-468b-853d-68348d78b182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:20.912332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349f54f7-baa4-468b-853d-68348d78b182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:20.975193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-349f54f7-baa4-468b-853d-68348d78b182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:20.983487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-349f54f7-baa4-468b-853d-68348d78b182 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085310 Sep 02 09:41:20.984049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 347/660] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:20 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:22.003547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8501a519-b749-4b89-a717-3e17aa7b5f2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:22.004215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8501a519-b749-4b89-a717-3e17aa7b5f2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:22.011095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8501a519-b749-4b89-a717-3e17aa7b5f2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:22.011563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8501a519-b749-4b89-a717-3e17aa7b5f2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:22.011993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8501a519-b749-4b89-a717-3e17aa7b5f2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:22.012666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8501a519-b749-4b89-a717-3e17aa7b5f2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:22.013112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8501a519-b749-4b89-a717-3e17aa7b5f2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:22.013532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8501a519-b749-4b89-a717-3e17aa7b5f2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:22.076974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8501a519-b749-4b89-a717-3e17aa7b5f2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:22.084864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8501a519-b749-4b89-a717-3e17aa7b5f2a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085150 Sep 02 09:41:22.085422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 348/661] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:21 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:23.106394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a1049694-ea77-4d1c-bbc8-ad5c27d2407c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:23.107005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a1049694-ea77-4d1c-bbc8-ad5c27d2407c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:23.113441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1049694-ea77-4d1c-bbc8-ad5c27d2407c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:23.113925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1049694-ea77-4d1c-bbc8-ad5c27d2407c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:23.114365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1049694-ea77-4d1c-bbc8-ad5c27d2407c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:23.115076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1049694-ea77-4d1c-bbc8-ad5c27d2407c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:23.115528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1049694-ea77-4d1c-bbc8-ad5c27d2407c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:23.115950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1049694-ea77-4d1c-bbc8-ad5c27d2407c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:23.130552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:23.178118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a1049694-ea77-4d1c-bbc8-ad5c27d2407c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:23.185862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a1049694-ea77-4d1c-bbc8-ad5c27d2407c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084012 Sep 02 09:41:23.186417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 349/662] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:23 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:24.206069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-da22fecc-8ff2-4b0d-bc2c-87830f2aa821 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:24.206748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-da22fecc-8ff2-4b0d-bc2c-87830f2aa821 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:24.212944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da22fecc-8ff2-4b0d-bc2c-87830f2aa821 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:24.213492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da22fecc-8ff2-4b0d-bc2c-87830f2aa821 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:24.214423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da22fecc-8ff2-4b0d-bc2c-87830f2aa821 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:24.215131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da22fecc-8ff2-4b0d-bc2c-87830f2aa821 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:24.215579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da22fecc-8ff2-4b0d-bc2c-87830f2aa821 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:24.215997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da22fecc-8ff2-4b0d-bc2c-87830f2aa821 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:24.276601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-da22fecc-8ff2-4b0d-bc2c-87830f2aa821 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:24.284309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-da22fecc-8ff2-4b0d-bc2c-87830f2aa821 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082210 Sep 02 09:41:24.284873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 350/663] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:24 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:25.015048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:25.304585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9d7d88e7-c412-4ff7-b42b-cc30942c27b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:25.305196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9d7d88e7-c412-4ff7-b42b-cc30942c27b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:25.311597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d7d88e7-c412-4ff7-b42b-cc30942c27b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:25.312123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d7d88e7-c412-4ff7-b42b-cc30942c27b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:25.312613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d7d88e7-c412-4ff7-b42b-cc30942c27b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:25.313298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d7d88e7-c412-4ff7-b42b-cc30942c27b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:25.313751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d7d88e7-c412-4ff7-b42b-cc30942c27b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:25.314175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d7d88e7-c412-4ff7-b42b-cc30942c27b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:25.374380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9d7d88e7-c412-4ff7-b42b-cc30942c27b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:25.381960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9d7d88e7-c412-4ff7-b42b-cc30942c27b8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081348 Sep 02 09:41:25.382521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 351/664] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:25 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:26.402951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-78333f0d-448d-4564-984d-e4e566fa4e2f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:26.403812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-78333f0d-448d-4564-984d-e4e566fa4e2f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:26.410380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78333f0d-448d-4564-984d-e4e566fa4e2f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:26.410899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78333f0d-448d-4564-984d-e4e566fa4e2f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:26.411331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78333f0d-448d-4564-984d-e4e566fa4e2f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:26.412004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78333f0d-448d-4564-984d-e4e566fa4e2f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:26.412452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78333f0d-448d-4564-984d-e4e566fa4e2f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:26.412869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78333f0d-448d-4564-984d-e4e566fa4e2f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:26.475638 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-78333f0d-448d-4564-984d-e4e566fa4e2f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:26.483805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-78333f0d-448d-4564-984d-e4e566fa4e2f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084970 Sep 02 09:41:26.484382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 352/665] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:26 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:27.504748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6f4b3ad8-ab69-4153-8a15-c1ed0afdfc01 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:27.505349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6f4b3ad8-ab69-4153-8a15-c1ed0afdfc01 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:27.512291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4b3ad8-ab69-4153-8a15-c1ed0afdfc01 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:27.512766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4b3ad8-ab69-4153-8a15-c1ed0afdfc01 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:27.513195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4b3ad8-ab69-4153-8a15-c1ed0afdfc01 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:27.513870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4b3ad8-ab69-4153-8a15-c1ed0afdfc01 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:27.514317 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4b3ad8-ab69-4153-8a15-c1ed0afdfc01 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:27.514814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4b3ad8-ab69-4153-8a15-c1ed0afdfc01 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:27.575232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6f4b3ad8-ab69-4153-8a15-c1ed0afdfc01 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:27.582804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6f4b3ad8-ab69-4153-8a15-c1ed0afdfc01 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081860 Sep 02 09:41:27.583364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 353/666] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:27 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:28.602633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5ac7c7a4-2882-4a2f-8e67-15acec7ee589 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:28.603315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5ac7c7a4-2882-4a2f-8e67-15acec7ee589 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:28.610159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ac7c7a4-2882-4a2f-8e67-15acec7ee589 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:28.610642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ac7c7a4-2882-4a2f-8e67-15acec7ee589 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:28.611108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ac7c7a4-2882-4a2f-8e67-15acec7ee589 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:28.611822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ac7c7a4-2882-4a2f-8e67-15acec7ee589 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:28.612274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ac7c7a4-2882-4a2f-8e67-15acec7ee589 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:28.612696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ac7c7a4-2882-4a2f-8e67-15acec7ee589 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:28.674525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ac7c7a4-2882-4a2f-8e67-15acec7ee589 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:28.682184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5ac7c7a4-2882-4a2f-8e67-15acec7ee589 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083493 Sep 02 09:41:28.682761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 354/667] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:28 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:29.703778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4861d6bb-7bac-49b9-8eb7-2f080ff7863d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:29.704429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4861d6bb-7bac-49b9-8eb7-2f080ff7863d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:29.710782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4861d6bb-7bac-49b9-8eb7-2f080ff7863d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:29.711268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4861d6bb-7bac-49b9-8eb7-2f080ff7863d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:29.711701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4861d6bb-7bac-49b9-8eb7-2f080ff7863d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:29.712383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4861d6bb-7bac-49b9-8eb7-2f080ff7863d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:29.712830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4861d6bb-7bac-49b9-8eb7-2f080ff7863d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:29.713252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4861d6bb-7bac-49b9-8eb7-2f080ff7863d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:29.774436 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4861d6bb-7bac-49b9-8eb7-2f080ff7863d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:29.783075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4861d6bb-7bac-49b9-8eb7-2f080ff7863d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083172 Sep 02 09:41:29.783639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 355/668] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:29 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:30.803509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0101cbe8-b25a-4b24-bf86-9d064eedcf21 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:30.804172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0101cbe8-b25a-4b24-bf86-9d064eedcf21 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:30.810468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0101cbe8-b25a-4b24-bf86-9d064eedcf21 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:30.810984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0101cbe8-b25a-4b24-bf86-9d064eedcf21 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:30.811425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0101cbe8-b25a-4b24-bf86-9d064eedcf21 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:30.812110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0101cbe8-b25a-4b24-bf86-9d064eedcf21 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:30.812564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0101cbe8-b25a-4b24-bf86-9d064eedcf21 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:30.812988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0101cbe8-b25a-4b24-bf86-9d064eedcf21 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:30.876015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0101cbe8-b25a-4b24-bf86-9d064eedcf21 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:30.883827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0101cbe8-b25a-4b24-bf86-9d064eedcf21 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084165 Sep 02 09:41:30.884407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 356/669] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:30 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:31.904477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d6db2b3b-e053-4758-8c1a-436f8606219a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:31.905074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d6db2b3b-e053-4758-8c1a-436f8606219a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:31.911737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6db2b3b-e053-4758-8c1a-436f8606219a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:31.912220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6db2b3b-e053-4758-8c1a-436f8606219a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:31.912660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6db2b3b-e053-4758-8c1a-436f8606219a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:31.913344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6db2b3b-e053-4758-8c1a-436f8606219a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:31.913801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6db2b3b-e053-4758-8c1a-436f8606219a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:31.914226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6db2b3b-e053-4758-8c1a-436f8606219a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:31.974559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d6db2b3b-e053-4758-8c1a-436f8606219a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:31.982236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d6db2b3b-e053-4758-8c1a-436f8606219a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081874 Sep 02 09:41:31.982823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 357/670] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:31 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:33.002405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fcbf3f76-9f5a-4e69-ac0d-d67bc13521db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:33.003100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fcbf3f76-9f5a-4e69-ac0d-d67bc13521db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:33.009525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcbf3f76-9f5a-4e69-ac0d-d67bc13521db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:33.010007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcbf3f76-9f5a-4e69-ac0d-d67bc13521db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:33.010446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcbf3f76-9f5a-4e69-ac0d-d67bc13521db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:33.011153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcbf3f76-9f5a-4e69-ac0d-d67bc13521db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:33.012152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcbf3f76-9f5a-4e69-ac0d-d67bc13521db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:33.012553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcbf3f76-9f5a-4e69-ac0d-d67bc13521db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:33.071815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fcbf3f76-9f5a-4e69-ac0d-d67bc13521db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:33.080228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fcbf3f76-9f5a-4e69-ac0d-d67bc13521db tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081471 Sep 02 09:41:33.080789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 358/671] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:32 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:34.101508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-30954b88-407c-4325-a3d0-cf3c07710478 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:34.102157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-30954b88-407c-4325-a3d0-cf3c07710478 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:34.109173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-30954b88-407c-4325-a3d0-cf3c07710478 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:34.109653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-30954b88-407c-4325-a3d0-cf3c07710478 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:34.110078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-30954b88-407c-4325-a3d0-cf3c07710478 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:34.110788 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-30954b88-407c-4325-a3d0-cf3c07710478 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:34.111237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-30954b88-407c-4325-a3d0-cf3c07710478 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:34.111651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-30954b88-407c-4325-a3d0-cf3c07710478 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:34.172009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-30954b88-407c-4325-a3d0-cf3c07710478 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:34.179637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-30954b88-407c-4325-a3d0-cf3c07710478 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082139 Sep 02 09:41:34.180207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 359/672] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:34 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:35.199945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-86649586-1d95-4520-9d66-f73ce76a4e6d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:35.200572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-86649586-1d95-4520-9d66-f73ce76a4e6d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:35.206981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86649586-1d95-4520-9d66-f73ce76a4e6d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:35.207467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86649586-1d95-4520-9d66-f73ce76a4e6d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:35.207905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86649586-1d95-4520-9d66-f73ce76a4e6d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:35.208588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86649586-1d95-4520-9d66-f73ce76a4e6d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:35.209040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86649586-1d95-4520-9d66-f73ce76a4e6d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:35.209488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86649586-1d95-4520-9d66-f73ce76a4e6d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:35.274402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-86649586-1d95-4520-9d66-f73ce76a4e6d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:35.282367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-86649586-1d95-4520-9d66-f73ce76a4e6d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.086871 Sep 02 09:41:35.282964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 360/673] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:35 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:36.303223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6d4bb44e-f04c-4b8f-b875-21b395cdf895 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:36.303854 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6d4bb44e-f04c-4b8f-b875-21b395cdf895 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:36.310197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d4bb44e-f04c-4b8f-b875-21b395cdf895 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:36.310678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d4bb44e-f04c-4b8f-b875-21b395cdf895 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:36.311148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d4bb44e-f04c-4b8f-b875-21b395cdf895 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:36.311828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d4bb44e-f04c-4b8f-b875-21b395cdf895 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:36.312282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d4bb44e-f04c-4b8f-b875-21b395cdf895 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:36.312708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d4bb44e-f04c-4b8f-b875-21b395cdf895 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:36.372902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6d4bb44e-f04c-4b8f-b875-21b395cdf895 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:36.380546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6d4bb44e-f04c-4b8f-b875-21b395cdf895 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081342 Sep 02 09:41:36.381111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 361/674] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:36 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:37.402857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-67353332-1eea-471d-8225-90925ab62912 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:37.403481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-67353332-1eea-471d-8225-90925ab62912 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:37.410118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67353332-1eea-471d-8225-90925ab62912 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:37.410607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67353332-1eea-471d-8225-90925ab62912 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:37.411082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67353332-1eea-471d-8225-90925ab62912 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:37.411777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67353332-1eea-471d-8225-90925ab62912 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:37.412237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67353332-1eea-471d-8225-90925ab62912 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:37.412664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67353332-1eea-471d-8225-90925ab62912 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:37.477474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67353332-1eea-471d-8225-90925ab62912 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:37.483460 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-67353332-1eea-471d-8225-90925ab62912 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085387 Sep 02 09:41:37.484027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 362/675] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:37 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:38.503688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a5165661-1a52-4248-b9fa-301ae18f4291 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:38.504363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a5165661-1a52-4248-b9fa-301ae18f4291 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:38.510593 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5165661-1a52-4248-b9fa-301ae18f4291 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:38.511097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5165661-1a52-4248-b9fa-301ae18f4291 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:38.512022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5165661-1a52-4248-b9fa-301ae18f4291 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:38.512698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5165661-1a52-4248-b9fa-301ae18f4291 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:38.513146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5165661-1a52-4248-b9fa-301ae18f4291 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:38.513563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5165661-1a52-4248-b9fa-301ae18f4291 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:38.572879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a5165661-1a52-4248-b9fa-301ae18f4291 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:38.581153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a5165661-1a52-4248-b9fa-301ae18f4291 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081299 Sep 02 09:41:38.581726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 363/676] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:38 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:39.602135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4efda374-e53f-4aa2-ab3f-dfbb9c141660 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:39.602759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4efda374-e53f-4aa2-ab3f-dfbb9c141660 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:39.609754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4efda374-e53f-4aa2-ab3f-dfbb9c141660 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:39.610238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4efda374-e53f-4aa2-ab3f-dfbb9c141660 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:39.610714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4efda374-e53f-4aa2-ab3f-dfbb9c141660 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:39.611404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4efda374-e53f-4aa2-ab3f-dfbb9c141660 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:39.611859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4efda374-e53f-4aa2-ab3f-dfbb9c141660 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:39.612286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4efda374-e53f-4aa2-ab3f-dfbb9c141660 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:39.675146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4efda374-e53f-4aa2-ab3f-dfbb9c141660 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:39.682744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4efda374-e53f-4aa2-ab3f-dfbb9c141660 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084461 Sep 02 09:41:39.683312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 364/677] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:39 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:40.703047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-22360afa-6d38-42ed-b56e-8a410fae8201 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:40.703693 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-22360afa-6d38-42ed-b56e-8a410fae8201 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:40.710033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22360afa-6d38-42ed-b56e-8a410fae8201 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:40.710514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22360afa-6d38-42ed-b56e-8a410fae8201 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:40.710981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22360afa-6d38-42ed-b56e-8a410fae8201 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:40.711667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22360afa-6d38-42ed-b56e-8a410fae8201 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:40.712118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22360afa-6d38-42ed-b56e-8a410fae8201 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:40.712541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-22360afa-6d38-42ed-b56e-8a410fae8201 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:40.773024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-22360afa-6d38-42ed-b56e-8a410fae8201 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:40.780899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-22360afa-6d38-42ed-b56e-8a410fae8201 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081791 Sep 02 09:41:40.781458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 365/678] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:40 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:41.802207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4fea3709-f7c9-45ce-b2bb-7d584bc58ef5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:41.802871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4fea3709-f7c9-45ce-b2bb-7d584bc58ef5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:41.809836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4fea3709-f7c9-45ce-b2bb-7d584bc58ef5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:41.810316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4fea3709-f7c9-45ce-b2bb-7d584bc58ef5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:41.810782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4fea3709-f7c9-45ce-b2bb-7d584bc58ef5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:41.811470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4fea3709-f7c9-45ce-b2bb-7d584bc58ef5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:41.811922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4fea3709-f7c9-45ce-b2bb-7d584bc58ef5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:41.812347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4fea3709-f7c9-45ce-b2bb-7d584bc58ef5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:41.816218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:41.873018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4fea3709-f7c9-45ce-b2bb-7d584bc58ef5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:41.880723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4fea3709-f7c9-45ce-b2bb-7d584bc58ef5 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083133 Sep 02 09:41:41.881283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 366/679] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:41 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:42.901791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-921b5713-1e6e-4bdc-bb0b-e02401568f5e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:42.903094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-921b5713-1e6e-4bdc-bb0b-e02401568f5e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:42.909401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-921b5713-1e6e-4bdc-bb0b-e02401568f5e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:42.909892 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-921b5713-1e6e-4bdc-bb0b-e02401568f5e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:42.910325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-921b5713-1e6e-4bdc-bb0b-e02401568f5e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:42.911039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-921b5713-1e6e-4bdc-bb0b-e02401568f5e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:42.911501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-921b5713-1e6e-4bdc-bb0b-e02401568f5e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:42.911927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-921b5713-1e6e-4bdc-bb0b-e02401568f5e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:42.974549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-921b5713-1e6e-4bdc-bb0b-e02401568f5e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:41:42.982226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-921b5713-1e6e-4bdc-bb0b-e02401568f5e tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084704 Sep 02 09:41:42.982810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 367/680] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:41:42 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:41:43.509667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:41:43.510158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:41:43.516257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:43.516743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:43.517174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:43.517856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:41:43.518302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:41:43.518752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:41:53.513801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=49 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:41:53.537532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=15 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:01.254044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:42:01.254548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:42:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 (ip 10.222.0.57) !!! Sep 02 09:42:01.255514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:42:01.255651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:42:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 (ip 10.222.0.57) !!! Sep 02 09:42:04.556490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:42:04.557064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 09:42:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 (ip 10.222.0.57) !!! Sep 02 09:42:43.931218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bc1d3e6e-335d-40be-908d-71631e1483b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412" status: 202 len: 0 microversion: 2.1 time: 120.480532 Sep 02 09:42:43.934064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 314/681] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:40:43 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 => generated 0 bytes in 120482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:42:43.937510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a9c42c1d-4467-47b8-ba7c-76ba0a3c6d17 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:42:43.938202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a9c42c1d-4467-47b8-ba7c-76ba0a3c6d17 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:42:43.945096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a9c42c1d-4467-47b8-ba7c-76ba0a3c6d17 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:42:43.945583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a9c42c1d-4467-47b8-ba7c-76ba0a3c6d17 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:42:43.946241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a9c42c1d-4467-47b8-ba7c-76ba0a3c6d17 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:42:43.947187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a9c42c1d-4467-47b8-ba7c-76ba0a3c6d17 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:42:43.947644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a9c42c1d-4467-47b8-ba7c-76ba0a3c6d17 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:42:43.948069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a9c42c1d-4467-47b8-ba7c-76ba0a3c6d17 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:42:44.013579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a9c42c1d-4467-47b8-ba7c-76ba0a3c6d17 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:42:44.021419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a9c42c1d-4467-47b8-ba7c-76ba0a3c6d17 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.088350 Sep 02 09:42:44.022001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 315/682] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:42:43 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:42:44.027395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:42:44.028019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:42:44.034420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:42:44.034943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:42:44.035381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:42:44.036078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:42:44.036523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:42:44.036943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:42:44.119670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'services' on Instance uuid a2bccc75-d837-4a98-8a78-841b2edb8ce5 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:42:54.031600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:54.056978 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:42:54.154194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=4 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:15.175203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'services' on Instance uuid a2bccc75-d837-4a98-8a78-841b2edb8ce5 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:43:15.205450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4667ce0-d515-4339-aaf3-bd5b75781338) Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 HTTP/1.1 Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:43:15.208347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:43:15.209696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:43:15.209696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:43:15.209696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:43:15.209696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:43:15.209696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:43:15.209696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:43:15.209696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:43:15.209696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 09:43:15.209696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:43:15.209696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4667ce0-d515-4339-aaf3-bd5b75781338) Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'server_id': 'a2bccc75-d837-4a98-8a78-841b2edb8ce5', 'id': '6aefd94e-dc9d-4a48-9b8a-97e273701412'} Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:43:15.210328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4667ce0-d515-4339-aaf3-bd5b75781338) Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:43:15.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4667ce0-d515-4339-aaf3-bd5b75781338) Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:43:15.213659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4667ce0-d515-4339-aaf3-bd5b75781338) Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:43:15.214933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4667ce0-d515-4339-aaf3-bd5b75781338) Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4667ce0-d515-4339-aaf3-bd5b75781338) Sep 02 09:43:15.216319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:43:15.217811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b4667ce0-d515-4339-aaf3-bd5b75781338) {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:43:15.217811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d59de414-292e-46fd-afe1-4ad0facc8525 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412" status: 400 len: 269 microversion: 2.1 time: 91.704175 Sep 02 09:43:15.217811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 368/683] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:41:43 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 => generated 269 bytes in 91705 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 02 09:43:15.217811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-320012b1-3265-4da9-8c5f-b471b2cb3c37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:15.218173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-320012b1-3265-4da9-8c5f-b471b2cb3c37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:15.222134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-320012b1-3265-4da9-8c5f-b471b2cb3c37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:15.222620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-320012b1-3265-4da9-8c5f-b471b2cb3c37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:15.223096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-320012b1-3265-4da9-8c5f-b471b2cb3c37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:15.223813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-320012b1-3265-4da9-8c5f-b471b2cb3c37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:15.224268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-320012b1-3265-4da9-8c5f-b471b2cb3c37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:15.224695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-320012b1-3265-4da9-8c5f-b471b2cb3c37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:15.287885 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-320012b1-3265-4da9-8c5f-b471b2cb3c37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:15.295661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-320012b1-3265-4da9-8c5f-b471b2cb3c37 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084304 Sep 02 09:43:15.296225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 369/684] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:15 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:43:16.315960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d37f799a-3961-4952-8614-543e1a95f444 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:16.316578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d37f799a-3961-4952-8614-543e1a95f444 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:16.322892 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d37f799a-3961-4952-8614-543e1a95f444 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:16.323372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d37f799a-3961-4952-8614-543e1a95f444 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:16.323802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d37f799a-3961-4952-8614-543e1a95f444 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:16.324480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d37f799a-3961-4952-8614-543e1a95f444 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:16.324925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d37f799a-3961-4952-8614-543e1a95f444 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:16.325344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d37f799a-3961-4952-8614-543e1a95f444 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:16.388549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d37f799a-3961-4952-8614-543e1a95f444 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:16.396822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d37f799a-3961-4952-8614-543e1a95f444 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084807 Sep 02 09:43:16.397382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 370/685] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:16 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:17.417672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-34ee663c-f1a3-40f1-ab93-4f44e9254ec4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:17.418273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-34ee663c-f1a3-40f1-ab93-4f44e9254ec4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:17.424705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34ee663c-f1a3-40f1-ab93-4f44e9254ec4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:17.425186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34ee663c-f1a3-40f1-ab93-4f44e9254ec4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:17.425612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34ee663c-f1a3-40f1-ab93-4f44e9254ec4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:17.426285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34ee663c-f1a3-40f1-ab93-4f44e9254ec4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:17.427449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34ee663c-f1a3-40f1-ab93-4f44e9254ec4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:17.427874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34ee663c-f1a3-40f1-ab93-4f44e9254ec4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:17.486921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-34ee663c-f1a3-40f1-ab93-4f44e9254ec4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:17.495145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-34ee663c-f1a3-40f1-ab93-4f44e9254ec4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081298 Sep 02 09:43:17.495710 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 371/686] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:17 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:18.515202 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7851e832-d4b2-467f-a33d-bc10df1c8172 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:18.515835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7851e832-d4b2-467f-a33d-bc10df1c8172 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:18.522969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7851e832-d4b2-467f-a33d-bc10df1c8172 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:18.523462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7851e832-d4b2-467f-a33d-bc10df1c8172 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:18.523903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7851e832-d4b2-467f-a33d-bc10df1c8172 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:18.524585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7851e832-d4b2-467f-a33d-bc10df1c8172 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:18.525039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7851e832-d4b2-467f-a33d-bc10df1c8172 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:18.525463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7851e832-d4b2-467f-a33d-bc10df1c8172 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:18.589785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7851e832-d4b2-467f-a33d-bc10df1c8172 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:18.597513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7851e832-d4b2-467f-a33d-bc10df1c8172 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.086212 Sep 02 09:43:18.598082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 372/687] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:18 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:19.617501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0b3f6ab1-88d9-4484-9967-3ad89f0d88f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:19.618136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0b3f6ab1-88d9-4484-9967-3ad89f0d88f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:19.624482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b3f6ab1-88d9-4484-9967-3ad89f0d88f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:19.624968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b3f6ab1-88d9-4484-9967-3ad89f0d88f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:19.625405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b3f6ab1-88d9-4484-9967-3ad89f0d88f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:19.626096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b3f6ab1-88d9-4484-9967-3ad89f0d88f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:19.626546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b3f6ab1-88d9-4484-9967-3ad89f0d88f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:19.626995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b3f6ab1-88d9-4484-9967-3ad89f0d88f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:19.687275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0b3f6ab1-88d9-4484-9967-3ad89f0d88f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:19.695371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0b3f6ab1-88d9-4484-9967-3ad89f0d88f8 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081907 Sep 02 09:43:19.695942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 373/688] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:19 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:20.716409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3080eaaf-ee90-4fb3-b2d0-d2ee5b957220 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:20.717085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3080eaaf-ee90-4fb3-b2d0-d2ee5b957220 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:20.723897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3080eaaf-ee90-4fb3-b2d0-d2ee5b957220 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:20.724378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3080eaaf-ee90-4fb3-b2d0-d2ee5b957220 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:20.724808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3080eaaf-ee90-4fb3-b2d0-d2ee5b957220 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:20.725496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3080eaaf-ee90-4fb3-b2d0-d2ee5b957220 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:20.725945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3080eaaf-ee90-4fb3-b2d0-d2ee5b957220 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:20.726366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3080eaaf-ee90-4fb3-b2d0-d2ee5b957220 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:20.789240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3080eaaf-ee90-4fb3-b2d0-d2ee5b957220 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:20.796789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3080eaaf-ee90-4fb3-b2d0-d2ee5b957220 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084264 Sep 02 09:43:20.797343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 374/689] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:20 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:21.817233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0bb832b1-ce3e-4310-84e7-234df8f970cc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:21.817909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0bb832b1-ce3e-4310-84e7-234df8f970cc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:21.824163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bb832b1-ce3e-4310-84e7-234df8f970cc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:21.824645 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bb832b1-ce3e-4310-84e7-234df8f970cc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:21.825080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bb832b1-ce3e-4310-84e7-234df8f970cc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:21.825763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bb832b1-ce3e-4310-84e7-234df8f970cc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:21.826215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bb832b1-ce3e-4310-84e7-234df8f970cc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:21.826677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bb832b1-ce3e-4310-84e7-234df8f970cc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:21.890127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0bb832b1-ce3e-4310-84e7-234df8f970cc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:21.898535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0bb832b1-ce3e-4310-84e7-234df8f970cc tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085137 Sep 02 09:43:21.899124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 375/690] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:21 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:22.919828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f368af96-fc41-488a-ae27-568e6cb6936c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:22.920473 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f368af96-fc41-488a-ae27-568e6cb6936c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:22.927492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f368af96-fc41-488a-ae27-568e6cb6936c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:22.927978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f368af96-fc41-488a-ae27-568e6cb6936c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:22.928421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f368af96-fc41-488a-ae27-568e6cb6936c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:22.929105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f368af96-fc41-488a-ae27-568e6cb6936c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:22.929557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f368af96-fc41-488a-ae27-568e6cb6936c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:22.930009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f368af96-fc41-488a-ae27-568e6cb6936c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:22.992292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f368af96-fc41-488a-ae27-568e6cb6936c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:22.999886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f368af96-fc41-488a-ae27-568e6cb6936c tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083918 Sep 02 09:43:23.000457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 376/691] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:22 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:24.020841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3758ca42-e477-45a1-9162-9b75a4506f46 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:24.021505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3758ca42-e477-45a1-9162-9b75a4506f46 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:24.028184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3758ca42-e477-45a1-9162-9b75a4506f46 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:24.028669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3758ca42-e477-45a1-9162-9b75a4506f46 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:24.029119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3758ca42-e477-45a1-9162-9b75a4506f46 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:24.029810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3758ca42-e477-45a1-9162-9b75a4506f46 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:24.030263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3758ca42-e477-45a1-9162-9b75a4506f46 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:24.030685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3758ca42-e477-45a1-9162-9b75a4506f46 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:24.090861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3758ca42-e477-45a1-9162-9b75a4506f46 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:24.099211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3758ca42-e477-45a1-9162-9b75a4506f46 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082079 Sep 02 09:43:24.099777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 377/692] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:24 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:25.120241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5bb7bd0b-e33a-426f-8112-f4631acddba1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:25.120878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5bb7bd0b-e33a-426f-8112-f4631acddba1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:25.127186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5bb7bd0b-e33a-426f-8112-f4631acddba1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:25.127668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5bb7bd0b-e33a-426f-8112-f4631acddba1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:25.128107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5bb7bd0b-e33a-426f-8112-f4631acddba1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:25.128785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5bb7bd0b-e33a-426f-8112-f4631acddba1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:25.129236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5bb7bd0b-e33a-426f-8112-f4631acddba1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:25.129656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5bb7bd0b-e33a-426f-8112-f4631acddba1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:25.179487 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:25.189275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5bb7bd0b-e33a-426f-8112-f4631acddba1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:25.197097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5bb7bd0b-e33a-426f-8112-f4631acddba1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080655 Sep 02 09:43:25.197655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 378/693] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:25 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:26.216613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4d19a1e3-1e38-4b73-9f92-04f2bc3603e2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:26.217226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4d19a1e3-1e38-4b73-9f92-04f2bc3603e2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:26.223525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d19a1e3-1e38-4b73-9f92-04f2bc3603e2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:26.224011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d19a1e3-1e38-4b73-9f92-04f2bc3603e2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:26.224444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d19a1e3-1e38-4b73-9f92-04f2bc3603e2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:26.225126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d19a1e3-1e38-4b73-9f92-04f2bc3603e2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:26.225578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d19a1e3-1e38-4b73-9f92-04f2bc3603e2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:26.226011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d19a1e3-1e38-4b73-9f92-04f2bc3603e2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:26.285762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4d19a1e3-1e38-4b73-9f92-04f2bc3603e2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:26.293404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4d19a1e3-1e38-4b73-9f92-04f2bc3603e2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080734 Sep 02 09:43:26.293970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 379/694] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:26 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:27.315718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ce9dfff5-f231-428d-99f4-6ec24ceed46f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:27.316498 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ce9dfff5-f231-428d-99f4-6ec24ceed46f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:27.323223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce9dfff5-f231-428d-99f4-6ec24ceed46f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:27.323746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce9dfff5-f231-428d-99f4-6ec24ceed46f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:27.324182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce9dfff5-f231-428d-99f4-6ec24ceed46f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:27.324873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce9dfff5-f231-428d-99f4-6ec24ceed46f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:27.325325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce9dfff5-f231-428d-99f4-6ec24ceed46f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:27.325749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce9dfff5-f231-428d-99f4-6ec24ceed46f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:27.388623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ce9dfff5-f231-428d-99f4-6ec24ceed46f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:27.396941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ce9dfff5-f231-428d-99f4-6ec24ceed46f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.085065 Sep 02 09:43:27.397493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 380/695] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:27 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:28.417305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-11a1d2b6-0bbf-429c-93c9-67bc9ec5e234 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:28.417916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-11a1d2b6-0bbf-429c-93c9-67bc9ec5e234 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:28.424657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11a1d2b6-0bbf-429c-93c9-67bc9ec5e234 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:28.425145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11a1d2b6-0bbf-429c-93c9-67bc9ec5e234 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:28.425580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11a1d2b6-0bbf-429c-93c9-67bc9ec5e234 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:28.426262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11a1d2b6-0bbf-429c-93c9-67bc9ec5e234 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:28.426729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11a1d2b6-0bbf-429c-93c9-67bc9ec5e234 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:28.427191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11a1d2b6-0bbf-429c-93c9-67bc9ec5e234 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:28.488166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-11a1d2b6-0bbf-429c-93c9-67bc9ec5e234 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:28.496169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-11a1d2b6-0bbf-429c-93c9-67bc9ec5e234 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082679 Sep 02 09:43:28.496727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 381/696] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:28 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:29.517461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e89eeefc-f1f1-4e72-8f05-62bbf2f846d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:29.518070 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e89eeefc-f1f1-4e72-8f05-62bbf2f846d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:29.525005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e89eeefc-f1f1-4e72-8f05-62bbf2f846d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:29.525484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e89eeefc-f1f1-4e72-8f05-62bbf2f846d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:29.525922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e89eeefc-f1f1-4e72-8f05-62bbf2f846d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:29.526598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e89eeefc-f1f1-4e72-8f05-62bbf2f846d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:29.527347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e89eeefc-f1f1-4e72-8f05-62bbf2f846d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:29.527772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e89eeefc-f1f1-4e72-8f05-62bbf2f846d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:29.587552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e89eeefc-f1f1-4e72-8f05-62bbf2f846d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:29.595230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e89eeefc-f1f1-4e72-8f05-62bbf2f846d4 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081573 Sep 02 09:43:29.595737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 382/697] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:29 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:30.615602 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-020f7b91-2c01-4737-95e6-107f2ba6c12d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:30.616282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-020f7b91-2c01-4737-95e6-107f2ba6c12d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:30.622567 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-020f7b91-2c01-4737-95e6-107f2ba6c12d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:30.623092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-020f7b91-2c01-4737-95e6-107f2ba6c12d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:30.623530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-020f7b91-2c01-4737-95e6-107f2ba6c12d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:30.624225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-020f7b91-2c01-4737-95e6-107f2ba6c12d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:30.624675 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-020f7b91-2c01-4737-95e6-107f2ba6c12d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:30.625096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-020f7b91-2c01-4737-95e6-107f2ba6c12d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:30.685386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-020f7b91-2c01-4737-95e6-107f2ba6c12d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:30.692933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-020f7b91-2c01-4737-95e6-107f2ba6c12d tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081213 Sep 02 09:43:30.693492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 383/698] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:30 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:31.714042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3ad22287-80cf-44d9-ba93-3b672234c601 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:31.714678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3ad22287-80cf-44d9-ba93-3b672234c601 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:31.720968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ad22287-80cf-44d9-ba93-3b672234c601 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:31.721455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ad22287-80cf-44d9-ba93-3b672234c601 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:31.721896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ad22287-80cf-44d9-ba93-3b672234c601 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:31.722581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ad22287-80cf-44d9-ba93-3b672234c601 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:31.723074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ad22287-80cf-44d9-ba93-3b672234c601 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:31.723505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ad22287-80cf-44d9-ba93-3b672234c601 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:31.786180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3ad22287-80cf-44d9-ba93-3b672234c601 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:31.794005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3ad22287-80cf-44d9-ba93-3b672234c601 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084502 Sep 02 09:43:31.794582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 384/699] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:31 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:32.814388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3680cb62-937f-4d4b-8213-16a03cca2b5a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:32.815128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3680cb62-937f-4d4b-8213-16a03cca2b5a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:32.822011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3680cb62-937f-4d4b-8213-16a03cca2b5a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:32.822496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3680cb62-937f-4d4b-8213-16a03cca2b5a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:32.822961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3680cb62-937f-4d4b-8213-16a03cca2b5a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:32.823646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3680cb62-937f-4d4b-8213-16a03cca2b5a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:32.824101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3680cb62-937f-4d4b-8213-16a03cca2b5a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:32.824524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3680cb62-937f-4d4b-8213-16a03cca2b5a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:32.842132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:32.885040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3680cb62-937f-4d4b-8213-16a03cca2b5a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:32.892549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3680cb62-937f-4d4b-8213-16a03cca2b5a tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.082027 Sep 02 09:43:32.893102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 385/700] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:32 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:33.913396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-97f9616b-bcc2-49e7-9511-4f609a005974 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:33.914013 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-97f9616b-bcc2-49e7-9511-4f609a005974 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:33.920469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-97f9616b-bcc2-49e7-9511-4f609a005974 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:33.920956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-97f9616b-bcc2-49e7-9511-4f609a005974 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:33.921393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-97f9616b-bcc2-49e7-9511-4f609a005974 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:33.922080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-97f9616b-bcc2-49e7-9511-4f609a005974 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:33.922538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-97f9616b-bcc2-49e7-9511-4f609a005974 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:33.922995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-97f9616b-bcc2-49e7-9511-4f609a005974 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:33.982805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-97f9616b-bcc2-49e7-9511-4f609a005974 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:33.990346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-97f9616b-bcc2-49e7-9511-4f609a005974 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080986 Sep 02 09:43:33.990942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 386/701] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:33 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:35.012911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4aedae90-219c-4718-9e0c-da31357a7c86 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:35.013574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4aedae90-219c-4718-9e0c-da31357a7c86 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:35.019949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aedae90-219c-4718-9e0c-da31357a7c86 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:35.020431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aedae90-219c-4718-9e0c-da31357a7c86 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:35.020870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aedae90-219c-4718-9e0c-da31357a7c86 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:35.021552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aedae90-219c-4718-9e0c-da31357a7c86 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:35.022005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aedae90-219c-4718-9e0c-da31357a7c86 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:35.022436 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aedae90-219c-4718-9e0c-da31357a7c86 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:35.085059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4aedae90-219c-4718-9e0c-da31357a7c86 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:35.092651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4aedae90-219c-4718-9e0c-da31357a7c86 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083671 Sep 02 09:43:35.093215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 387/702] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:35 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:36.113169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-28bf5969-cd79-4d89-a6f3-f5d97acb8af6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:36.113802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-28bf5969-cd79-4d89-a6f3-f5d97acb8af6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:36.120134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28bf5969-cd79-4d89-a6f3-f5d97acb8af6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:36.120609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28bf5969-cd79-4d89-a6f3-f5d97acb8af6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:36.121038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28bf5969-cd79-4d89-a6f3-f5d97acb8af6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:36.121707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28bf5969-cd79-4d89-a6f3-f5d97acb8af6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:36.122151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28bf5969-cd79-4d89-a6f3-f5d97acb8af6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:36.122566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28bf5969-cd79-4d89-a6f3-f5d97acb8af6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:36.185425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-28bf5969-cd79-4d89-a6f3-f5d97acb8af6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:36.192962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-28bf5969-cd79-4d89-a6f3-f5d97acb8af6 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083734 Sep 02 09:43:36.193521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 388/703] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:36 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:37.214099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f99ad518-a846-4980-9a4e-2fea22384233 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:37.214766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f99ad518-a846-4980-9a4e-2fea22384233 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:37.221047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f99ad518-a846-4980-9a4e-2fea22384233 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:37.221533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f99ad518-a846-4980-9a4e-2fea22384233 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:37.221972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f99ad518-a846-4980-9a4e-2fea22384233 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:37.222654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f99ad518-a846-4980-9a4e-2fea22384233 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:37.223135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f99ad518-a846-4980-9a4e-2fea22384233 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:37.223555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f99ad518-a846-4980-9a4e-2fea22384233 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:37.512223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f99ad518-a846-4980-9a4e-2fea22384233 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:37.520066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f99ad518-a846-4980-9a4e-2fea22384233 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.310369 Sep 02 09:43:37.520623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 389/704] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:37 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:38.540235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-83bbfe40-5e78-4191-95b8-fb7ce10122a0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:38.540914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-83bbfe40-5e78-4191-95b8-fb7ce10122a0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:38.547349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83bbfe40-5e78-4191-95b8-fb7ce10122a0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:38.547836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83bbfe40-5e78-4191-95b8-fb7ce10122a0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:38.548270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83bbfe40-5e78-4191-95b8-fb7ce10122a0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:38.548959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83bbfe40-5e78-4191-95b8-fb7ce10122a0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:38.549411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83bbfe40-5e78-4191-95b8-fb7ce10122a0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:38.549839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83bbfe40-5e78-4191-95b8-fb7ce10122a0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:38.609450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-83bbfe40-5e78-4191-95b8-fb7ce10122a0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:38.617000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-83bbfe40-5e78-4191-95b8-fb7ce10122a0 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080631 Sep 02 09:43:38.617564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 390/705] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:38 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:39.637328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-25b0308d-5a03-4a74-813d-1273e8c2bf42 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:39.637938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-25b0308d-5a03-4a74-813d-1273e8c2bf42 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:39.644300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0308d-5a03-4a74-813d-1273e8c2bf42 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:39.644787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0308d-5a03-4a74-813d-1273e8c2bf42 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:39.645221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0308d-5a03-4a74-813d-1273e8c2bf42 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:39.645901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0308d-5a03-4a74-813d-1273e8c2bf42 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:39.646353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0308d-5a03-4a74-813d-1273e8c2bf42 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:39.646807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0308d-5a03-4a74-813d-1273e8c2bf42 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:39.706574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-25b0308d-5a03-4a74-813d-1273e8c2bf42 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:39.714618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-25b0308d-5a03-4a74-813d-1273e8c2bf42 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.081222 Sep 02 09:43:39.715202 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 391/706] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:39 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:40.735284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c1ceece9-651c-4689-a3cc-4b1c32db244f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:40.735954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c1ceece9-651c-4689-a3cc-4b1c32db244f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:40.742263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c1ceece9-651c-4689-a3cc-4b1c32db244f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:40.742743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c1ceece9-651c-4689-a3cc-4b1c32db244f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:40.743184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c1ceece9-651c-4689-a3cc-4b1c32db244f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:40.744432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c1ceece9-651c-4689-a3cc-4b1c32db244f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:40.744878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c1ceece9-651c-4689-a3cc-4b1c32db244f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:40.745299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c1ceece9-651c-4689-a3cc-4b1c32db244f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:40.804144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c1ceece9-651c-4689-a3cc-4b1c32db244f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:40.812254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c1ceece9-651c-4689-a3cc-4b1c32db244f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.080774 Sep 02 09:43:40.812816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 392/707] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:40 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:41.264891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:43:41.265427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:43:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 (ip 10.222.0.57) !!! Sep 02 09:43:41.832678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c7ec4d74-1740-43ec-a80b-09716271b53f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:41.833230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c7ec4d74-1740-43ec-a80b-09716271b53f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:41.839613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7ec4d74-1740-43ec-a80b-09716271b53f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:41.840091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7ec4d74-1740-43ec-a80b-09716271b53f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:41.840523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7ec4d74-1740-43ec-a80b-09716271b53f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:41.841202 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7ec4d74-1740-43ec-a80b-09716271b53f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:41.841651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7ec4d74-1740-43ec-a80b-09716271b53f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:41.842073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7ec4d74-1740-43ec-a80b-09716271b53f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:41.904720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c7ec4d74-1740-43ec-a80b-09716271b53f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:41.912306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c7ec4d74-1740-43ec-a80b-09716271b53f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.083563 Sep 02 09:43:41.912872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 393/708] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:41 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:42.932694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3aefa3f6-cf42-462e-9173-deda2041be61 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:42.933307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3aefa3f6-cf42-462e-9173-deda2041be61 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:42.939734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aefa3f6-cf42-462e-9173-deda2041be61 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:42.940221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aefa3f6-cf42-462e-9173-deda2041be61 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:42.940658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aefa3f6-cf42-462e-9173-deda2041be61 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:42.941344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aefa3f6-cf42-462e-9173-deda2041be61 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:42.941793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aefa3f6-cf42-462e-9173-deda2041be61 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:42.942214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aefa3f6-cf42-462e-9173-deda2041be61 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:43.004834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3aefa3f6-cf42-462e-9173-deda2041be61 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:43:43.012907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3aefa3f6-cf42-462e-9173-deda2041be61 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.084041 Sep 02 09:43:43.013468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 394/709] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:43:42 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:43:43.632370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:43:43.632863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:43:43.634678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=53 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:43.639289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:43.639807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:43.640243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:43.640926 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:43:43.641380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:43:43.641804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:43:44.569009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:43:44.569662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 09:43:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 (ip 10.222.0.57) !!! Sep 02 09:43:53.660253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=60 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:43:53.672130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:44.313579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca370ee9-817d-44ff-8846-4c5b1edfb56f) Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 HTTP/1.1 Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:44:44.317021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:44:44.318810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:44:44.318810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:44:44.318810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:44:44.318810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:44:44.318810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:44:44.318810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:44:44.318810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:44:44.318810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 09:44:44.318810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:44:44.318810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca370ee9-817d-44ff-8846-4c5b1edfb56f) Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'server_id': 'a2bccc75-d837-4a98-8a78-841b2edb8ce5', 'id': '6aefd94e-dc9d-4a48-9b8a-97e273701412'} Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:44:44.319736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca370ee9-817d-44ff-8846-4c5b1edfb56f) Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:44:44.321509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca370ee9-817d-44ff-8846-4c5b1edfb56f) Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:44:44.322928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca370ee9-817d-44ff-8846-4c5b1edfb56f) Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:44:44.324171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca370ee9-817d-44ff-8846-4c5b1edfb56f) Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca370ee9-817d-44ff-8846-4c5b1edfb56f) Sep 02 09:44:44.325511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:44:44.326883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ca370ee9-817d-44ff-8846-4c5b1edfb56f) {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:44:44.326883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e9c6af1e-d302-4588-9b83-00c834aa8810 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412" status: 400 len: 269 microversion: 2.1 time: 120.295078 Sep 02 09:44:44.326883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 316/710] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:42:44 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 => generated 269 bytes in 120296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:44:44.326883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d5e08c0d-be3e-4549-bdfa-43089ae23a68 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:44:44.327238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d5e08c0d-be3e-4549-bdfa-43089ae23a68 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:44:44.331573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5e08c0d-be3e-4549-bdfa-43089ae23a68 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:44:44.332056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5e08c0d-be3e-4549-bdfa-43089ae23a68 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:44:44.332490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5e08c0d-be3e-4549-bdfa-43089ae23a68 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:44:44.333180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5e08c0d-be3e-4549-bdfa-43089ae23a68 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:44:44.333630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5e08c0d-be3e-4549-bdfa-43089ae23a68 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:44:44.334053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5e08c0d-be3e-4549-bdfa-43089ae23a68 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:44:44.400501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d5e08c0d-be3e-4549-bdfa-43089ae23a68 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:44:44.408487 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d5e08c0d-be3e-4549-bdfa-43089ae23a68 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.088228 Sep 02 09:44:44.409088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 317/711] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:44:44 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:44:44.413678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:44:44.414171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:44:44.419671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:44:44.420153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:44:44.420750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:44:44.421258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:44:44.421737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:44:44.422132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:44:44.528097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'services' on Instance uuid a2bccc75-d837-4a98-8a78-841b2edb8ce5 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:44:54.417838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:54.440982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=10 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:44:54.531817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=4 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:45:15.381398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'services' on Instance uuid a2bccc75-d837-4a98-8a78-841b2edb8ce5 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:45:15.409221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c08f805f-8892-4e7b-8720-5f1e6a7c981c) Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 HTTP/1.1 Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:45:15.411986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:45:15.413575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:45:15.413575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:45:15.413575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:45:15.413575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:45:15.413575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:45:15.413575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:45:15.413575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:45:15.413575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 09:45:15.413575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:45:15.413575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c08f805f-8892-4e7b-8720-5f1e6a7c981c) Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'server_id': 'a2bccc75-d837-4a98-8a78-841b2edb8ce5', 'id': '6aefd94e-dc9d-4a48-9b8a-97e273701412'} Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:45:15.414448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c08f805f-8892-4e7b-8720-5f1e6a7c981c) Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:45:15.415578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c08f805f-8892-4e7b-8720-5f1e6a7c981c) Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:45:15.416743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c08f805f-8892-4e7b-8720-5f1e6a7c981c) Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:45:15.417770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c08f805f-8892-4e7b-8720-5f1e6a7c981c) Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c08f805f-8892-4e7b-8720-5f1e6a7c981c) Sep 02 09:45:15.419056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:45:15.420201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c08f805f-8892-4e7b-8720-5f1e6a7c981c) {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:45:15.420201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e6411972-8d91-4eba-b8b5-ef50969f1cc9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412" status: 400 len: 269 microversion: 2.1 time: 91.785031 Sep 02 09:45:15.420201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 395/712] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:43:43 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 => generated 269 bytes in 91786 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 02 09:45:15.488192 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-410110d8-893b-4f0b-91e9-870b9e36bdb1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:45:15.488807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-410110d8-893b-4f0b-91e9-870b9e36bdb1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:45:15.496401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-410110d8-893b-4f0b-91e9-870b9e36bdb1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:45:15.496840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-410110d8-893b-4f0b-91e9-870b9e36bdb1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:45:15.498070 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-410110d8-893b-4f0b-91e9-870b9e36bdb1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:45:15.498820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-410110d8-893b-4f0b-91e9-870b9e36bdb1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:45:15.500306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-410110d8-893b-4f0b-91e9-870b9e36bdb1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:45:15.500728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-410110d8-893b-4f0b-91e9-870b9e36bdb1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:45:15.569886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-410110d8-893b-4f0b-91e9-870b9e36bdb1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:45:15.577988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-410110d8-893b-4f0b-91e9-870b9e36bdb1 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1224 microversion: 2.1 time: 0.162996 Sep 02 09:45:15.578540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 396/713] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:45:15 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1224 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:45:15.583994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3a627e6d-58c6-40b1-b676-b8a6db91ae99 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:45:15.584555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3a627e6d-58c6-40b1-b676-b8a6db91ae99 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:45:15.590458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a627e6d-58c6-40b1-b676-b8a6db91ae99 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:45:15.591053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a627e6d-58c6-40b1-b676-b8a6db91ae99 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:45:15.591557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a627e6d-58c6-40b1-b676-b8a6db91ae99 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:45:15.592406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a627e6d-58c6-40b1-b676-b8a6db91ae99 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:45:15.593050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a627e6d-58c6-40b1-b676-b8a6db91ae99 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:45:15.593543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a627e6d-58c6-40b1-b676-b8a6db91ae99 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:45:21.268199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:45:21.268650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:45:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 (ip 10.222.0.57) !!! Sep 02 09:45:21.269446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:45:21.269578 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:45:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 (ip 10.222.0.57) !!! Sep 02 09:45:24.567315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:45:24.567894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 09:45:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 (ip 10.222.0.57) !!! Sep 02 09:45:25.384563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:45:25.588047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=4 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:45:25.612277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=10 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:46:44.681448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3057030-2136-4769-b4b8-5c1998063893) Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 HTTP/1.1 Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:46:44.683744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:46:44.685351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:46:44.685351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:46:44.685351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:46:44.685351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:46:44.685351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:46:44.685351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:46:44.685351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:46:44.685351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 09:46:44.685351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:46:44.685351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3057030-2136-4769-b4b8-5c1998063893) Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'server_id': 'a2bccc75-d837-4a98-8a78-841b2edb8ce5', 'id': '6aefd94e-dc9d-4a48-9b8a-97e273701412'} Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:46:44.686530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3057030-2136-4769-b4b8-5c1998063893) Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:46:44.688161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3057030-2136-4769-b4b8-5c1998063893) Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:46:44.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3057030-2136-4769-b4b8-5c1998063893) Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:46:44.692637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3057030-2136-4769-b4b8-5c1998063893) Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3057030-2136-4769-b4b8-5c1998063893) Sep 02 09:46:44.694193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:46:44.695585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3057030-2136-4769-b4b8-5c1998063893) {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:46:44.695585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6a7eea9d-b6e7-45df-a8eb-7331f8cb1b0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412" status: 400 len: 269 microversion: 2.1 time: 120.275452 Sep 02 09:46:44.695585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 318/714] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:44:44 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 => generated 269 bytes in 120277 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:46:44.695585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3567a471-1988-4cd6-9913-db026201a532 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:46:44.696049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3567a471-1988-4cd6-9913-db026201a532 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:46:44.700057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3567a471-1988-4cd6-9913-db026201a532 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:46:44.700535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3567a471-1988-4cd6-9913-db026201a532 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:46:44.700969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3567a471-1988-4cd6-9913-db026201a532 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:46:44.701659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3567a471-1988-4cd6-9913-db026201a532 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:46:44.702107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3567a471-1988-4cd6-9913-db026201a532 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:46:44.702523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3567a471-1988-4cd6-9913-db026201a532 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:46:44.731023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-3a627e6d-58c6-40b1-b676-b8a6db91ae99 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lazy-loading 'services' on Instance uuid 94dc7b98-31d1-406f-9070-26ccfe00e15b {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:46:44.733115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3567a471-1988-4cd6-9913-db026201a532 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Sep 02 09:46:44.733749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 319/715] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:46:44 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:46:44.738080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:46:44.738600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:46:44.745243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:46:44.745731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:46:44.746166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:46:44.746887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:46:44.747350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:46:44.747766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:46:44.772119 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:46:44.888698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.compute.api [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Instance is already in deleting state, ignoring this request Sep 02 09:46:44.889773 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5f7ce09a-33d3-4511-847e-90f16e475bc3 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 204 len: 0 microversion: 2.1 time: 0.155225 Sep 02 09:46:44.890342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 320/716] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:46:44 2022] DELETE /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:46:44.895200 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:46:44.895633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:46:44.901817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:46:44.902338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:46:44.902808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:46:44.903497 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:46:44.903958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:46:44.904381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:46:54.735242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=4 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:46:54.899258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:46:54.922790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:47:01.274976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:47:01.275807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:47:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 (ip 10.222.0.57) !!! Sep 02 09:47:04.578460 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:47:04.579097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 09:47:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 (ip 10.222.0.57) !!! Sep 02 09:47:15.674035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'services' on Instance uuid a2bccc75-d837-4a98-8a78-841b2edb8ce5 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:47:15.692619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3a627e6d-58c6-40b1-b676-b8a6db91ae99 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4" status: 202 len: 0 microversion: 2.1 time: 120.112749 Sep 02 09:47:15.693581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 397/717] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:45:15 2022] DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 => generated 0 bytes in 120114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:47:15.699424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:47:15.699999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:47:15.707024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:47:15.714625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:47:15.714625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:47:15.714625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:47:15.714625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:47:15.715053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:47:25.685356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:47:25.704455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:47:25.727804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:48:41.282888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:48:41.283474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:48:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 (ip 10.222.0.57) !!! Sep 02 09:48:41.284054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:48:41.284182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:48:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 (ip 10.222.0.57) !!! Sep 02 09:48:45.250490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03c33512-06d2-46b7-b7f2-9f3941dd31b3) Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 HTTP/1.1 Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:48:45.252825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:48:45.254447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:48:45.254447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:48:45.254447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:48:45.254447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:48:45.254447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:48:45.254447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:48:45.254447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:48:45.254447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 09:48:45.254447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:48:45.254447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03c33512-06d2-46b7-b7f2-9f3941dd31b3) Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'server_id': 'a2bccc75-d837-4a98-8a78-841b2edb8ce5', 'id': '6aefd94e-dc9d-4a48-9b8a-97e273701412'} Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:48:45.255263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03c33512-06d2-46b7-b7f2-9f3941dd31b3) Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:48:45.256738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03c33512-06d2-46b7-b7f2-9f3941dd31b3) Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:48:45.258107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03c33512-06d2-46b7-b7f2-9f3941dd31b3) Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:48:45.259336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03c33512-06d2-46b7-b7f2-9f3941dd31b3) Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03c33512-06d2-46b7-b7f2-9f3941dd31b3) Sep 02 09:48:45.260690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.262056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03c33512-06d2-46b7-b7f2-9f3941dd31b3) {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:48:45.262056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d9899330-58da-4607-9161-4ffd3e89d6a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412" status: 400 len: 269 microversion: 2.1 time: 120.364888 Sep 02 09:48:45.262056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 321/718] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:46:44 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 => generated 269 bytes in 120367 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:48:45.266100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-79cb24b3-3178-4d89-90ed-3d514499c664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:48:45.268708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-79cb24b3-3178-4d89-90ed-3d514499c664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:48:45.280690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79cb24b3-3178-4d89-90ed-3d514499c664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:48:45.280690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79cb24b3-3178-4d89-90ed-3d514499c664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:48:45.280690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79cb24b3-3178-4d89-90ed-3d514499c664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:48:45.280690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79cb24b3-3178-4d89-90ed-3d514499c664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:48:45.281064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79cb24b3-3178-4d89-90ed-3d514499c664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:48:45.281064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79cb24b3-3178-4d89-90ed-3d514499c664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:48:45.308043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-79cb24b3-3178-4d89-90ed-3d514499c664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046695 Sep 02 09:48:45.308610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 322/719] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:48:45 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:48:45.312931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:48:45.313535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:48:45.319094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:48:45.319575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:48:45.320005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:48:45.320684 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:48:45.321130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:48:45.321554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:48:45.346616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:48:45.479978 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.compute.api [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Instance is already in deleting state, ignoring this request Sep 02 09:48:45.483580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-022cbbbc-2659-4a09-8946-453ea06aeb92 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 204 len: 0 microversion: 2.1 time: 0.171312 Sep 02 09:48:45.483580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 323/720] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:48:45 2022] DELETE /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:48:45.486344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-66064139-bf23-4c3a-a5a5-b7f80e5446f9 tempest-TestMinimumBasicScenario-421719921 tempest-TestMinimumBasicScenario-421719921-project] Action: 'create', calling method: .version_select at 0x7f4e5c3090d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-366952725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfEBNlHVL5vhV/DKuJpGQgW3L0K/akZJ86F/PI2TWLcDNlP8HeCfuX4+fvduDz3NSl2D3p/FInYuhfnZqKb3wYxCZ+m5etZIPZKKcJLgHxxYxH+W7RulYT4u1WuWXtCVQ=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:48:45.495146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lazy-loading 'services' on Instance uuid 94dc7b98-31d1-406f-9070-26ccfe00e15b {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:48:45.503309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-66064139-bf23-4c3a-a5a5-b7f80e5446f9 tempest-TestMinimumBasicScenario-421719921 tempest-TestMinimumBasicScenario-421719921-project] Getting quotas for project 6939595a200a438facc915ebdb3c3679. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 09:48:45.507701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-66064139-bf23-4c3a-a5a5-b7f80e5446f9 tempest-TestMinimumBasicScenario-421719921 tempest-TestMinimumBasicScenario-421719921-project] Getting quotas for user 87691a170289480dbc1e283834d9e400 and project 6939595a200a438facc915ebdb3c3679. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 09:48:45.581444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-808882fe-0810-474f-8ebb-9bbf8bb7abfd) Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Request method failure captured: Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 HTTP/1.1 Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc6mkctKvb8Nt8q4V9eZInVr2Sbj-UGTJtKm-_o856B0arFnvpiQ5HGvopgJG1L1YrGdSV31LfSZ0-ik9WrL3PfQJHXOvuqVkKoJsexNtFVdmv7hADfkgq9jZU4qryfhYYT5c81LVMvIzh1ftwPLa2Jw5omeFzuoSt2LJD8Zzu5P3ts Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 7232d6277f26496ab552afa4abe13ad5 Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:48:45.581987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:48:45.583654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7232d6277f26496ab552afa4abe13ad5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:48:45.583654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:48:45.583654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 7232d6277f26496ab552afa4abe13ad5 Sep 02 09:48:45.583654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:48:45.583654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesSnapshotTestJSON-1505638161-project Sep 02 09:48:45.583654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:48:45.583654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:48:45.583654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 889d4c60870447bda2926106026a0537 Sep 02 09:48:45.583654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesSnapshotTestJSON-1505638161-project Sep 02 09:48:45.583654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-808882fe-0810-474f-8ebb-9bbf8bb7abfd) Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'server_id': '94dc7b98-31d1-406f-9070-26ccfe00e15b', 'id': 'bb57c32f-94b5-417f-bfad-902604e338b4'} Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:48:45.584545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-808882fe-0810-474f-8ebb-9bbf8bb7abfd) Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:48:45.586218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-808882fe-0810-474f-8ebb-9bbf8bb7abfd) Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:48:45.587715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-808882fe-0810-474f-8ebb-9bbf8bb7abfd) Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:48:45.588978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-808882fe-0810-474f-8ebb-9bbf8bb7abfd) Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-808882fe-0810-474f-8ebb-9bbf8bb7abfd) Sep 02 09:48:45.590303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:48:45.591722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-808882fe-0810-474f-8ebb-9bbf8bb7abfd) {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:48:45.591722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-af2faccc-c51f-4518-afa7-194d6c0c78b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4" status: 400 len: 269 microversion: 2.1 time: 89.888884 Sep 02 09:48:45.591722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 398/721] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:47:15 2022] DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 => generated 269 bytes in 89890 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:48:45.591722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:48:45.592107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:48:45.596331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:48:45.596844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:48:45.597252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:48:45.597935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:48:45.598399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:48:45.598852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:48:45.623704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-66064139-bf23-4c3a-a5a5-b7f80e5446f9 tempest-TestMinimumBasicScenario-421719921 tempest-TestMinimumBasicScenario-421719921-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.141284 Sep 02 09:48:45.624298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 324/722] 10.222.0.57 () {60 vars in 1159 bytes} [Fri Sep 2 09:48:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:48:45.629630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:48:45.633212 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:48:45.636807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:48:45.637294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:48:45.637729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:48:45.638419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:48:45.638900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:48:45.639325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:48:45.681144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'services' on Instance uuid a2bccc75-d837-4a98-8a78-841b2edb8ce5 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:48:55.514992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=4 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:48:55.594282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:48:55.633714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:48:55.657841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:48:55.685652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=12 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:49:15.744232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lazy-loading 'services' on Instance uuid 94dc7b98-31d1-406f-9070-26ccfe00e15b {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f21c3d16-831b-40d8-a163-3fa184056bed) Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 HTTP/1.1 Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:49:15.775757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:49:15.777816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:49:15.777816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:49:15.777816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:49:15.777816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:49:15.777816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:49:15.777816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:49:15.777816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:49:15.777816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 09:49:15.777816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:49:15.777816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f21c3d16-831b-40d8-a163-3fa184056bed) Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'server_id': 'a2bccc75-d837-4a98-8a78-841b2edb8ce5', 'id': '6aefd94e-dc9d-4a48-9b8a-97e273701412'} Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:15.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f21c3d16-831b-40d8-a163-3fa184056bed) Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:15.782002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f21c3d16-831b-40d8-a163-3fa184056bed) Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.783586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f21c3d16-831b-40d8-a163-3fa184056bed) Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:15.784931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f21c3d16-831b-40d8-a163-3fa184056bed) Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f21c3d16-831b-40d8-a163-3fa184056bed) Sep 02 09:49:15.786347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.787777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f21c3d16-831b-40d8-a163-3fa184056bed) {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:49:15.787777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bad9fed7-58ca-43b3-ad80-023d198f57a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412" status: 400 len: 269 microversion: 2.1 time: 30.191638 Sep 02 09:49:15.787777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 399/723] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:48:45 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 => generated 269 bytes in 30193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:49:15.787777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e4f3a5be-260b-4047-a8a9-5f221b1e7d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:15.788143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e4f3a5be-260b-4047-a8a9-5f221b1e7d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:15.790929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f3a5be-260b-4047-a8a9-5f221b1e7d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:15.791419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f3a5be-260b-4047-a8a9-5f221b1e7d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:15.791856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f3a5be-260b-4047-a8a9-5f221b1e7d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:15.792694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f3a5be-260b-4047-a8a9-5f221b1e7d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:15.793195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f3a5be-260b-4047-a8a9-5f221b1e7d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:15.793698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f3a5be-260b-4047-a8a9-5f221b1e7d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:15.808352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-954aa992-f8fd-4ffb-aff3-01ad448d59d9) Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Request method failure captured: Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 HTTP/1.1 Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc6mkctKvb8Nt8q4V9eZInVr2Sbj-UGTJtKm-_o856B0arFnvpiQ5HGvopgJG1L1YrGdSV31LfSZ0-ik9WrL3PfQJHXOvuqVkKoJsexNtFVdmv7hADfkgq9jZU4qryfhYYT5c81LVMvIzh1ftwPLa2Jw5omeFzuoSt2LJD8Zzu5P3ts Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 7232d6277f26496ab552afa4abe13ad5 Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:49:15.810541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:49:15.811923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7232d6277f26496ab552afa4abe13ad5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:49:15.811923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:49:15.811923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 7232d6277f26496ab552afa4abe13ad5 Sep 02 09:49:15.811923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:49:15.811923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesSnapshotTestJSON-1505638161-project Sep 02 09:49:15.811923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:49:15.811923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:49:15.811923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 889d4c60870447bda2926106026a0537 Sep 02 09:49:15.811923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesSnapshotTestJSON-1505638161-project Sep 02 09:49:15.811923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-954aa992-f8fd-4ffb-aff3-01ad448d59d9) Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'server_id': '94dc7b98-31d1-406f-9070-26ccfe00e15b', 'id': 'bb57c32f-94b5-417f-bfad-902604e338b4'} Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:15.813125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-954aa992-f8fd-4ffb-aff3-01ad448d59d9) Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:15.814196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-954aa992-f8fd-4ffb-aff3-01ad448d59d9) Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.815989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-954aa992-f8fd-4ffb-aff3-01ad448d59d9) Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:15.817056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-954aa992-f8fd-4ffb-aff3-01ad448d59d9) Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-954aa992-f8fd-4ffb-aff3-01ad448d59d9) Sep 02 09:49:15.818183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.820275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-954aa992-f8fd-4ffb-aff3-01ad448d59d9) {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:49:15.820275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a91f780c-e6c8-489e-8328-1c9a6d4a6209 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4" status: 400 len: 269 microversion: 2.1 time: 30.186726 Sep 02 09:49:15.820275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 325/724] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:48:45 2022] DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 => generated 269 bytes in 30188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:49:15.820275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:15.820644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:15.824261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:15.824744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:15.825175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:15.825866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:15.826320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:15.826763 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:15.828444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e4f3a5be-260b-4047-a8a9-5f221b1e7d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050152 Sep 02 09:49:15.833100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 400/725] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:15 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:15.833513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:15.834025 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:15.839719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:15.840202 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:15.840662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:15.841319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:15.841767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:15.842187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:15.854003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:49:15.925720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'services' on Instance uuid a2bccc75-d837-4a98-8a78-841b2edb8ce5 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:49:15.980049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3b8d9cc-e9a3-419e-ba7a-78488232ac7c) Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 HTTP/1.1 Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:49:15.982360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:49:15.983953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:49:15.983953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:49:15.983953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:49:15.983953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:49:15.983953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:49:15.983953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:49:15.983953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:49:15.983953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 09:49:15.983953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:49:15.983953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3b8d9cc-e9a3-419e-ba7a-78488232ac7c) Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'server_id': 'a2bccc75-d837-4a98-8a78-841b2edb8ce5', 'id': '6aefd94e-dc9d-4a48-9b8a-97e273701412'} Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:15.984702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3b8d9cc-e9a3-419e-ba7a-78488232ac7c) Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:15.985990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3b8d9cc-e9a3-419e-ba7a-78488232ac7c) Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.988276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3b8d9cc-e9a3-419e-ba7a-78488232ac7c) Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:15.989685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3b8d9cc-e9a3-419e-ba7a-78488232ac7c) Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3b8d9cc-e9a3-419e-ba7a-78488232ac7c) Sep 02 09:49:15.991021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:15.992300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3b8d9cc-e9a3-419e-ba7a-78488232ac7c) {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:49:15.992300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cb8c1587-e414-426e-9d47-96e898ad3e94 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412" status: 400 len: 269 microversion: 2.1 time: 0.153927 Sep 02 09:49:15.992300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 401/726] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:49:15 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 => generated 269 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:49:15.992300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:15.992650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:15.996183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:15.997876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:15.997876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:15.997876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:15.998303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:15.998612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:15.998834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.compute.api [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Instance is already in deleting state, ignoring this request Sep 02 09:49:15.999657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-16550fd0-d35a-469a-86c0-ceeabb6640f2 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 204 len: 0 microversion: 2.1 time: 0.186280 Sep 02 09:49:16.000216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 326/727] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:49:15 2022] DELETE /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:49:16.004836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f22d4629-d870-40b2-a178-5f2f03232eec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:16.006943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f22d4629-d870-40b2-a178-5f2f03232eec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:16.012460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f22d4629-d870-40b2-a178-5f2f03232eec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.012931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f22d4629-d870-40b2-a178-5f2f03232eec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.013794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f22d4629-d870-40b2-a178-5f2f03232eec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.014031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f22d4629-d870-40b2-a178-5f2f03232eec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.014476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f22d4629-d870-40b2-a178-5f2f03232eec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.014916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f22d4629-d870-40b2-a178-5f2f03232eec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.048206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f22d4629-d870-40b2-a178-5f2f03232eec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046798 Sep 02 09:49:16.049355 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 327/728] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:16 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:16.056747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:16.057240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:16.063509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.063986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.064411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.065085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.065632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.065980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.089166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lazy-loading 'services' on Instance uuid 94dc7b98-31d1-406f-9070-26ccfe00e15b {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:49:16.099931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:49:16.147865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.compute.api [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Instance is already in deleting state, ignoring this request Sep 02 09:49:16.148691 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0179bad3-65cd-4d23-a710-920521864d25 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 204 len: 0 microversion: 2.1 time: 0.095699 Sep 02 09:49:16.152527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 328/729] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:49:16 2022] DELETE /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:49:16.153879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:16.154394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:16.155052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98f373df-66b7-4abc-ab7a-99097b0fed2e) Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Request method failure captured: Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 HTTP/1.1 Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc6mkctKvb8Nt8q4V9eZInVr2Sbj-UGTJtKm-_o856B0arFnvpiQ5HGvopgJG1L1YrGdSV31LfSZ0-ik9WrL3PfQJHXOvuqVkKoJsexNtFVdmv7hADfkgq9jZU4qryfhYYT5c81LVMvIzh1ftwPLa2Jw5omeFzuoSt2LJD8Zzu5P3ts Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 7232d6277f26496ab552afa4abe13ad5 Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:49:16.157260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:49:16.158839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7232d6277f26496ab552afa4abe13ad5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:49:16.158839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:49:16.158839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 7232d6277f26496ab552afa4abe13ad5 Sep 02 09:49:16.158839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:49:16.158839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesSnapshotTestJSON-1505638161-project Sep 02 09:49:16.158839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:49:16.158839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:49:16.158839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 889d4c60870447bda2926106026a0537 Sep 02 09:49:16.158839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesSnapshotTestJSON-1505638161-project Sep 02 09:49:16.158839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98f373df-66b7-4abc-ab7a-99097b0fed2e) Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'server_id': '94dc7b98-31d1-406f-9070-26ccfe00e15b', 'id': 'bb57c32f-94b5-417f-bfad-902604e338b4'} Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:16.160218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98f373df-66b7-4abc-ab7a-99097b0fed2e) Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:16.161310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98f373df-66b7-4abc-ab7a-99097b0fed2e) Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.163284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98f373df-66b7-4abc-ab7a-99097b0fed2e) Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:16.164756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98f373df-66b7-4abc-ab7a-99097b0fed2e) Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98f373df-66b7-4abc-ab7a-99097b0fed2e) Sep 02 09:49:16.166206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.167958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98f373df-66b7-4abc-ab7a-99097b0fed2e) {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:49:16.168158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.168280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b0da4a4f-96c4-4608-85f8-e0c14cd336d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4" status: 400 len: 269 microversion: 2.1 time: 0.175391 Sep 02 09:49:16.168388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.168494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 402/730] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:49:15 2022] DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 => generated 269 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:49:16.168599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.168599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.168599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.168599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.169891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:16.170383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:16.177333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.177814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.178248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.178968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.179419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.179838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.245754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'services' on Instance uuid a2bccc75-d837-4a98-8a78-841b2edb8ce5 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:49:16.289148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lazy-loading 'services' on Instance uuid 94dc7b98-31d1-406f-9070-26ccfe00e15b {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:49:16.316341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-916d5d89-1699-4ecc-9357-b397ae37866b) Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 HTTP/1.1 Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:49:16.318463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:49:16.320054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:49:16.320054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:49:16.320054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 09:49:16.320054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 09:49:16.320054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:49:16.320054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:49:16.320054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:49:16.320054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 09:49:16.320054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 09:49:16.320054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-916d5d89-1699-4ecc-9357-b397ae37866b) Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'server_id': 'a2bccc75-d837-4a98-8a78-841b2edb8ce5', 'id': '6aefd94e-dc9d-4a48-9b8a-97e273701412'} Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:16.321370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-916d5d89-1699-4ecc-9357-b397ae37866b) Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:16.322600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-916d5d89-1699-4ecc-9357-b397ae37866b) Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.324018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-916d5d89-1699-4ecc-9357-b397ae37866b) Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:16.325444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-916d5d89-1699-4ecc-9357-b397ae37866b) Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-916d5d89-1699-4ecc-9357-b397ae37866b) Sep 02 09:49:16.326980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.328243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-916d5d89-1699-4ecc-9357-b397ae37866b) {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:49:16.328243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-85139972-57b2-4a20-862b-5a1c5b18a993 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412" status: 400 len: 269 microversion: 2.1 time: 0.169783 Sep 02 09:49:16.328243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 329/731] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:49:16 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments/6aefd94e-dc9d-4a48-9b8a-97e273701412 => generated 269 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:49:16.328243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4df32d7a-3caa-4a31-bacb-50986b0e7a34 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:16.328579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4df32d7a-3caa-4a31-bacb-50986b0e7a34 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:16.333860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4df32d7a-3caa-4a31-bacb-50986b0e7a34 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.334344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4df32d7a-3caa-4a31-bacb-50986b0e7a34 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.334806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4df32d7a-3caa-4a31-bacb-50986b0e7a34 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.335493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4df32d7a-3caa-4a31-bacb-50986b0e7a34 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.335972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4df32d7a-3caa-4a31-bacb-50986b0e7a34 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.336394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4df32d7a-3caa-4a31-bacb-50986b0e7a34 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.356595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ea07643-7eb1-496d-8510-38a10425238d) Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Request method failure captured: Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 HTTP/1.1 Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc6mkctKvb8Nt8q4V9eZInVr2Sbj-UGTJtKm-_o856B0arFnvpiQ5HGvopgJG1L1YrGdSV31LfSZ0-ik9WrL3PfQJHXOvuqVkKoJsexNtFVdmv7hADfkgq9jZU4qryfhYYT5c81LVMvIzh1ftwPLa2Jw5omeFzuoSt2LJD8Zzu5P3ts Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 7232d6277f26496ab552afa4abe13ad5 Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 09:49:16.358798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 09:49:16.361616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7232d6277f26496ab552afa4abe13ad5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:49:16.361616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:49:16.361616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 7232d6277f26496ab552afa4abe13ad5 Sep 02 09:49:16.361616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 09:49:16.361616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesSnapshotTestJSON-1505638161-project Sep 02 09:49:16.361616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 09:49:16.361616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 09:49:16.361616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 889d4c60870447bda2926106026a0537 Sep 02 09:49:16.361616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesSnapshotTestJSON-1505638161-project Sep 02 09:49:16.361616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ea07643-7eb1-496d-8510-38a10425238d) Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'server_id': '94dc7b98-31d1-406f-9070-26ccfe00e15b', 'id': 'bb57c32f-94b5-417f-bfad-902604e338b4'} Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:16.362937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ea07643-7eb1-496d-8510-38a10425238d) Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 09:49:16.365095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ea07643-7eb1-496d-8510-38a10425238d) Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.367806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ea07643-7eb1-496d-8510-38a10425238d) Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:16.370182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ea07643-7eb1-496d-8510-38a10425238d) Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ea07643-7eb1-496d-8510-38a10425238d) Sep 02 09:49:16.372717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 09:49:16.375901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1ea07643-7eb1-496d-8510-38a10425238d) {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:49:16.375901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b22d1cb3-38af-4027-b1a6-bc28ffd76852 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4" status: 400 len: 269 microversion: 2.1 time: 0.196462 Sep 02 09:49:16.375901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 403/732] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 09:49:16 2022] DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b/os-volume_attachments/bb57c32f-94b5-417f-bfad-902604e338b4 => generated 269 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 09:49:16.375901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:16.376575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:16.378325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4df32d7a-3caa-4a31-bacb-50986b0e7a34 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049614 Sep 02 09:49:16.378512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.378512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.378512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.378512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.379299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.379299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.379535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 330/733] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:16 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:16.381003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1d97d3fc-a41c-48ed-81fa-927290e99fae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:16.383290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1d97d3fc-a41c-48ed-81fa-927290e99fae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:16.389052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d97d3fc-a41c-48ed-81fa-927290e99fae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.389614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d97d3fc-a41c-48ed-81fa-927290e99fae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.389976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d97d3fc-a41c-48ed-81fa-927290e99fae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.390683 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d97d3fc-a41c-48ed-81fa-927290e99fae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.391247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d97d3fc-a41c-48ed-81fa-927290e99fae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.391682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d97d3fc-a41c-48ed-81fa-927290e99fae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.411559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:16.412053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:16.412481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:16.412923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lazy-loading 'fault' on Instance uuid 99c278bb-a399-4a52-bb7a-6d1782711406 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 09:49:16.424147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1d97d3fc-a41c-48ed-81fa-927290e99fae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046876 Sep 02 09:49:16.424967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 331/734] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:16.456319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd935a4a30e4d44e0a392596452a5c1b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c5938d62e2d40969d096b66e14edd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:49:16.464373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c8d5630a-ea51-41b4-8cef-42c44436ad03 tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 200 len: 1235 microversion: 2.1 time: 0.102723 Sep 02 09:49:16.465015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 404/735] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:49:16 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 1235 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:49:17.384214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-87d083e5-8082-4b90-ba6e-290bf12085e0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:17.386335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-87d083e5-8082-4b90-ba6e-290bf12085e0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:17.392703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87d083e5-8082-4b90-ba6e-290bf12085e0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:17.393185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87d083e5-8082-4b90-ba6e-290bf12085e0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:17.393622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87d083e5-8082-4b90-ba6e-290bf12085e0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:17.394970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87d083e5-8082-4b90-ba6e-290bf12085e0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:17.395430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87d083e5-8082-4b90-ba6e-290bf12085e0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:17.395854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87d083e5-8082-4b90-ba6e-290bf12085e0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:17.424787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-87d083e5-8082-4b90-ba6e-290bf12085e0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044401 Sep 02 09:49:17.425332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 332/736] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:17 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:49:17.435617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2f180cea-b2fc-4112-8864-8a4aaf1dd6e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:17.437879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2f180cea-b2fc-4112-8864-8a4aaf1dd6e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:17.444739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f180cea-b2fc-4112-8864-8a4aaf1dd6e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:17.445225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f180cea-b2fc-4112-8864-8a4aaf1dd6e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:17.445661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f180cea-b2fc-4112-8864-8a4aaf1dd6e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:17.446357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f180cea-b2fc-4112-8864-8a4aaf1dd6e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:17.446841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f180cea-b2fc-4112-8864-8a4aaf1dd6e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:17.447270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f180cea-b2fc-4112-8864-8a4aaf1dd6e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:17.477299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2f180cea-b2fc-4112-8864-8a4aaf1dd6e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045552 Sep 02 09:49:17.477894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 405/737] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:17.485376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:17.486790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [instance: 99c278bb-a399-4a52-bb7a-6d1782711406] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:17.491947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:17.492427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:17.492861 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:17.493545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:17.493992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:17.494415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:17.507841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] HTTP exception thrown: Instance 99c278bb-a399-4a52-bb7a-6d1782711406 could not be found. Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Request method failure captured: Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 HTTP/1.1 Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc4x4VJ_1NxV9K6biKl_eUoQCYcprF5QhPXanHsckYRrFSprQR-AxPIp5Rg-eNfL9uXxsUkBxhe8jOwf0RFGShaA4dHcBW0k9gA2DjfxTTrJRwCrP2cEM2meFlV5ySrZPgJSqnH9C2xyg6-I7LzCdejejLrsadA6hwTiiiiE1_7oA2s Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 2c5938d62e2d40969d096b66e14edd75 Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-TestVolumeBootPattern-1229258799 Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 09:49:17.509321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2c5938d62e2d40969d096b66e14edd75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2c5938d62e2d40969d096b66e14edd75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2c5938d62e2d40969d096b66e14edd75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2c5938d62e2d40969d096b66e14edd75", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-TestVolumeBootPattern-1229258799 Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 2c5938d62e2d40969d096b66e14edd75 Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229258799 Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-TestVolumeBootPattern-1229258799-project Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: d935a4a30e4d44e0a392596452a5c1b6 Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-TestVolumeBootPattern-1229258799-project Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 99c278bb-a399-4a52-bb7a-6d1782711406 could not be found. Sep 02 09:49:17.511077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '99c278bb-a399-4a52-bb7a-6d1782711406'} Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c278bb-a399-4a52-bb7a-6d1782711406 could not be found. Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 09:49:17.512201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c278bb-a399-4a52-bb7a-6d1782711406 could not be found. Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c278bb-a399-4a52-bb7a-6d1782711406 could not be found. Sep 02 09:49:17.513750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 09:49:17.515451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Returning 404 to user: Instance 99c278bb-a399-4a52-bb7a-6d1782711406 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 09:49:17.515451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-65b87ea5-6f30-4f9a-8a6b-5d689904f85f tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406" status: 404 len: 111 microversion: 2.1 time: 0.029098 Sep 02 09:49:17.515451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 333/738] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:49:17 2022] GET /compute/v2.1/servers/99c278bb-a399-4a52-bb7a-6d1782711406 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 09:49:18.441368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6ed7c7a5-2999-4f8c-a01b-8a0e9d0f2aee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:18.443563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6ed7c7a5-2999-4f8c-a01b-8a0e9d0f2aee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:18.449913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7a5-2999-4f8c-a01b-8a0e9d0f2aee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:18.450397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7a5-2999-4f8c-a01b-8a0e9d0f2aee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:18.450860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7a5-2999-4f8c-a01b-8a0e9d0f2aee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:18.451542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7a5-2999-4f8c-a01b-8a0e9d0f2aee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:18.451992 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7a5-2999-4f8c-a01b-8a0e9d0f2aee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:18.452412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7a5-2999-4f8c-a01b-8a0e9d0f2aee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:18.482235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6ed7c7a5-2999-4f8c-a01b-8a0e9d0f2aee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044864 Sep 02 09:49:18.482808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 406/739] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:18 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:18.489775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aa08a2d8-bd51-4442-88dd-b6e090b86077 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:18.492346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aa08a2d8-bd51-4442-88dd-b6e090b86077 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:18.499028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa08a2d8-bd51-4442-88dd-b6e090b86077 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:18.499506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa08a2d8-bd51-4442-88dd-b6e090b86077 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:18.499936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa08a2d8-bd51-4442-88dd-b6e090b86077 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:18.500615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa08a2d8-bd51-4442-88dd-b6e090b86077 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:18.501057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa08a2d8-bd51-4442-88dd-b6e090b86077 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:18.501568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa08a2d8-bd51-4442-88dd-b6e090b86077 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:18.531846 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aa08a2d8-bd51-4442-88dd-b6e090b86077 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046264 Sep 02 09:49:18.532387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 334/740] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:19.494943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7434f2f9-4753-4ebe-b571-280759a1b4b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:19.497122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7434f2f9-4753-4ebe-b571-280759a1b4b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:19.503565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7434f2f9-4753-4ebe-b571-280759a1b4b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:19.504049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7434f2f9-4753-4ebe-b571-280759a1b4b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:19.504489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7434f2f9-4753-4ebe-b571-280759a1b4b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:19.505843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7434f2f9-4753-4ebe-b571-280759a1b4b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:19.506300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7434f2f9-4753-4ebe-b571-280759a1b4b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:19.506748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7434f2f9-4753-4ebe-b571-280759a1b4b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:19.535190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7434f2f9-4753-4ebe-b571-280759a1b4b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044201 Sep 02 09:49:19.535871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 407/741] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:19 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:19.544245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8c1e5ef2-54ae-4079-b24e-2e6e247add1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:19.546477 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8c1e5ef2-54ae-4079-b24e-2e6e247add1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:19.553538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c1e5ef2-54ae-4079-b24e-2e6e247add1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:19.554018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c1e5ef2-54ae-4079-b24e-2e6e247add1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:19.554467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c1e5ef2-54ae-4079-b24e-2e6e247add1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:19.555169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c1e5ef2-54ae-4079-b24e-2e6e247add1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:19.555625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c1e5ef2-54ae-4079-b24e-2e6e247add1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:19.556045 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c1e5ef2-54ae-4079-b24e-2e6e247add1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:19.584452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8c1e5ef2-54ae-4079-b24e-2e6e247add1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044179 Sep 02 09:49:19.585205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 335/742] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:20.547832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-590631d3-be7e-4355-a287-fe54e69dc37b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:20.549965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-590631d3-be7e-4355-a287-fe54e69dc37b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:20.556277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-590631d3-be7e-4355-a287-fe54e69dc37b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:20.556759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-590631d3-be7e-4355-a287-fe54e69dc37b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:20.557193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-590631d3-be7e-4355-a287-fe54e69dc37b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:20.557880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-590631d3-be7e-4355-a287-fe54e69dc37b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:20.558333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-590631d3-be7e-4355-a287-fe54e69dc37b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:20.558778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-590631d3-be7e-4355-a287-fe54e69dc37b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:20.588446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-590631d3-be7e-4355-a287-fe54e69dc37b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044589 Sep 02 09:49:20.588983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 408/743] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:20 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:20.596816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d3887d43-79cc-48d2-909d-f94cdea94562 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:20.598995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d3887d43-79cc-48d2-909d-f94cdea94562 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:20.605453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3887d43-79cc-48d2-909d-f94cdea94562 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:20.605936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3887d43-79cc-48d2-909d-f94cdea94562 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:20.606365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3887d43-79cc-48d2-909d-f94cdea94562 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:20.607069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3887d43-79cc-48d2-909d-f94cdea94562 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:20.607522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3887d43-79cc-48d2-909d-f94cdea94562 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:20.607942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3887d43-79cc-48d2-909d-f94cdea94562 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:20.637771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d3887d43-79cc-48d2-909d-f94cdea94562 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Sep 02 09:49:20.638329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 336/744] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:21.601108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-04e3d563-3df8-4000-b33f-ce973dc20126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:21.603308 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-04e3d563-3df8-4000-b33f-ce973dc20126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:21.609575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04e3d563-3df8-4000-b33f-ce973dc20126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:21.610056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04e3d563-3df8-4000-b33f-ce973dc20126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:21.610507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04e3d563-3df8-4000-b33f-ce973dc20126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:21.611190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04e3d563-3df8-4000-b33f-ce973dc20126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:21.611639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04e3d563-3df8-4000-b33f-ce973dc20126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:21.612060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04e3d563-3df8-4000-b33f-ce973dc20126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:21.640520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-04e3d563-3df8-4000-b33f-ce973dc20126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043964 Sep 02 09:49:21.646423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 409/745] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:21 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:21.650304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5fa78c8b-86fe-422d-b4b9-7e2686aad4e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:21.652447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5fa78c8b-86fe-422d-b4b9-7e2686aad4e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:21.658913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa78c8b-86fe-422d-b4b9-7e2686aad4e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:21.659404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa78c8b-86fe-422d-b4b9-7e2686aad4e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:21.659837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa78c8b-86fe-422d-b4b9-7e2686aad4e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:21.660528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa78c8b-86fe-422d-b4b9-7e2686aad4e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:21.661068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa78c8b-86fe-422d-b4b9-7e2686aad4e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:21.662143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa78c8b-86fe-422d-b4b9-7e2686aad4e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:21.691395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5fa78c8b-86fe-422d-b4b9-7e2686aad4e0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Sep 02 09:49:21.691961 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 337/746] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:22.653021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b59a604b-37e9-4962-86c7-f0d13ebce422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:22.655280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b59a604b-37e9-4962-86c7-f0d13ebce422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:22.662180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b59a604b-37e9-4962-86c7-f0d13ebce422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:22.662667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b59a604b-37e9-4962-86c7-f0d13ebce422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:22.663134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b59a604b-37e9-4962-86c7-f0d13ebce422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:22.663908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b59a604b-37e9-4962-86c7-f0d13ebce422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:22.664308 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b59a604b-37e9-4962-86c7-f0d13ebce422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:22.664733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b59a604b-37e9-4962-86c7-f0d13ebce422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:22.693934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b59a604b-37e9-4962-86c7-f0d13ebce422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Sep 02 09:49:22.694476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 410/747] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:22 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:22.703531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ff1fe360-c568-4699-b342-4ee34ecfc22a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:22.705686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ff1fe360-c568-4699-b342-4ee34ecfc22a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:22.711941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff1fe360-c568-4699-b342-4ee34ecfc22a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:22.712419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff1fe360-c568-4699-b342-4ee34ecfc22a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:22.712849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff1fe360-c568-4699-b342-4ee34ecfc22a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:22.713521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff1fe360-c568-4699-b342-4ee34ecfc22a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:22.713967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff1fe360-c568-4699-b342-4ee34ecfc22a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:22.714381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff1fe360-c568-4699-b342-4ee34ecfc22a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:22.744136 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ff1fe360-c568-4699-b342-4ee34ecfc22a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Sep 02 09:49:22.744687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 338/748] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:23.706185 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-aa738860-fcf0-4631-b8d2-498827a41e48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:23.708403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-aa738860-fcf0-4631-b8d2-498827a41e48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:23.715135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa738860-fcf0-4631-b8d2-498827a41e48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:23.715615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa738860-fcf0-4631-b8d2-498827a41e48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:23.716041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa738860-fcf0-4631-b8d2-498827a41e48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:23.716716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa738860-fcf0-4631-b8d2-498827a41e48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:23.717162 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa738860-fcf0-4631-b8d2-498827a41e48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:23.717582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa738860-fcf0-4631-b8d2-498827a41e48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:23.746410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-aa738860-fcf0-4631-b8d2-498827a41e48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044251 Sep 02 09:49:23.746980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 411/749] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:23 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:23.756889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2602b73b-0814-40ee-a0c3-a870008c9275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:23.759029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2602b73b-0814-40ee-a0c3-a870008c9275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:23.765365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2602b73b-0814-40ee-a0c3-a870008c9275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:23.765848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2602b73b-0814-40ee-a0c3-a870008c9275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:23.766283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2602b73b-0814-40ee-a0c3-a870008c9275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:23.766997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2602b73b-0814-40ee-a0c3-a870008c9275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:23.767452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2602b73b-0814-40ee-a0c3-a870008c9275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:23.767876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2602b73b-0814-40ee-a0c3-a870008c9275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:23.784767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:49:23.803495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2602b73b-0814-40ee-a0c3-a870008c9275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045747 Sep 02 09:49:23.803495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 339/750] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:24.758894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-76f5980c-fb09-4acc-ab1a-0e75640530ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:24.761010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-76f5980c-fb09-4acc-ab1a-0e75640530ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:24.767360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76f5980c-fb09-4acc-ab1a-0e75640530ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:24.767843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76f5980c-fb09-4acc-ab1a-0e75640530ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:24.768272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76f5980c-fb09-4acc-ab1a-0e75640530ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:24.768946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76f5980c-fb09-4acc-ab1a-0e75640530ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:24.769438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76f5980c-fb09-4acc-ab1a-0e75640530ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:24.769858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-76f5980c-fb09-4acc-ab1a-0e75640530ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:24.800933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-76f5980c-fb09-4acc-ab1a-0e75640530ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046582 Sep 02 09:49:24.801497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 412/751] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:24 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:24.813429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7daed008-9aac-4ab8-87cd-20275dcee988 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:24.815626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7daed008-9aac-4ab8-87cd-20275dcee988 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:24.823405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daed008-9aac-4ab8-87cd-20275dcee988 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:24.823883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daed008-9aac-4ab8-87cd-20275dcee988 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:24.824313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daed008-9aac-4ab8-87cd-20275dcee988 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:24.824990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daed008-9aac-4ab8-87cd-20275dcee988 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:24.825433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daed008-9aac-4ab8-87cd-20275dcee988 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:24.825845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daed008-9aac-4ab8-87cd-20275dcee988 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:24.857806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7daed008-9aac-4ab8-87cd-20275dcee988 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048316 Sep 02 09:49:24.858358 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 340/752] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:25.813385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b100a65e-825d-414a-844d-18ea29084d1f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:25.815456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b100a65e-825d-414a-844d-18ea29084d1f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:25.821931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b100a65e-825d-414a-844d-18ea29084d1f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:25.822411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b100a65e-825d-414a-844d-18ea29084d1f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:25.822877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b100a65e-825d-414a-844d-18ea29084d1f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:25.823558 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b100a65e-825d-414a-844d-18ea29084d1f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:25.824006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b100a65e-825d-414a-844d-18ea29084d1f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:25.824426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b100a65e-825d-414a-844d-18ea29084d1f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:25.853735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b100a65e-825d-414a-844d-18ea29084d1f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Sep 02 09:49:25.854284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 413/753] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:25.871714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5b99bd57-9899-4eb8-9d7c-baf3e61c5fda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:25.873812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5b99bd57-9899-4eb8-9d7c-baf3e61c5fda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:25.880540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b99bd57-9899-4eb8-9d7c-baf3e61c5fda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:25.881013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b99bd57-9899-4eb8-9d7c-baf3e61c5fda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:25.881440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b99bd57-9899-4eb8-9d7c-baf3e61c5fda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:25.882120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b99bd57-9899-4eb8-9d7c-baf3e61c5fda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:25.882565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b99bd57-9899-4eb8-9d7c-baf3e61c5fda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:25.883008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b99bd57-9899-4eb8-9d7c-baf3e61c5fda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:25.912979 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5b99bd57-9899-4eb8-9d7c-baf3e61c5fda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045505 Sep 02 09:49:25.913536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 341/754] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:25 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:26.866139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a3b511b6-c52b-4d22-b61e-4d6044ce123a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:26.868287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a3b511b6-c52b-4d22-b61e-4d6044ce123a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:26.874694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3b511b6-c52b-4d22-b61e-4d6044ce123a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:26.875408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3b511b6-c52b-4d22-b61e-4d6044ce123a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:26.876691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3b511b6-c52b-4d22-b61e-4d6044ce123a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:26.876915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3b511b6-c52b-4d22-b61e-4d6044ce123a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:26.877360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3b511b6-c52b-4d22-b61e-4d6044ce123a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:26.877777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3b511b6-c52b-4d22-b61e-4d6044ce123a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:26.909192 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a3b511b6-c52b-4d22-b61e-4d6044ce123a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047581 Sep 02 09:49:26.909753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 414/755] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:26 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:26.924417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e5541a3b-4dba-4ee1-addd-60ceebb17740 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:26.927065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e5541a3b-4dba-4ee1-addd-60ceebb17740 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:26.933527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5541a3b-4dba-4ee1-addd-60ceebb17740 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:26.934006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5541a3b-4dba-4ee1-addd-60ceebb17740 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:26.934436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5541a3b-4dba-4ee1-addd-60ceebb17740 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:26.935134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5541a3b-4dba-4ee1-addd-60ceebb17740 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:26.935584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5541a3b-4dba-4ee1-addd-60ceebb17740 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:26.936001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5541a3b-4dba-4ee1-addd-60ceebb17740 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:26.966168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e5541a3b-4dba-4ee1-addd-60ceebb17740 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045663 Sep 02 09:49:26.966751 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 342/756] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:26 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:27.921408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-00ca26b4-931b-4683-98f8-ba05614c7368 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:27.923593 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-00ca26b4-931b-4683-98f8-ba05614c7368 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:27.930281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ca26b4-931b-4683-98f8-ba05614c7368 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:27.930826 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ca26b4-931b-4683-98f8-ba05614c7368 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:27.931269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ca26b4-931b-4683-98f8-ba05614c7368 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:27.931995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ca26b4-931b-4683-98f8-ba05614c7368 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:27.932476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ca26b4-931b-4683-98f8-ba05614c7368 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:27.932900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ca26b4-931b-4683-98f8-ba05614c7368 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:27.936541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:49:27.979283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9ab5c427-ce57-45f3-8215-ecd175b1772a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:27.981569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9ab5c427-ce57-45f3-8215-ecd175b1772a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:27.991128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ab5c427-ce57-45f3-8215-ecd175b1772a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:27.991635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ab5c427-ce57-45f3-8215-ecd175b1772a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:27.992080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ab5c427-ce57-45f3-8215-ecd175b1772a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:27.992802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ab5c427-ce57-45f3-8215-ecd175b1772a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:27.993262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ab5c427-ce57-45f3-8215-ecd175b1772a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:27.993695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9ab5c427-ce57-45f3-8215-ecd175b1772a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:28.028131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9ab5c427-ce57-45f3-8215-ecd175b1772a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053143 Sep 02 09:49:28.028964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 343/757] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:49:28.113751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-00ca26b4-931b-4683-98f8-ba05614c7368 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196228 Sep 02 09:49:28.114265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 415/758] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:27 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:29.040383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3794b982-7941-409b-a538-5d4c122153b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:29.042570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3794b982-7941-409b-a538-5d4c122153b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:29.049013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3794b982-7941-409b-a538-5d4c122153b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:29.049476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3794b982-7941-409b-a538-5d4c122153b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:29.049907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3794b982-7941-409b-a538-5d4c122153b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:29.050585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3794b982-7941-409b-a538-5d4c122153b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:29.051069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3794b982-7941-409b-a538-5d4c122153b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:29.051494 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3794b982-7941-409b-a538-5d4c122153b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:29.079994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3794b982-7941-409b-a538-5d4c122153b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044162 Sep 02 09:49:29.080551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 344/759] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:29.125360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1e90d4e7-ff85-4c85-bfe9-a0a4c06ba559 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:29.127519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1e90d4e7-ff85-4c85-bfe9-a0a4c06ba559 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:29.133900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1e90d4e7-ff85-4c85-bfe9-a0a4c06ba559 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:29.134385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1e90d4e7-ff85-4c85-bfe9-a0a4c06ba559 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:29.134841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1e90d4e7-ff85-4c85-bfe9-a0a4c06ba559 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:29.135525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1e90d4e7-ff85-4c85-bfe9-a0a4c06ba559 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:29.135979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1e90d4e7-ff85-4c85-bfe9-a0a4c06ba559 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:29.136402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1e90d4e7-ff85-4c85-bfe9-a0a4c06ba559 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:29.166614 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1e90d4e7-ff85-4c85-bfe9-a0a4c06ba559 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Sep 02 09:49:29.167184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 416/760] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:29 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:30.092667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d4acffd8-3534-4d3c-8a55-28b3df17d85f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:30.094836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d4acffd8-3534-4d3c-8a55-28b3df17d85f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:30.101719 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4acffd8-3534-4d3c-8a55-28b3df17d85f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:30.102136 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4acffd8-3534-4d3c-8a55-28b3df17d85f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:30.102563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4acffd8-3534-4d3c-8a55-28b3df17d85f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:30.103270 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4acffd8-3534-4d3c-8a55-28b3df17d85f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:30.103716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4acffd8-3534-4d3c-8a55-28b3df17d85f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:30.104150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4acffd8-3534-4d3c-8a55-28b3df17d85f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:30.133037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d4acffd8-3534-4d3c-8a55-28b3df17d85f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044363 Sep 02 09:49:30.133582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 345/761] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:30.179505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2a3fd923-7b83-43bd-9cfc-e23041e63b52 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:30.181702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2a3fd923-7b83-43bd-9cfc-e23041e63b52 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:30.188277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2a3fd923-7b83-43bd-9cfc-e23041e63b52 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:30.188766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2a3fd923-7b83-43bd-9cfc-e23041e63b52 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:30.189201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2a3fd923-7b83-43bd-9cfc-e23041e63b52 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:30.189913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2a3fd923-7b83-43bd-9cfc-e23041e63b52 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:30.190374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2a3fd923-7b83-43bd-9cfc-e23041e63b52 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:30.190830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2a3fd923-7b83-43bd-9cfc-e23041e63b52 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:30.220182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2a3fd923-7b83-43bd-9cfc-e23041e63b52 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045407 Sep 02 09:49:30.222231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 417/762] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:30 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:31.145799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d2d4e44-0932-41fa-98b9-fe0ed8435a98 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:31.148206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5d2d4e44-0932-41fa-98b9-fe0ed8435a98 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:31.154560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d2d4e44-0932-41fa-98b9-fe0ed8435a98 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:31.155076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d2d4e44-0932-41fa-98b9-fe0ed8435a98 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:31.155506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d2d4e44-0932-41fa-98b9-fe0ed8435a98 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:31.156207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d2d4e44-0932-41fa-98b9-fe0ed8435a98 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:31.156652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d2d4e44-0932-41fa-98b9-fe0ed8435a98 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:31.157068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d2d4e44-0932-41fa-98b9-fe0ed8435a98 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:31.186333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5d2d4e44-0932-41fa-98b9-fe0ed8435a98 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045169 Sep 02 09:49:31.186905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 346/763] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:31.232924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b31dbc64-de3f-425e-9143-c1e9d885ef6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:31.235054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b31dbc64-de3f-425e-9143-c1e9d885ef6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:31.241879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b31dbc64-de3f-425e-9143-c1e9d885ef6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:31.242359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b31dbc64-de3f-425e-9143-c1e9d885ef6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:31.242817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b31dbc64-de3f-425e-9143-c1e9d885ef6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:31.243497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b31dbc64-de3f-425e-9143-c1e9d885ef6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:31.243940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b31dbc64-de3f-425e-9143-c1e9d885ef6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:31.244358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b31dbc64-de3f-425e-9143-c1e9d885ef6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:31.273482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b31dbc64-de3f-425e-9143-c1e9d885ef6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Sep 02 09:49:31.274013 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 418/764] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:31 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:32.198787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-61df1851-63f0-42d1-8670-6322af4a5321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:32.200837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-61df1851-63f0-42d1-8670-6322af4a5321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:32.206670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61df1851-63f0-42d1-8670-6322af4a5321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:32.207176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61df1851-63f0-42d1-8670-6322af4a5321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:32.208139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61df1851-63f0-42d1-8670-6322af4a5321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:32.208844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61df1851-63f0-42d1-8670-6322af4a5321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:32.209287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61df1851-63f0-42d1-8670-6322af4a5321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:32.209702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-61df1851-63f0-42d1-8670-6322af4a5321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:32.238352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-61df1851-63f0-42d1-8670-6322af4a5321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 Sep 02 09:49:32.238948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 347/765] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:32.285895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-95933dcc-f4b8-4f46-9f66-2955c206d29a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:32.291841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-95933dcc-f4b8-4f46-9f66-2955c206d29a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:32.294634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95933dcc-f4b8-4f46-9f66-2955c206d29a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:32.295164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95933dcc-f4b8-4f46-9f66-2955c206d29a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:32.295605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95933dcc-f4b8-4f46-9f66-2955c206d29a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:32.296310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95933dcc-f4b8-4f46-9f66-2955c206d29a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:32.296767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95933dcc-f4b8-4f46-9f66-2955c206d29a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:32.297194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95933dcc-f4b8-4f46-9f66-2955c206d29a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:32.327453 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-95933dcc-f4b8-4f46-9f66-2955c206d29a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Sep 02 09:49:32.330761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 419/766] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:32 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:33.250794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1c0f37cf-c011-42bf-a269-bfc1d249cc27 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:33.252816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1c0f37cf-c011-42bf-a269-bfc1d249cc27 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:33.259656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c0f37cf-c011-42bf-a269-bfc1d249cc27 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:33.260142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c0f37cf-c011-42bf-a269-bfc1d249cc27 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:33.260575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c0f37cf-c011-42bf-a269-bfc1d249cc27 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:33.261256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c0f37cf-c011-42bf-a269-bfc1d249cc27 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:33.261721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c0f37cf-c011-42bf-a269-bfc1d249cc27 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:33.262126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1c0f37cf-c011-42bf-a269-bfc1d249cc27 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:33.291218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1c0f37cf-c011-42bf-a269-bfc1d249cc27 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Sep 02 09:49:33.291757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 348/767] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:33.341510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-89eed759-890f-4817-b8e4-ef61198edc8a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:33.343651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-89eed759-890f-4817-b8e4-ef61198edc8a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:33.349985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89eed759-890f-4817-b8e4-ef61198edc8a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:33.350524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89eed759-890f-4817-b8e4-ef61198edc8a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:33.351004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89eed759-890f-4817-b8e4-ef61198edc8a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:33.351687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89eed759-890f-4817-b8e4-ef61198edc8a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:33.352134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89eed759-890f-4817-b8e4-ef61198edc8a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:33.352549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89eed759-890f-4817-b8e4-ef61198edc8a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:33.381549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-89eed759-890f-4817-b8e4-ef61198edc8a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Sep 02 09:49:33.382079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 420/768] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:33 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:34.304114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a94cb761-f0c8-4ae5-9004-b9b9c1d90c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:34.306146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a94cb761-f0c8-4ae5-9004-b9b9c1d90c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:34.312608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a94cb761-f0c8-4ae5-9004-b9b9c1d90c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:34.313075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a94cb761-f0c8-4ae5-9004-b9b9c1d90c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:34.313509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a94cb761-f0c8-4ae5-9004-b9b9c1d90c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:34.314190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a94cb761-f0c8-4ae5-9004-b9b9c1d90c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:34.314641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a94cb761-f0c8-4ae5-9004-b9b9c1d90c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:34.315088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a94cb761-f0c8-4ae5-9004-b9b9c1d90c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:34.344578 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a94cb761-f0c8-4ae5-9004-b9b9c1d90c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Sep 02 09:49:34.345131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 349/769] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:34.393511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-41eefb71-7758-4c1f-ba42-7c6f81391c6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:34.395818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-41eefb71-7758-4c1f-ba42-7c6f81391c6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:34.402276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41eefb71-7758-4c1f-ba42-7c6f81391c6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:34.402783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41eefb71-7758-4c1f-ba42-7c6f81391c6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:34.403220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41eefb71-7758-4c1f-ba42-7c6f81391c6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:34.403926 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41eefb71-7758-4c1f-ba42-7c6f81391c6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:34.404371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41eefb71-7758-4c1f-ba42-7c6f81391c6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:34.404790 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41eefb71-7758-4c1f-ba42-7c6f81391c6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:34.435354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-41eefb71-7758-4c1f-ba42-7c6f81391c6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Sep 02 09:49:34.435897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 421/770] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:34 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:35.356082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e20cdffc-c041-4d99-9ea3-a89d52dbad46 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:35.358204 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e20cdffc-c041-4d99-9ea3-a89d52dbad46 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:35.364554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e20cdffc-c041-4d99-9ea3-a89d52dbad46 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:35.365036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e20cdffc-c041-4d99-9ea3-a89d52dbad46 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:35.365473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e20cdffc-c041-4d99-9ea3-a89d52dbad46 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:35.366149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e20cdffc-c041-4d99-9ea3-a89d52dbad46 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:35.366601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e20cdffc-c041-4d99-9ea3-a89d52dbad46 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:35.367047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e20cdffc-c041-4d99-9ea3-a89d52dbad46 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:35.396524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e20cdffc-c041-4d99-9ea3-a89d52dbad46 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Sep 02 09:49:35.397325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 350/771] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:35.448449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0b0b7235-4861-489b-bc4c-161ef30f4b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:35.451034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0b0b7235-4861-489b-bc4c-161ef30f4b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:35.457993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b0b7235-4861-489b-bc4c-161ef30f4b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:35.458488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b0b7235-4861-489b-bc4c-161ef30f4b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:35.458950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b0b7235-4861-489b-bc4c-161ef30f4b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:35.459640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b0b7235-4861-489b-bc4c-161ef30f4b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:35.460089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b0b7235-4861-489b-bc4c-161ef30f4b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:35.460518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b0b7235-4861-489b-bc4c-161ef30f4b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:35.489165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0b0b7235-4861-489b-bc4c-161ef30f4b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045116 Sep 02 09:49:35.489700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 422/772] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:35 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:49:36.409000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0acec6a9-5222-430a-866b-50d223cfd47f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:36.411733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0acec6a9-5222-430a-866b-50d223cfd47f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:36.418092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0acec6a9-5222-430a-866b-50d223cfd47f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:36.418589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0acec6a9-5222-430a-866b-50d223cfd47f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:36.419064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0acec6a9-5222-430a-866b-50d223cfd47f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:36.419743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0acec6a9-5222-430a-866b-50d223cfd47f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:36.420195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0acec6a9-5222-430a-866b-50d223cfd47f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:36.420616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0acec6a9-5222-430a-866b-50d223cfd47f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:36.449086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0acec6a9-5222-430a-866b-50d223cfd47f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 Sep 02 09:49:36.449628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 351/773] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:36.501106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4845b84d-7905-4fed-997e-86e82570e92c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:36.503245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4845b84d-7905-4fed-997e-86e82570e92c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:36.509661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4845b84d-7905-4fed-997e-86e82570e92c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:36.510146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4845b84d-7905-4fed-997e-86e82570e92c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:36.510578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4845b84d-7905-4fed-997e-86e82570e92c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:36.511291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4845b84d-7905-4fed-997e-86e82570e92c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:36.511736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4845b84d-7905-4fed-997e-86e82570e92c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:36.512153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4845b84d-7905-4fed-997e-86e82570e92c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:36.542962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4845b84d-7905-4fed-997e-86e82570e92c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Sep 02 09:49:36.543506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 423/774] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:36 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:37.461598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8a5c701f-d0e2-4f25-97ec-6ddeb05d0a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:37.463755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8a5c701f-d0e2-4f25-97ec-6ddeb05d0a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:37.470177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a5c701f-d0e2-4f25-97ec-6ddeb05d0a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:37.470656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a5c701f-d0e2-4f25-97ec-6ddeb05d0a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:37.471122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a5c701f-d0e2-4f25-97ec-6ddeb05d0a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:37.471797 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a5c701f-d0e2-4f25-97ec-6ddeb05d0a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:37.472243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a5c701f-d0e2-4f25-97ec-6ddeb05d0a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:37.472659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a5c701f-d0e2-4f25-97ec-6ddeb05d0a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:37.502303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8a5c701f-d0e2-4f25-97ec-6ddeb05d0a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Sep 02 09:49:37.502870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 352/775] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:37.556273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8868a2db-9ec4-481b-ad4e-517b5b2784fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:37.559240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8868a2db-9ec4-481b-ad4e-517b5b2784fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:37.566186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8868a2db-9ec4-481b-ad4e-517b5b2784fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:37.573138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8868a2db-9ec4-481b-ad4e-517b5b2784fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:37.573138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8868a2db-9ec4-481b-ad4e-517b5b2784fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:37.573138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8868a2db-9ec4-481b-ad4e-517b5b2784fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:37.573138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8868a2db-9ec4-481b-ad4e-517b5b2784fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:37.573575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8868a2db-9ec4-481b-ad4e-517b5b2784fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:37.600364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8868a2db-9ec4-481b-ad4e-517b5b2784fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049069 Sep 02 09:49:37.602908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 424/776] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:37 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:38.517163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-50e5c8f5-0ecf-4dc2-8c6f-c9ecaa07be6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:38.519302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-50e5c8f5-0ecf-4dc2-8c6f-c9ecaa07be6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:38.526518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50e5c8f5-0ecf-4dc2-8c6f-c9ecaa07be6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:38.527061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50e5c8f5-0ecf-4dc2-8c6f-c9ecaa07be6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:38.527496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50e5c8f5-0ecf-4dc2-8c6f-c9ecaa07be6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:38.528171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50e5c8f5-0ecf-4dc2-8c6f-c9ecaa07be6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:38.528615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50e5c8f5-0ecf-4dc2-8c6f-c9ecaa07be6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:38.529035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50e5c8f5-0ecf-4dc2-8c6f-c9ecaa07be6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:38.557345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-50e5c8f5-0ecf-4dc2-8c6f-c9ecaa07be6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Sep 02 09:49:38.557882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 353/777] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:38.612960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6a58aa5e-ca0a-4014-92af-694efb030745 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:38.615182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6a58aa5e-ca0a-4014-92af-694efb030745 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:38.621624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a58aa5e-ca0a-4014-92af-694efb030745 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:38.622175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a58aa5e-ca0a-4014-92af-694efb030745 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:38.622698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a58aa5e-ca0a-4014-92af-694efb030745 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:38.623410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a58aa5e-ca0a-4014-92af-694efb030745 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:38.623858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a58aa5e-ca0a-4014-92af-694efb030745 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:38.624282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6a58aa5e-ca0a-4014-92af-694efb030745 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:38.654449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6a58aa5e-ca0a-4014-92af-694efb030745 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045359 Sep 02 09:49:38.655026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 425/778] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:38 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:39.569522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5fa30b9d-4191-491b-ad4e-5478e3bcc5ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:39.571667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5fa30b9d-4191-491b-ad4e-5478e3bcc5ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:39.577983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa30b9d-4191-491b-ad4e-5478e3bcc5ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:39.578464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa30b9d-4191-491b-ad4e-5478e3bcc5ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:39.578945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa30b9d-4191-491b-ad4e-5478e3bcc5ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:39.579617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa30b9d-4191-491b-ad4e-5478e3bcc5ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:39.580069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa30b9d-4191-491b-ad4e-5478e3bcc5ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:39.580487 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5fa30b9d-4191-491b-ad4e-5478e3bcc5ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:39.610134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5fa30b9d-4191-491b-ad4e-5478e3bcc5ce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 Sep 02 09:49:39.610677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 354/779] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:39.667036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-792f3291-4091-4163-a46b-b0f2a0b1d535 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:39.669136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-792f3291-4091-4163-a46b-b0f2a0b1d535 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:39.675513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-792f3291-4091-4163-a46b-b0f2a0b1d535 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:39.676011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-792f3291-4091-4163-a46b-b0f2a0b1d535 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:39.676445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-792f3291-4091-4163-a46b-b0f2a0b1d535 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:39.677130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-792f3291-4091-4163-a46b-b0f2a0b1d535 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:39.677576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-792f3291-4091-4163-a46b-b0f2a0b1d535 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:39.677993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-792f3291-4091-4163-a46b-b0f2a0b1d535 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:39.708383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-792f3291-4091-4163-a46b-b0f2a0b1d535 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Sep 02 09:49:39.708937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 426/780] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:39 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:40.621559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-696062e2-469e-4a1f-b59d-f6f1deb62503 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:40.623706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-696062e2-469e-4a1f-b59d-f6f1deb62503 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:40.630012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696062e2-469e-4a1f-b59d-f6f1deb62503 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:40.630489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696062e2-469e-4a1f-b59d-f6f1deb62503 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:40.630956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696062e2-469e-4a1f-b59d-f6f1deb62503 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:40.631633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696062e2-469e-4a1f-b59d-f6f1deb62503 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:40.632079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696062e2-469e-4a1f-b59d-f6f1deb62503 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:40.632497 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696062e2-469e-4a1f-b59d-f6f1deb62503 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:40.661425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-696062e2-469e-4a1f-b59d-f6f1deb62503 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Sep 02 09:49:40.661951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 355/781] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:40.719796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-15b1647f-6851-4b60-9e02-db3e49e3b873 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:40.721892 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-15b1647f-6851-4b60-9e02-db3e49e3b873 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:40.728783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15b1647f-6851-4b60-9e02-db3e49e3b873 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:40.729263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15b1647f-6851-4b60-9e02-db3e49e3b873 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:40.729695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15b1647f-6851-4b60-9e02-db3e49e3b873 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:40.730371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15b1647f-6851-4b60-9e02-db3e49e3b873 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:40.730848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15b1647f-6851-4b60-9e02-db3e49e3b873 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:40.731270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15b1647f-6851-4b60-9e02-db3e49e3b873 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:40.760880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-15b1647f-6851-4b60-9e02-db3e49e3b873 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Sep 02 09:49:40.761416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 427/782] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:40 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:41.673305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e9c9b4a9-40c2-4571-ba5c-6254189afee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:41.675486 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e9c9b4a9-40c2-4571-ba5c-6254189afee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:41.682357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c9b4a9-40c2-4571-ba5c-6254189afee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:41.682882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c9b4a9-40c2-4571-ba5c-6254189afee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:41.683323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c9b4a9-40c2-4571-ba5c-6254189afee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:41.684006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c9b4a9-40c2-4571-ba5c-6254189afee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:41.684462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c9b4a9-40c2-4571-ba5c-6254189afee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:41.684888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9c9b4a9-40c2-4571-ba5c-6254189afee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:41.688549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:49:41.714560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e9c9b4a9-40c2-4571-ba5c-6254189afee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Sep 02 09:49:41.715151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 356/783] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:41.772252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8712a94b-3b79-4721-b9b2-b3fc6cb1d79a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:41.774383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8712a94b-3b79-4721-b9b2-b3fc6cb1d79a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:41.780833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8712a94b-3b79-4721-b9b2-b3fc6cb1d79a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:41.781327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8712a94b-3b79-4721-b9b2-b3fc6cb1d79a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:41.781767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8712a94b-3b79-4721-b9b2-b3fc6cb1d79a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:41.782465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8712a94b-3b79-4721-b9b2-b3fc6cb1d79a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:41.782950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8712a94b-3b79-4721-b9b2-b3fc6cb1d79a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:41.783380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8712a94b-3b79-4721-b9b2-b3fc6cb1d79a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:41.812635 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8712a94b-3b79-4721-b9b2-b3fc6cb1d79a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 Sep 02 09:49:41.813207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 428/784] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:41 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:42.726729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3d2fc6d-e507-4809-8563-943704660cbd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:42.728883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3d2fc6d-e507-4809-8563-943704660cbd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:42.735197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3d2fc6d-e507-4809-8563-943704660cbd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:42.735670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3d2fc6d-e507-4809-8563-943704660cbd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:42.736096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3d2fc6d-e507-4809-8563-943704660cbd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:42.736770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3d2fc6d-e507-4809-8563-943704660cbd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:42.737214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3d2fc6d-e507-4809-8563-943704660cbd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:42.737627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3d2fc6d-e507-4809-8563-943704660cbd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:42.766624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3d2fc6d-e507-4809-8563-943704660cbd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Sep 02 09:49:42.767189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 357/785] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:42.825278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-349b1c7c-1fbc-4612-9ebf-65a09ebc2ab3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:42.827413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-349b1c7c-1fbc-4612-9ebf-65a09ebc2ab3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:42.833860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349b1c7c-1fbc-4612-9ebf-65a09ebc2ab3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:42.834352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349b1c7c-1fbc-4612-9ebf-65a09ebc2ab3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:42.834824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349b1c7c-1fbc-4612-9ebf-65a09ebc2ab3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:42.835516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349b1c7c-1fbc-4612-9ebf-65a09ebc2ab3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:42.835970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349b1c7c-1fbc-4612-9ebf-65a09ebc2ab3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:42.836393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-349b1c7c-1fbc-4612-9ebf-65a09ebc2ab3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:42.867272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-349b1c7c-1fbc-4612-9ebf-65a09ebc2ab3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Sep 02 09:49:42.868015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 429/786] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:42 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:43.778965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f25a449a-6d64-4c90-a5dd-39020f4b12c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:43.781138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f25a449a-6d64-4c90-a5dd-39020f4b12c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:43.787965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f25a449a-6d64-4c90-a5dd-39020f4b12c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:43.788444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f25a449a-6d64-4c90-a5dd-39020f4b12c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:43.788871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f25a449a-6d64-4c90-a5dd-39020f4b12c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:43.789540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f25a449a-6d64-4c90-a5dd-39020f4b12c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:43.789985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f25a449a-6d64-4c90-a5dd-39020f4b12c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:43.790413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f25a449a-6d64-4c90-a5dd-39020f4b12c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:43.819038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f25a449a-6d64-4c90-a5dd-39020f4b12c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 Sep 02 09:49:43.819502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 358/787] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:43.879682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-85ff0c89-5b5b-4a4e-94c4-d01614bb2795 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:43.881911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-85ff0c89-5b5b-4a4e-94c4-d01614bb2795 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:43.888228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85ff0c89-5b5b-4a4e-94c4-d01614bb2795 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:43.888708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85ff0c89-5b5b-4a4e-94c4-d01614bb2795 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:43.889481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85ff0c89-5b5b-4a4e-94c4-d01614bb2795 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:43.889805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85ff0c89-5b5b-4a4e-94c4-d01614bb2795 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:43.890257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85ff0c89-5b5b-4a4e-94c4-d01614bb2795 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:43.890675 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85ff0c89-5b5b-4a4e-94c4-d01614bb2795 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:43.921509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-85ff0c89-5b5b-4a4e-94c4-d01614bb2795 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Sep 02 09:49:43.922062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 430/788] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:43 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:44.831155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-14a55131-9311-4eeb-952f-c74a364a114c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:44.833288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-14a55131-9311-4eeb-952f-c74a364a114c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:44.839752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14a55131-9311-4eeb-952f-c74a364a114c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:44.840234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14a55131-9311-4eeb-952f-c74a364a114c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:44.840671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14a55131-9311-4eeb-952f-c74a364a114c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:44.841355 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14a55131-9311-4eeb-952f-c74a364a114c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:44.841812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14a55131-9311-4eeb-952f-c74a364a114c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:44.842265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14a55131-9311-4eeb-952f-c74a364a114c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:44.871613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-14a55131-9311-4eeb-952f-c74a364a114c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Sep 02 09:49:44.872165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 359/789] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:45.055015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-70db50ef-4be6-4000-ab2b-a8f7423d2797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:45.057117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-70db50ef-4be6-4000-ab2b-a8f7423d2797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:45.063200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70db50ef-4be6-4000-ab2b-a8f7423d2797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:45.063671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70db50ef-4be6-4000-ab2b-a8f7423d2797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:45.064094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70db50ef-4be6-4000-ab2b-a8f7423d2797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:45.064773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70db50ef-4be6-4000-ab2b-a8f7423d2797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:45.065225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70db50ef-4be6-4000-ab2b-a8f7423d2797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:45.065650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70db50ef-4be6-4000-ab2b-a8f7423d2797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:45.090604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:49:45.095285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-70db50ef-4be6-4000-ab2b-a8f7423d2797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165814 Sep 02 09:49:45.095958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 431/790] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:44 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:45.884324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5aef0ad9-73ff-441d-b208-de098dc19684 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:45.886492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5aef0ad9-73ff-441d-b208-de098dc19684 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:45.888821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=69 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:49:45.893409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aef0ad9-73ff-441d-b208-de098dc19684 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:45.893882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aef0ad9-73ff-441d-b208-de098dc19684 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:45.894308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aef0ad9-73ff-441d-b208-de098dc19684 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:45.895002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aef0ad9-73ff-441d-b208-de098dc19684 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:45.896071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aef0ad9-73ff-441d-b208-de098dc19684 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:45.896490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aef0ad9-73ff-441d-b208-de098dc19684 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:45.925546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5aef0ad9-73ff-441d-b208-de098dc19684 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Sep 02 09:49:45.926094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 360/791] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:46.109229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2f9f32c7-561f-40eb-a2e3-570fe0febe59 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:46.111356 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2f9f32c7-561f-40eb-a2e3-570fe0febe59 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:46.113905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=67 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:49:46.119243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f9f32c7-561f-40eb-a2e3-570fe0febe59 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:46.119723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f9f32c7-561f-40eb-a2e3-570fe0febe59 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:46.120201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f9f32c7-561f-40eb-a2e3-570fe0febe59 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:46.120884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f9f32c7-561f-40eb-a2e3-570fe0febe59 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:46.121332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f9f32c7-561f-40eb-a2e3-570fe0febe59 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:46.121749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f9f32c7-561f-40eb-a2e3-570fe0febe59 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:46.153101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2f9f32c7-561f-40eb-a2e3-570fe0febe59 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047846 Sep 02 09:49:46.153662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 432/792] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:46 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:46.937732 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-be4108ce-dbf8-4631-9fb6-8e02cedd0573 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:46.939908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-be4108ce-dbf8-4631-9fb6-8e02cedd0573 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:46.946656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be4108ce-dbf8-4631-9fb6-8e02cedd0573 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:46.947165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be4108ce-dbf8-4631-9fb6-8e02cedd0573 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:46.947593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be4108ce-dbf8-4631-9fb6-8e02cedd0573 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:46.948270 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be4108ce-dbf8-4631-9fb6-8e02cedd0573 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:46.948717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be4108ce-dbf8-4631-9fb6-8e02cedd0573 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:46.949134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be4108ce-dbf8-4631-9fb6-8e02cedd0573 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:46.978037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-be4108ce-dbf8-4631-9fb6-8e02cedd0573 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044490 Sep 02 09:49:46.978577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 361/793] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:47.165814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f0089ee7-e401-42f8-9e08-2dedfc6f1d0f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:47.168029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f0089ee7-e401-42f8-9e08-2dedfc6f1d0f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:47.174400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0089ee7-e401-42f8-9e08-2dedfc6f1d0f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:47.175033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0089ee7-e401-42f8-9e08-2dedfc6f1d0f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:47.175342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0089ee7-e401-42f8-9e08-2dedfc6f1d0f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:47.176029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0089ee7-e401-42f8-9e08-2dedfc6f1d0f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:47.176482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0089ee7-e401-42f8-9e08-2dedfc6f1d0f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:47.176907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0089ee7-e401-42f8-9e08-2dedfc6f1d0f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:47.207773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f0089ee7-e401-42f8-9e08-2dedfc6f1d0f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046491 Sep 02 09:49:47.208979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 433/794] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:47 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:47.990186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-952a0795-e442-44d0-bffb-de516b237321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:47.992334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-952a0795-e442-44d0-bffb-de516b237321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:47.998642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-952a0795-e442-44d0-bffb-de516b237321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:47.999148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-952a0795-e442-44d0-bffb-de516b237321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:47.999582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-952a0795-e442-44d0-bffb-de516b237321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:48.000259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-952a0795-e442-44d0-bffb-de516b237321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:48.000707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-952a0795-e442-44d0-bffb-de516b237321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:48.001122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-952a0795-e442-44d0-bffb-de516b237321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:48.029540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-952a0795-e442-44d0-bffb-de516b237321 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Sep 02 09:49:48.030076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 362/795] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:48.220532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-698035e3-b484-4bd1-91ac-489c7d79ee47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:48.222676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-698035e3-b484-4bd1-91ac-489c7d79ee47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:48.229518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-698035e3-b484-4bd1-91ac-489c7d79ee47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:48.229995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-698035e3-b484-4bd1-91ac-489c7d79ee47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:48.230426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-698035e3-b484-4bd1-91ac-489c7d79ee47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:48.231166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-698035e3-b484-4bd1-91ac-489c7d79ee47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:48.231616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-698035e3-b484-4bd1-91ac-489c7d79ee47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:48.232032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-698035e3-b484-4bd1-91ac-489c7d79ee47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:48.261440 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-698035e3-b484-4bd1-91ac-489c7d79ee47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Sep 02 09:49:48.261985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 434/796] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:48 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:49.041860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5928a1e2-d9a4-4ecc-b73b-5e1a693f3e2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:49.043977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5928a1e2-d9a4-4ecc-b73b-5e1a693f3e2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:49.050249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5928a1e2-d9a4-4ecc-b73b-5e1a693f3e2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:49.050739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5928a1e2-d9a4-4ecc-b73b-5e1a693f3e2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:49.051178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5928a1e2-d9a4-4ecc-b73b-5e1a693f3e2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:49.051840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5928a1e2-d9a4-4ecc-b73b-5e1a693f3e2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:49.052284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5928a1e2-d9a4-4ecc-b73b-5e1a693f3e2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:49.052701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5928a1e2-d9a4-4ecc-b73b-5e1a693f3e2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:49.083671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5928a1e2-d9a4-4ecc-b73b-5e1a693f3e2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Sep 02 09:49:49.084220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 363/797] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:49.275137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-08842357-857e-42c0-8efd-39b2fec08756 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:49.277274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-08842357-857e-42c0-8efd-39b2fec08756 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:49.283582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08842357-857e-42c0-8efd-39b2fec08756 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:49.284067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08842357-857e-42c0-8efd-39b2fec08756 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:49.284508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08842357-857e-42c0-8efd-39b2fec08756 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:49.285195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08842357-857e-42c0-8efd-39b2fec08756 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:49.285654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08842357-857e-42c0-8efd-39b2fec08756 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:49.286079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08842357-857e-42c0-8efd-39b2fec08756 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:49.318249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-08842357-857e-42c0-8efd-39b2fec08756 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046612 Sep 02 09:49:49.318793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 435/798] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:49 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:50.095932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-23acb10f-8048-4d12-b3d1-37cce85aa2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:50.098078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-23acb10f-8048-4d12-b3d1-37cce85aa2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:50.105051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23acb10f-8048-4d12-b3d1-37cce85aa2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:50.105528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23acb10f-8048-4d12-b3d1-37cce85aa2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:50.105954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23acb10f-8048-4d12-b3d1-37cce85aa2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:50.106630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23acb10f-8048-4d12-b3d1-37cce85aa2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:50.107103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23acb10f-8048-4d12-b3d1-37cce85aa2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:50.107526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23acb10f-8048-4d12-b3d1-37cce85aa2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:50.135812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-23acb10f-8048-4d12-b3d1-37cce85aa2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Sep 02 09:49:50.136343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 364/799] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:50.338764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2e4f5f23-a071-4af3-a7eb-4ff89c07fff8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:50.340888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2e4f5f23-a071-4af3-a7eb-4ff89c07fff8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:50.347309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e4f5f23-a071-4af3-a7eb-4ff89c07fff8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:50.347737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e4f5f23-a071-4af3-a7eb-4ff89c07fff8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:50.348172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e4f5f23-a071-4af3-a7eb-4ff89c07fff8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:50.348860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e4f5f23-a071-4af3-a7eb-4ff89c07fff8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:50.349344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e4f5f23-a071-4af3-a7eb-4ff89c07fff8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:50.349767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e4f5f23-a071-4af3-a7eb-4ff89c07fff8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:50.378772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2e4f5f23-a071-4af3-a7eb-4ff89c07fff8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Sep 02 09:49:50.379319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 436/800] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:50 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:51.148317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3629b247-c97e-426d-b7ca-a2438e1eb706 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:51.150404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3629b247-c97e-426d-b7ca-a2438e1eb706 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:51.156786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3629b247-c97e-426d-b7ca-a2438e1eb706 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:51.157271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3629b247-c97e-426d-b7ca-a2438e1eb706 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:51.157707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3629b247-c97e-426d-b7ca-a2438e1eb706 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:51.158395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3629b247-c97e-426d-b7ca-a2438e1eb706 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:51.158891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3629b247-c97e-426d-b7ca-a2438e1eb706 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:51.159317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3629b247-c97e-426d-b7ca-a2438e1eb706 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:51.188647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3629b247-c97e-426d-b7ca-a2438e1eb706 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Sep 02 09:49:51.189196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 365/801] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:51.391304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b515de9f-4002-4d20-ad63-22ee41a692be tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:51.393475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b515de9f-4002-4d20-ad63-22ee41a692be tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:51.400964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b515de9f-4002-4d20-ad63-22ee41a692be tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:51.401392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b515de9f-4002-4d20-ad63-22ee41a692be tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:51.401860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b515de9f-4002-4d20-ad63-22ee41a692be tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:51.402542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b515de9f-4002-4d20-ad63-22ee41a692be tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:51.403023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b515de9f-4002-4d20-ad63-22ee41a692be tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:51.403531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b515de9f-4002-4d20-ad63-22ee41a692be tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:51.433493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b515de9f-4002-4d20-ad63-22ee41a692be tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046077 Sep 02 09:49:51.434040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 437/802] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:51 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:52.200750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-da299da5-bdb8-4313-bd60-dc5db112c4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:52.202816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-da299da5-bdb8-4313-bd60-dc5db112c4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:52.209156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da299da5-bdb8-4313-bd60-dc5db112c4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:52.209633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da299da5-bdb8-4313-bd60-dc5db112c4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:52.210065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da299da5-bdb8-4313-bd60-dc5db112c4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:52.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da299da5-bdb8-4313-bd60-dc5db112c4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:52.211220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da299da5-bdb8-4313-bd60-dc5db112c4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:52.211641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da299da5-bdb8-4313-bd60-dc5db112c4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:52.240424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-da299da5-bdb8-4313-bd60-dc5db112c4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043117 Sep 02 09:49:52.240962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 366/803] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:52.446285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b9c44d54-d67e-4dbf-920c-84ed877b83a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:52.448470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b9c44d54-d67e-4dbf-920c-84ed877b83a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:52.455165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b9c44d54-d67e-4dbf-920c-84ed877b83a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:52.455582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b9c44d54-d67e-4dbf-920c-84ed877b83a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:52.456024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b9c44d54-d67e-4dbf-920c-84ed877b83a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:52.456747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b9c44d54-d67e-4dbf-920c-84ed877b83a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:52.457204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b9c44d54-d67e-4dbf-920c-84ed877b83a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:52.457629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b9c44d54-d67e-4dbf-920c-84ed877b83a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:52.487042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b9c44d54-d67e-4dbf-920c-84ed877b83a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Sep 02 09:49:52.487594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 438/804] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:52 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:53.252780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-edf0bfaa-d1b8-4408-a889-5f4714ba24c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:53.255038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-edf0bfaa-d1b8-4408-a889-5f4714ba24c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:53.261876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-edf0bfaa-d1b8-4408-a889-5f4714ba24c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:53.262361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-edf0bfaa-d1b8-4408-a889-5f4714ba24c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:53.262823 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-edf0bfaa-d1b8-4408-a889-5f4714ba24c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:53.263526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-edf0bfaa-d1b8-4408-a889-5f4714ba24c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:53.263974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-edf0bfaa-d1b8-4408-a889-5f4714ba24c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:53.264398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-edf0bfaa-d1b8-4408-a889-5f4714ba24c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:53.294178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-edf0bfaa-d1b8-4408-a889-5f4714ba24c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Sep 02 09:49:53.294796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 367/805] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:53.500109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-59081af7-5d3d-4989-a1d0-f5b40e254f31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:53.502253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-59081af7-5d3d-4989-a1d0-f5b40e254f31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:53.509038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59081af7-5d3d-4989-a1d0-f5b40e254f31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:53.509536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59081af7-5d3d-4989-a1d0-f5b40e254f31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:53.509976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59081af7-5d3d-4989-a1d0-f5b40e254f31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:53.510664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59081af7-5d3d-4989-a1d0-f5b40e254f31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:53.511143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59081af7-5d3d-4989-a1d0-f5b40e254f31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:53.511570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59081af7-5d3d-4989-a1d0-f5b40e254f31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:53.541630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-59081af7-5d3d-4989-a1d0-f5b40e254f31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045509 Sep 02 09:49:53.542187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 439/806] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:53 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:54.307146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5cb76b21-6940-44b9-8d30-c4386df344be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:54.309170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5cb76b21-6940-44b9-8d30-c4386df344be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:54.315530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cb76b21-6940-44b9-8d30-c4386df344be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:54.316004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cb76b21-6940-44b9-8d30-c4386df344be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:54.316434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cb76b21-6940-44b9-8d30-c4386df344be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:54.317107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cb76b21-6940-44b9-8d30-c4386df344be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:54.317556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cb76b21-6940-44b9-8d30-c4386df344be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:54.317969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5cb76b21-6940-44b9-8d30-c4386df344be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:54.346391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5cb76b21-6940-44b9-8d30-c4386df344be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Sep 02 09:49:54.346945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 368/807] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:54.553680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-71c5f23e-e0b7-4868-9788-5622e6add868 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:54.555864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-71c5f23e-e0b7-4868-9788-5622e6add868 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:54.562385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71c5f23e-e0b7-4868-9788-5622e6add868 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:54.562849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71c5f23e-e0b7-4868-9788-5622e6add868 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:54.563281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71c5f23e-e0b7-4868-9788-5622e6add868 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:54.563961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71c5f23e-e0b7-4868-9788-5622e6add868 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:54.564408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71c5f23e-e0b7-4868-9788-5622e6add868 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:54.564891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71c5f23e-e0b7-4868-9788-5622e6add868 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:54.595044 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-71c5f23e-e0b7-4868-9788-5622e6add868 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045448 Sep 02 09:49:54.595603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 440/808] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:54 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:55.359107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-40d54929-e547-42a8-902a-2772c8318b7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:55.361221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-40d54929-e547-42a8-902a-2772c8318b7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:55.368156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d54929-e547-42a8-902a-2772c8318b7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:55.368668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d54929-e547-42a8-902a-2772c8318b7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:55.369106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d54929-e547-42a8-902a-2772c8318b7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:55.369783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d54929-e547-42a8-902a-2772c8318b7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:55.370234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d54929-e547-42a8-902a-2772c8318b7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:55.370653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d54929-e547-42a8-902a-2772c8318b7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:55.399583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-40d54929-e547-42a8-902a-2772c8318b7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Sep 02 09:49:55.400124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 369/809] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:55.607848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-67599c06-9a41-4588-8fba-9e407a05d78b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:55.610044 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-67599c06-9a41-4588-8fba-9e407a05d78b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:55.616956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67599c06-9a41-4588-8fba-9e407a05d78b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:55.617447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67599c06-9a41-4588-8fba-9e407a05d78b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:55.617880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67599c06-9a41-4588-8fba-9e407a05d78b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:55.618562 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67599c06-9a41-4588-8fba-9e407a05d78b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:55.619039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67599c06-9a41-4588-8fba-9e407a05d78b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:55.619464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67599c06-9a41-4588-8fba-9e407a05d78b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:55.648548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-67599c06-9a41-4588-8fba-9e407a05d78b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Sep 02 09:49:55.649106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 441/810] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:55 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:56.411860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-810bb69d-0f72-435e-b97d-476012a0c877 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:56.413988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-810bb69d-0f72-435e-b97d-476012a0c877 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:56.420376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-810bb69d-0f72-435e-b97d-476012a0c877 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:56.420852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-810bb69d-0f72-435e-b97d-476012a0c877 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:56.421279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-810bb69d-0f72-435e-b97d-476012a0c877 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:56.421953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-810bb69d-0f72-435e-b97d-476012a0c877 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:56.422395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-810bb69d-0f72-435e-b97d-476012a0c877 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:56.422838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-810bb69d-0f72-435e-b97d-476012a0c877 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:56.451534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-810bb69d-0f72-435e-b97d-476012a0c877 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Sep 02 09:49:56.452070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 370/811] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:56.660736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c92cedc7-76c8-4cac-84e7-c41c4a983f98 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:56.662988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c92cedc7-76c8-4cac-84e7-c41c4a983f98 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:56.669226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92cedc7-76c8-4cac-84e7-c41c4a983f98 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:56.669708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92cedc7-76c8-4cac-84e7-c41c4a983f98 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:56.670153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92cedc7-76c8-4cac-84e7-c41c4a983f98 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:56.670873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92cedc7-76c8-4cac-84e7-c41c4a983f98 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:56.671329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92cedc7-76c8-4cac-84e7-c41c4a983f98 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:56.671751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92cedc7-76c8-4cac-84e7-c41c4a983f98 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:56.702370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c92cedc7-76c8-4cac-84e7-c41c4a983f98 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Sep 02 09:49:56.703145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 442/812] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:56 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:57.464359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-48d09e96-7acb-4991-a577-e2ad80d79a06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:57.466543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-48d09e96-7acb-4991-a577-e2ad80d79a06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:57.472983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48d09e96-7acb-4991-a577-e2ad80d79a06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:57.473472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48d09e96-7acb-4991-a577-e2ad80d79a06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:57.474531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48d09e96-7acb-4991-a577-e2ad80d79a06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:57.475249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48d09e96-7acb-4991-a577-e2ad80d79a06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:57.475706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48d09e96-7acb-4991-a577-e2ad80d79a06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:57.476134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48d09e96-7acb-4991-a577-e2ad80d79a06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:57.504424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-48d09e96-7acb-4991-a577-e2ad80d79a06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Sep 02 09:49:57.504968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 371/813] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:57.714085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4de60e68-99be-48e9-ae4a-58c8aa32ad73 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:57.716281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4de60e68-99be-48e9-ae4a-58c8aa32ad73 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:57.722576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4de60e68-99be-48e9-ae4a-58c8aa32ad73 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:57.723106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4de60e68-99be-48e9-ae4a-58c8aa32ad73 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:57.723541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4de60e68-99be-48e9-ae4a-58c8aa32ad73 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:57.725844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4de60e68-99be-48e9-ae4a-58c8aa32ad73 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:57.726301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4de60e68-99be-48e9-ae4a-58c8aa32ad73 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:57.726917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4de60e68-99be-48e9-ae4a-58c8aa32ad73 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:57.756350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4de60e68-99be-48e9-ae4a-58c8aa32ad73 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046293 Sep 02 09:49:57.756895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 443/814] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:57 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:58.516841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-75af7e2e-cdc4-446e-be87-87350f711df7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:58.519009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-75af7e2e-cdc4-446e-be87-87350f711df7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:58.525729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75af7e2e-cdc4-446e-be87-87350f711df7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:58.526209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75af7e2e-cdc4-446e-be87-87350f711df7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:58.526646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75af7e2e-cdc4-446e-be87-87350f711df7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:58.527360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75af7e2e-cdc4-446e-be87-87350f711df7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:58.527808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75af7e2e-cdc4-446e-be87-87350f711df7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:58.528229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75af7e2e-cdc4-446e-be87-87350f711df7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:58.553372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:49:58.557973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-75af7e2e-cdc4-446e-be87-87350f711df7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Sep 02 09:49:58.558526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 372/815] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:58.768418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bcd7048b-09a9-46ac-a475-61b5d1fb563c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:58.770495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bcd7048b-09a9-46ac-a475-61b5d1fb563c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:58.777716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd7048b-09a9-46ac-a475-61b5d1fb563c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:58.778195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd7048b-09a9-46ac-a475-61b5d1fb563c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:58.778629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd7048b-09a9-46ac-a475-61b5d1fb563c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:58.779775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd7048b-09a9-46ac-a475-61b5d1fb563c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:58.780238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd7048b-09a9-46ac-a475-61b5d1fb563c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:58.780664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd7048b-09a9-46ac-a475-61b5d1fb563c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:58.810045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bcd7048b-09a9-46ac-a475-61b5d1fb563c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045618 Sep 02 09:49:58.810600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 444/816] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:58 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:59.570469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c4cebf6a-c0ea-4d3b-aa78-b24517358e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:59.572646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c4cebf6a-c0ea-4d3b-aa78-b24517358e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:59.579058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4cebf6a-c0ea-4d3b-aa78-b24517358e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:59.579538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4cebf6a-c0ea-4d3b-aa78-b24517358e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:59.579976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4cebf6a-c0ea-4d3b-aa78-b24517358e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:59.580657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4cebf6a-c0ea-4d3b-aa78-b24517358e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:59.581110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4cebf6a-c0ea-4d3b-aa78-b24517358e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:59.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c4cebf6a-c0ea-4d3b-aa78-b24517358e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:59.610923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c4cebf6a-c0ea-4d3b-aa78-b24517358e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Sep 02 09:49:59.611471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 373/817] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:49:59.821369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c056c4b5-cb0f-4f67-8ccd-fff6f9241a6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:49:59.823579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c056c4b5-cb0f-4f67-8ccd-fff6f9241a6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:49:59.829834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c056c4b5-cb0f-4f67-8ccd-fff6f9241a6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:59.830320 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c056c4b5-cb0f-4f67-8ccd-fff6f9241a6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:59.830791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c056c4b5-cb0f-4f67-8ccd-fff6f9241a6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:59.831481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c056c4b5-cb0f-4f67-8ccd-fff6f9241a6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:49:59.831933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c056c4b5-cb0f-4f67-8ccd-fff6f9241a6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:49:59.832357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c056c4b5-cb0f-4f67-8ccd-fff6f9241a6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:49:59.862157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c056c4b5-cb0f-4f67-8ccd-fff6f9241a6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044682 Sep 02 09:49:59.862723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 445/818] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:49:59 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:00.623148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e693b997-5e2a-45a9-a4a9-f9a6c7d487a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:00.625259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e693b997-5e2a-45a9-a4a9-f9a6c7d487a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:00.632146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e693b997-5e2a-45a9-a4a9-f9a6c7d487a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:00.632620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e693b997-5e2a-45a9-a4a9-f9a6c7d487a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:00.633055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e693b997-5e2a-45a9-a4a9-f9a6c7d487a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:00.633727 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e693b997-5e2a-45a9-a4a9-f9a6c7d487a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:00.634170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e693b997-5e2a-45a9-a4a9-f9a6c7d487a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:00.634581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e693b997-5e2a-45a9-a4a9-f9a6c7d487a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:00.662545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e693b997-5e2a-45a9-a4a9-f9a6c7d487a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043409 Sep 02 09:50:00.663109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 374/819] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:00.873473 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f30a42d7-b19a-430e-9622-a4d6d0869f7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:00.875583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f30a42d7-b19a-430e-9622-a4d6d0869f7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:00.882107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f30a42d7-b19a-430e-9622-a4d6d0869f7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:00.882569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f30a42d7-b19a-430e-9622-a4d6d0869f7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:00.883048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f30a42d7-b19a-430e-9622-a4d6d0869f7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:00.883739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f30a42d7-b19a-430e-9622-a4d6d0869f7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:00.884191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f30a42d7-b19a-430e-9622-a4d6d0869f7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:00.884615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f30a42d7-b19a-430e-9622-a4d6d0869f7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:00.913807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f30a42d7-b19a-430e-9622-a4d6d0869f7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Sep 02 09:50:00.914354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 446/820] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:00 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:01.674975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-21d0d9b0-6741-476d-a8d4-ce77214edba6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:01.677082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-21d0d9b0-6741-476d-a8d4-ce77214edba6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:01.683449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d0d9b0-6741-476d-a8d4-ce77214edba6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:01.683958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d0d9b0-6741-476d-a8d4-ce77214edba6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:01.684392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d0d9b0-6741-476d-a8d4-ce77214edba6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:01.685073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d0d9b0-6741-476d-a8d4-ce77214edba6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:01.685529 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d0d9b0-6741-476d-a8d4-ce77214edba6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:01.685950 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d0d9b0-6741-476d-a8d4-ce77214edba6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:01.716508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-21d0d9b0-6741-476d-a8d4-ce77214edba6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045569 Sep 02 09:50:01.717076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 375/821] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:01.925628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6fe78b19-7ecd-430f-bfa3-75169dcad12a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:01.927808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6fe78b19-7ecd-430f-bfa3-75169dcad12a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:01.934801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6fe78b19-7ecd-430f-bfa3-75169dcad12a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:01.935297 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6fe78b19-7ecd-430f-bfa3-75169dcad12a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:01.935737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6fe78b19-7ecd-430f-bfa3-75169dcad12a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:01.936428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6fe78b19-7ecd-430f-bfa3-75169dcad12a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:01.936882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6fe78b19-7ecd-430f-bfa3-75169dcad12a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:01.937309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6fe78b19-7ecd-430f-bfa3-75169dcad12a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:01.966543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6fe78b19-7ecd-430f-bfa3-75169dcad12a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Sep 02 09:50:01.967144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 447/822] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:01 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:02.728945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-21eb70c6-a00e-4a09-807b-7a509d627f5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:02.731765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-21eb70c6-a00e-4a09-807b-7a509d627f5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:02.738144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21eb70c6-a00e-4a09-807b-7a509d627f5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:02.738623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21eb70c6-a00e-4a09-807b-7a509d627f5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:02.739085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21eb70c6-a00e-4a09-807b-7a509d627f5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:02.739762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21eb70c6-a00e-4a09-807b-7a509d627f5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:02.740209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21eb70c6-a00e-4a09-807b-7a509d627f5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:02.740632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21eb70c6-a00e-4a09-807b-7a509d627f5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:02.769305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-21eb70c6-a00e-4a09-807b-7a509d627f5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Sep 02 09:50:02.769845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 376/823] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:02.984411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0733a4c1-8493-4ad7-8d0b-7229e00d3022 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:02.986507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0733a4c1-8493-4ad7-8d0b-7229e00d3022 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:02.993264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0733a4c1-8493-4ad7-8d0b-7229e00d3022 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:02.993741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0733a4c1-8493-4ad7-8d0b-7229e00d3022 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:02.994173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0733a4c1-8493-4ad7-8d0b-7229e00d3022 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:02.994878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0733a4c1-8493-4ad7-8d0b-7229e00d3022 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:02.995329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0733a4c1-8493-4ad7-8d0b-7229e00d3022 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:02.995761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0733a4c1-8493-4ad7-8d0b-7229e00d3022 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:03.012706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:03.026094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0733a4c1-8493-4ad7-8d0b-7229e00d3022 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045695 Sep 02 09:50:03.026647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 448/824] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:02 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:03.783637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4f0a8ebd-6d97-4545-9e9f-5e734ed849d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:03.785974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4f0a8ebd-6d97-4545-9e9f-5e734ed849d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:03.793003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f0a8ebd-6d97-4545-9e9f-5e734ed849d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:03.793476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f0a8ebd-6d97-4545-9e9f-5e734ed849d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:03.793901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f0a8ebd-6d97-4545-9e9f-5e734ed849d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:03.794593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f0a8ebd-6d97-4545-9e9f-5e734ed849d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:03.795050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f0a8ebd-6d97-4545-9e9f-5e734ed849d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:03.796708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f0a8ebd-6d97-4545-9e9f-5e734ed849d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:03.826035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4f0a8ebd-6d97-4545-9e9f-5e734ed849d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046421 Sep 02 09:50:03.826581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 377/825] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:04.044826 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-881f5f67-878b-4c92-9198-e6b8f0b81ba4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:04.046937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-881f5f67-878b-4c92-9198-e6b8f0b81ba4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:04.054505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-881f5f67-878b-4c92-9198-e6b8f0b81ba4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:04.056492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-881f5f67-878b-4c92-9198-e6b8f0b81ba4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:04.056492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-881f5f67-878b-4c92-9198-e6b8f0b81ba4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:04.056492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-881f5f67-878b-4c92-9198-e6b8f0b81ba4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:04.056785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-881f5f67-878b-4c92-9198-e6b8f0b81ba4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:04.056956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-881f5f67-878b-4c92-9198-e6b8f0b81ba4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:04.086016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-881f5f67-878b-4c92-9198-e6b8f0b81ba4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Sep 02 09:50:04.086560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 449/826] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:04 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:04.837649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9162ac32-137f-423d-babb-7df235215690 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:04.839937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9162ac32-137f-423d-babb-7df235215690 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:04.846357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9162ac32-137f-423d-babb-7df235215690 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:04.846870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9162ac32-137f-423d-babb-7df235215690 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:04.847304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9162ac32-137f-423d-babb-7df235215690 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:04.847992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9162ac32-137f-423d-babb-7df235215690 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:04.848443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9162ac32-137f-423d-babb-7df235215690 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:04.848866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9162ac32-137f-423d-babb-7df235215690 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:04.878067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9162ac32-137f-423d-babb-7df235215690 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044363 Sep 02 09:50:04.878629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 378/827] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:05.097334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ab316544-f2c4-4180-af19-5d963acb53d2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:05.099529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ab316544-f2c4-4180-af19-5d963acb53d2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:05.105759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab316544-f2c4-4180-af19-5d963acb53d2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:05.106238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab316544-f2c4-4180-af19-5d963acb53d2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:05.106724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab316544-f2c4-4180-af19-5d963acb53d2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:05.107398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab316544-f2c4-4180-af19-5d963acb53d2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:05.107844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab316544-f2c4-4180-af19-5d963acb53d2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:05.108261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab316544-f2c4-4180-af19-5d963acb53d2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:05.137393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ab316544-f2c4-4180-af19-5d963acb53d2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Sep 02 09:50:05.137934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 450/828] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:05 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:05.891143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8c246f23-dc6a-4b28-a9fb-86fe97ac9d7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:05.893283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8c246f23-dc6a-4b28-a9fb-86fe97ac9d7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:05.900508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c246f23-dc6a-4b28-a9fb-86fe97ac9d7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:05.900990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c246f23-dc6a-4b28-a9fb-86fe97ac9d7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:05.901424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c246f23-dc6a-4b28-a9fb-86fe97ac9d7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:05.902102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c246f23-dc6a-4b28-a9fb-86fe97ac9d7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:05.902551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c246f23-dc6a-4b28-a9fb-86fe97ac9d7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:05.903006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c246f23-dc6a-4b28-a9fb-86fe97ac9d7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:05.931795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8c246f23-dc6a-4b28-a9fb-86fe97ac9d7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044727 Sep 02 09:50:05.932340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 379/829] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:06.150302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d9ddc505-3c05-40a0-80df-2dce2365ef2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:06.152488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d9ddc505-3c05-40a0-80df-2dce2365ef2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:06.158889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9ddc505-3c05-40a0-80df-2dce2365ef2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:06.159371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9ddc505-3c05-40a0-80df-2dce2365ef2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:06.159808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9ddc505-3c05-40a0-80df-2dce2365ef2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:06.160492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9ddc505-3c05-40a0-80df-2dce2365ef2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:06.160942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9ddc505-3c05-40a0-80df-2dce2365ef2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:06.161366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9ddc505-3c05-40a0-80df-2dce2365ef2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:06.189499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d9ddc505-3c05-40a0-80df-2dce2365ef2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Sep 02 09:50:06.190038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 451/830] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:06 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:06.943988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b1e2e4f-65ed-4c62-92ec-c4f5d6d84c2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:06.946146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8b1e2e4f-65ed-4c62-92ec-c4f5d6d84c2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:06.952597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1e2e4f-65ed-4c62-92ec-c4f5d6d84c2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:06.953076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1e2e4f-65ed-4c62-92ec-c4f5d6d84c2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:06.953509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1e2e4f-65ed-4c62-92ec-c4f5d6d84c2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:06.954186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1e2e4f-65ed-4c62-92ec-c4f5d6d84c2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:06.954636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1e2e4f-65ed-4c62-92ec-c4f5d6d84c2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:06.955088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1e2e4f-65ed-4c62-92ec-c4f5d6d84c2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:06.983783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8b1e2e4f-65ed-4c62-92ec-c4f5d6d84c2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043732 Sep 02 09:50:06.984328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 380/831] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:07.202188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-975194ec-6747-4e7f-b95c-2345e280b911 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:07.204383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-975194ec-6747-4e7f-b95c-2345e280b911 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:07.211233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-975194ec-6747-4e7f-b95c-2345e280b911 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:07.211720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-975194ec-6747-4e7f-b95c-2345e280b911 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:07.212160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-975194ec-6747-4e7f-b95c-2345e280b911 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:07.212842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-975194ec-6747-4e7f-b95c-2345e280b911 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:07.213295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-975194ec-6747-4e7f-b95c-2345e280b911 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:07.213718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-975194ec-6747-4e7f-b95c-2345e280b911 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:07.242742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-975194ec-6747-4e7f-b95c-2345e280b911 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Sep 02 09:50:07.243276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 452/832] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:07 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:07.996504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3bf5dbbc-5b1a-4c48-ba45-ae717add96ae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:07.998663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3bf5dbbc-5b1a-4c48-ba45-ae717add96ae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:08.005257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bf5dbbc-5b1a-4c48-ba45-ae717add96ae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:08.005744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bf5dbbc-5b1a-4c48-ba45-ae717add96ae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:08.006181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bf5dbbc-5b1a-4c48-ba45-ae717add96ae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:08.007427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bf5dbbc-5b1a-4c48-ba45-ae717add96ae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:08.007886 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bf5dbbc-5b1a-4c48-ba45-ae717add96ae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:08.008307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bf5dbbc-5b1a-4c48-ba45-ae717add96ae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:08.038562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3bf5dbbc-5b1a-4c48-ba45-ae717add96ae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046000 Sep 02 09:50:08.039187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 381/833] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:08.255158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9118ae83-d726-4548-8e5b-865ec6cd5875 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:08.257395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9118ae83-d726-4548-8e5b-865ec6cd5875 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:08.263731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9118ae83-d726-4548-8e5b-865ec6cd5875 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:08.264215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9118ae83-d726-4548-8e5b-865ec6cd5875 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:08.264649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9118ae83-d726-4548-8e5b-865ec6cd5875 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:08.265335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9118ae83-d726-4548-8e5b-865ec6cd5875 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:08.265785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9118ae83-d726-4548-8e5b-865ec6cd5875 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:08.266209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9118ae83-d726-4548-8e5b-865ec6cd5875 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:08.295805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9118ae83-d726-4548-8e5b-865ec6cd5875 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044765 Sep 02 09:50:08.296348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 453/834] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:08 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:50:09.051091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f04ba974-1787-4f02-985b-a9809fcab52c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:09.053267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f04ba974-1787-4f02-985b-a9809fcab52c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:09.059703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f04ba974-1787-4f02-985b-a9809fcab52c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:09.060185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f04ba974-1787-4f02-985b-a9809fcab52c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:09.060617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f04ba974-1787-4f02-985b-a9809fcab52c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:09.061299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f04ba974-1787-4f02-985b-a9809fcab52c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:09.061751 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f04ba974-1787-4f02-985b-a9809fcab52c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:09.062173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f04ba974-1787-4f02-985b-a9809fcab52c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:09.091548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f04ba974-1787-4f02-985b-a9809fcab52c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Sep 02 09:50:09.092090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 382/835] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:09.308520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bd7f0c1e-8808-4ddc-b058-61afa026f276 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:09.310678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bd7f0c1e-8808-4ddc-b058-61afa026f276 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:09.317644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd7f0c1e-8808-4ddc-b058-61afa026f276 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:09.318137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd7f0c1e-8808-4ddc-b058-61afa026f276 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:09.318575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd7f0c1e-8808-4ddc-b058-61afa026f276 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:09.319305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd7f0c1e-8808-4ddc-b058-61afa026f276 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:09.319762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd7f0c1e-8808-4ddc-b058-61afa026f276 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:09.320191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd7f0c1e-8808-4ddc-b058-61afa026f276 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:09.349559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bd7f0c1e-8808-4ddc-b058-61afa026f276 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Sep 02 09:50:09.350745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 454/836] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:09 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:10.104345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b955c536-98ed-4e27-b72c-732592eefe76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:10.106413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b955c536-98ed-4e27-b72c-732592eefe76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:10.112822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b955c536-98ed-4e27-b72c-732592eefe76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:10.113361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b955c536-98ed-4e27-b72c-732592eefe76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:10.113797 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b955c536-98ed-4e27-b72c-732592eefe76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:10.114472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b955c536-98ed-4e27-b72c-732592eefe76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:10.114941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b955c536-98ed-4e27-b72c-732592eefe76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:10.115361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b955c536-98ed-4e27-b72c-732592eefe76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:10.144157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b955c536-98ed-4e27-b72c-732592eefe76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044379 Sep 02 09:50:10.144686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 383/837] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:10.361668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7eb852bc-674e-44c8-8684-e1ebada886e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:10.363833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7eb852bc-674e-44c8-8684-e1ebada886e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:10.371580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7eb852bc-674e-44c8-8684-e1ebada886e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:10.372072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7eb852bc-674e-44c8-8684-e1ebada886e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:10.372507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7eb852bc-674e-44c8-8684-e1ebada886e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:10.373200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7eb852bc-674e-44c8-8684-e1ebada886e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:10.373686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7eb852bc-674e-44c8-8684-e1ebada886e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:10.374115 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7eb852bc-674e-44c8-8684-e1ebada886e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:10.403393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7eb852bc-674e-44c8-8684-e1ebada886e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045583 Sep 02 09:50:10.404144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 455/838] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:10 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:11.156709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bf1c38fe-2f42-4225-b6f9-ca9b4d52df8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:11.158811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bf1c38fe-2f42-4225-b6f9-ca9b4d52df8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:11.165209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1c38fe-2f42-4225-b6f9-ca9b4d52df8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:11.167103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1c38fe-2f42-4225-b6f9-ca9b4d52df8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:11.167103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1c38fe-2f42-4225-b6f9-ca9b4d52df8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:11.167103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1c38fe-2f42-4225-b6f9-ca9b4d52df8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:11.167404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1c38fe-2f42-4225-b6f9-ca9b4d52df8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:11.167783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1c38fe-2f42-4225-b6f9-ca9b4d52df8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:11.197451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bf1c38fe-2f42-4225-b6f9-ca9b4d52df8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Sep 02 09:50:11.198002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 384/839] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:11.415763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9fe32bb5-486c-4dca-8268-f030327a9b57 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:11.417888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9fe32bb5-486c-4dca-8268-f030327a9b57 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:11.424131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fe32bb5-486c-4dca-8268-f030327a9b57 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:11.424615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fe32bb5-486c-4dca-8268-f030327a9b57 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:11.425048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fe32bb5-486c-4dca-8268-f030327a9b57 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:11.425729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fe32bb5-486c-4dca-8268-f030327a9b57 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:11.426175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fe32bb5-486c-4dca-8268-f030327a9b57 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:11.426593 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9fe32bb5-486c-4dca-8268-f030327a9b57 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:11.456939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9fe32bb5-486c-4dca-8268-f030327a9b57 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045108 Sep 02 09:50:11.457490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 456/840] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:11 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:12.210084 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7aaf27ff-47f9-41cc-9fb9-3ce5a987c4df tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:12.212157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7aaf27ff-47f9-41cc-9fb9-3ce5a987c4df tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:12.218541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aaf27ff-47f9-41cc-9fb9-3ce5a987c4df tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:12.219055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aaf27ff-47f9-41cc-9fb9-3ce5a987c4df tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:12.219497 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aaf27ff-47f9-41cc-9fb9-3ce5a987c4df tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:12.220184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aaf27ff-47f9-41cc-9fb9-3ce5a987c4df tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:12.220637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aaf27ff-47f9-41cc-9fb9-3ce5a987c4df tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:12.221069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aaf27ff-47f9-41cc-9fb9-3ce5a987c4df tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:12.250172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7aaf27ff-47f9-41cc-9fb9-3ce5a987c4df tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Sep 02 09:50:12.250722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 385/841] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:12.469314 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f6887806-0375-4273-81f9-b7469d218282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:12.471655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f6887806-0375-4273-81f9-b7469d218282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:12.478065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6887806-0375-4273-81f9-b7469d218282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:12.478551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6887806-0375-4273-81f9-b7469d218282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:12.479039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6887806-0375-4273-81f9-b7469d218282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:12.479721 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6887806-0375-4273-81f9-b7469d218282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:12.480171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6887806-0375-4273-81f9-b7469d218282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:12.480707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6887806-0375-4273-81f9-b7469d218282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:12.510844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f6887806-0375-4273-81f9-b7469d218282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045559 Sep 02 09:50:12.511389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 457/842] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:12 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:13.262551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5ef718dd-ff46-4cd3-a431-05a87b221a6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:13.264605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5ef718dd-ff46-4cd3-a431-05a87b221a6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:13.270915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ef718dd-ff46-4cd3-a431-05a87b221a6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:13.271655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ef718dd-ff46-4cd3-a431-05a87b221a6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:13.272734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ef718dd-ff46-4cd3-a431-05a87b221a6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:13.273432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ef718dd-ff46-4cd3-a431-05a87b221a6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:13.273876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ef718dd-ff46-4cd3-a431-05a87b221a6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:13.274297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ef718dd-ff46-4cd3-a431-05a87b221a6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:13.302579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5ef718dd-ff46-4cd3-a431-05a87b221a6a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Sep 02 09:50:13.303154 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 386/843] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:13.523256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a2c7c766-191e-4c50-92c0-b2fc883c7ac2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:13.525427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a2c7c766-191e-4c50-92c0-b2fc883c7ac2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:13.531705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2c7c766-191e-4c50-92c0-b2fc883c7ac2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:13.532198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2c7c766-191e-4c50-92c0-b2fc883c7ac2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:13.532637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2c7c766-191e-4c50-92c0-b2fc883c7ac2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:13.533330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2c7c766-191e-4c50-92c0-b2fc883c7ac2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:13.533787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2c7c766-191e-4c50-92c0-b2fc883c7ac2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:13.534219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a2c7c766-191e-4c50-92c0-b2fc883c7ac2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:13.564232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a2c7c766-191e-4c50-92c0-b2fc883c7ac2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Sep 02 09:50:13.566919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 458/844] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:13 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:14.315062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4fd749d4-40de-40bf-ba6f-57f715b04ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:14.317177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4fd749d4-40de-40bf-ba6f-57f715b04ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:14.324446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fd749d4-40de-40bf-ba6f-57f715b04ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:14.324928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fd749d4-40de-40bf-ba6f-57f715b04ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:14.325363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fd749d4-40de-40bf-ba6f-57f715b04ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:14.326049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fd749d4-40de-40bf-ba6f-57f715b04ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:14.326503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fd749d4-40de-40bf-ba6f-57f715b04ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:14.326953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fd749d4-40de-40bf-ba6f-57f715b04ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:14.356466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4fd749d4-40de-40bf-ba6f-57f715b04ad9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045528 Sep 02 09:50:14.357021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 387/845] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:14.576274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fd0708d5-5557-4ace-ba88-c303b8e86cc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:14.578406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fd0708d5-5557-4ace-ba88-c303b8e86cc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:14.584855 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0708d5-5557-4ace-ba88-c303b8e86cc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:14.590174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0708d5-5557-4ace-ba88-c303b8e86cc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:14.590174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0708d5-5557-4ace-ba88-c303b8e86cc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:14.590174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0708d5-5557-4ace-ba88-c303b8e86cc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:14.590174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0708d5-5557-4ace-ba88-c303b8e86cc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:14.590688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0708d5-5557-4ace-ba88-c303b8e86cc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:14.618338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fd0708d5-5557-4ace-ba88-c303b8e86cc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046006 Sep 02 09:50:14.618916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 459/846] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:14 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:15.369294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c6839c66-7167-43ff-85b5-6762d12a0ba7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:15.371444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c6839c66-7167-43ff-85b5-6762d12a0ba7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:15.377774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6839c66-7167-43ff-85b5-6762d12a0ba7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:15.378250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6839c66-7167-43ff-85b5-6762d12a0ba7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:15.378680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6839c66-7167-43ff-85b5-6762d12a0ba7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:15.379379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6839c66-7167-43ff-85b5-6762d12a0ba7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:15.379837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6839c66-7167-43ff-85b5-6762d12a0ba7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:15.380269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6839c66-7167-43ff-85b5-6762d12a0ba7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:15.409756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c6839c66-7167-43ff-85b5-6762d12a0ba7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Sep 02 09:50:15.410309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 388/847] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:15.630533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-02e36b8e-de1a-48b9-a8cd-f457d79eb676 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:15.632740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-02e36b8e-de1a-48b9-a8cd-f457d79eb676 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:15.639192 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02e36b8e-de1a-48b9-a8cd-f457d79eb676 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:15.639784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02e36b8e-de1a-48b9-a8cd-f457d79eb676 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:15.640098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02e36b8e-de1a-48b9-a8cd-f457d79eb676 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:15.640781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02e36b8e-de1a-48b9-a8cd-f457d79eb676 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:15.641227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02e36b8e-de1a-48b9-a8cd-f457d79eb676 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:15.641646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02e36b8e-de1a-48b9-a8cd-f457d79eb676 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:15.671633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-02e36b8e-de1a-48b9-a8cd-f457d79eb676 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Sep 02 09:50:15.672179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 460/848] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:15 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:16.422614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ce5e875a-e62b-4676-8335-39dc0235c121 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:16.424770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ce5e875a-e62b-4676-8335-39dc0235c121 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:16.431185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce5e875a-e62b-4676-8335-39dc0235c121 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:16.431662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce5e875a-e62b-4676-8335-39dc0235c121 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:16.432092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce5e875a-e62b-4676-8335-39dc0235c121 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:16.432762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce5e875a-e62b-4676-8335-39dc0235c121 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:16.433205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce5e875a-e62b-4676-8335-39dc0235c121 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:16.433623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce5e875a-e62b-4676-8335-39dc0235c121 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:16.450023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:16.463082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ce5e875a-e62b-4676-8335-39dc0235c121 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Sep 02 09:50:16.465009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 389/849] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:16.684014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-44225d17-4d28-4d8f-8400-a6c5836b201d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:16.686203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-44225d17-4d28-4d8f-8400-a6c5836b201d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:16.688506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=58 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:16.693246 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44225d17-4d28-4d8f-8400-a6c5836b201d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:16.693739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44225d17-4d28-4d8f-8400-a6c5836b201d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:16.694180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44225d17-4d28-4d8f-8400-a6c5836b201d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:16.695066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44225d17-4d28-4d8f-8400-a6c5836b201d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:16.696222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44225d17-4d28-4d8f-8400-a6c5836b201d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:16.704295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44225d17-4d28-4d8f-8400-a6c5836b201d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:16.727378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-44225d17-4d28-4d8f-8400-a6c5836b201d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047675 Sep 02 09:50:16.728159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 461/850] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:16 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:17.475961 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-15b4e6b1-a52f-4475-b712-3049db746903 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:17.478616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-15b4e6b1-a52f-4475-b712-3049db746903 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:17.480904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=60 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:17.485714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15b4e6b1-a52f-4475-b712-3049db746903 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:17.486191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15b4e6b1-a52f-4475-b712-3049db746903 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:17.486627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15b4e6b1-a52f-4475-b712-3049db746903 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:17.487330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15b4e6b1-a52f-4475-b712-3049db746903 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:17.487783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15b4e6b1-a52f-4475-b712-3049db746903 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:17.488202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15b4e6b1-a52f-4475-b712-3049db746903 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:17.516385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-15b4e6b1-a52f-4475-b712-3049db746903 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Sep 02 09:50:17.516964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 390/851] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:17.741223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2241902b-dd47-4885-a757-32405b5b27c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:17.744434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2241902b-dd47-4885-a757-32405b5b27c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:17.752102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2241902b-dd47-4885-a757-32405b5b27c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:17.752591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2241902b-dd47-4885-a757-32405b5b27c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:17.753027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2241902b-dd47-4885-a757-32405b5b27c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:17.753726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2241902b-dd47-4885-a757-32405b5b27c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:17.754182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2241902b-dd47-4885-a757-32405b5b27c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:17.754610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2241902b-dd47-4885-a757-32405b5b27c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:17.784790 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2241902b-dd47-4885-a757-32405b5b27c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048392 Sep 02 09:50:17.785344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 462/852] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:17 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:18.529383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bd4cdc32-93f1-4e43-9707-407b0140c526 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:18.531616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bd4cdc32-93f1-4e43-9707-407b0140c526 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:18.538134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd4cdc32-93f1-4e43-9707-407b0140c526 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:18.538609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd4cdc32-93f1-4e43-9707-407b0140c526 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:18.539583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd4cdc32-93f1-4e43-9707-407b0140c526 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:18.540260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd4cdc32-93f1-4e43-9707-407b0140c526 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:18.540704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd4cdc32-93f1-4e43-9707-407b0140c526 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:18.541126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bd4cdc32-93f1-4e43-9707-407b0140c526 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:18.571713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bd4cdc32-93f1-4e43-9707-407b0140c526 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046361 Sep 02 09:50:18.572605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 391/853] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:18.803220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d83b7a07-7dea-4cf5-9854-4de886c4347b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:18.805877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d83b7a07-7dea-4cf5-9854-4de886c4347b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:18.812418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d83b7a07-7dea-4cf5-9854-4de886c4347b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:18.812910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d83b7a07-7dea-4cf5-9854-4de886c4347b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:18.813348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d83b7a07-7dea-4cf5-9854-4de886c4347b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:18.814043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d83b7a07-7dea-4cf5-9854-4de886c4347b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:18.814502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d83b7a07-7dea-4cf5-9854-4de886c4347b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:18.814952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d83b7a07-7dea-4cf5-9854-4de886c4347b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:18.849699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d83b7a07-7dea-4cf5-9854-4de886c4347b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050356 Sep 02 09:50:18.850551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 463/854] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:18 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:19.584077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e6fd0017-0b5e-43ae-aac1-092a02e343c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:19.586201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e6fd0017-0b5e-43ae-aac1-092a02e343c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:19.593068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6fd0017-0b5e-43ae-aac1-092a02e343c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:19.593552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6fd0017-0b5e-43ae-aac1-092a02e343c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:19.593988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6fd0017-0b5e-43ae-aac1-092a02e343c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:19.594670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6fd0017-0b5e-43ae-aac1-092a02e343c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:19.595145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6fd0017-0b5e-43ae-aac1-092a02e343c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:19.595568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6fd0017-0b5e-43ae-aac1-092a02e343c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:19.624423 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e6fd0017-0b5e-43ae-aac1-092a02e343c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Sep 02 09:50:19.624988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 392/855] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:19.861580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-12c65f2b-52cb-44c4-b34f-4ac17f2561fb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:19.863782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-12c65f2b-52cb-44c4-b34f-4ac17f2561fb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:19.870379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12c65f2b-52cb-44c4-b34f-4ac17f2561fb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:19.871112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12c65f2b-52cb-44c4-b34f-4ac17f2561fb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:19.871598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12c65f2b-52cb-44c4-b34f-4ac17f2561fb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:19.872302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12c65f2b-52cb-44c4-b34f-4ac17f2561fb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:19.872757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12c65f2b-52cb-44c4-b34f-4ac17f2561fb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:19.873180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12c65f2b-52cb-44c4-b34f-4ac17f2561fb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:19.907817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-12c65f2b-52cb-44c4-b34f-4ac17f2561fb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050227 Sep 02 09:50:19.908412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 464/856] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:19 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:20.635955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fa25fb80-30e0-49bb-9bc8-8793a22255b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:20.638078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fa25fb80-30e0-49bb-9bc8-8793a22255b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:20.644447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa25fb80-30e0-49bb-9bc8-8793a22255b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:20.644925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa25fb80-30e0-49bb-9bc8-8793a22255b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:20.645352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa25fb80-30e0-49bb-9bc8-8793a22255b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:20.646274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa25fb80-30e0-49bb-9bc8-8793a22255b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:20.646769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa25fb80-30e0-49bb-9bc8-8793a22255b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:20.647189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa25fb80-30e0-49bb-9bc8-8793a22255b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:20.675557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fa25fb80-30e0-49bb-9bc8-8793a22255b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043633 Sep 02 09:50:20.676086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 393/857] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:20.920631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-825b59fb-e0e8-44b6-8385-b444acc7cfff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:20.922920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-825b59fb-e0e8-44b6-8385-b444acc7cfff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:20.929229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-825b59fb-e0e8-44b6-8385-b444acc7cfff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:20.929739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-825b59fb-e0e8-44b6-8385-b444acc7cfff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:20.930174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-825b59fb-e0e8-44b6-8385-b444acc7cfff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:20.931477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-825b59fb-e0e8-44b6-8385-b444acc7cfff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:20.931935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-825b59fb-e0e8-44b6-8385-b444acc7cfff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:20.932359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-825b59fb-e0e8-44b6-8385-b444acc7cfff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:20.936124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:20.963047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-825b59fb-e0e8-44b6-8385-b444acc7cfff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 Sep 02 09:50:20.966469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 465/858] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:20 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:21.687730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-78145d45-cdf0-40c2-ac6c-cfbfd0b628c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:21.689839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-78145d45-cdf0-40c2-ac6c-cfbfd0b628c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:21.691850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:50:21.691996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:50:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments (ip 10.222.0.57) !!! Sep 02 09:50:21.701463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78145d45-cdf0-40c2-ac6c-cfbfd0b628c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:21.701954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78145d45-cdf0-40c2-ac6c-cfbfd0b628c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:21.702395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78145d45-cdf0-40c2-ac6c-cfbfd0b628c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:21.703125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78145d45-cdf0-40c2-ac6c-cfbfd0b628c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:21.703587 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78145d45-cdf0-40c2-ac6c-cfbfd0b628c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:21.704016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78145d45-cdf0-40c2-ac6c-cfbfd0b628c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:21.733104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-78145d45-cdf0-40c2-ac6c-cfbfd0b628c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049375 Sep 02 09:50:21.733657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 394/859] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:21.975234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-438aa5aa-854e-451f-a933-93efa96ba1fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:21.977460 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-438aa5aa-854e-451f-a933-93efa96ba1fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:21.984699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-438aa5aa-854e-451f-a933-93efa96ba1fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:21.985156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-438aa5aa-854e-451f-a933-93efa96ba1fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:21.985629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-438aa5aa-854e-451f-a933-93efa96ba1fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:21.986336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-438aa5aa-854e-451f-a933-93efa96ba1fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:21.986831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-438aa5aa-854e-451f-a933-93efa96ba1fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:21.987478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-438aa5aa-854e-451f-a933-93efa96ba1fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:22.017926 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-438aa5aa-854e-451f-a933-93efa96ba1fe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046570 Sep 02 09:50:22.018485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 466/860] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:21 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:22.745401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-332d0c73-2074-4d2d-82bc-172711629ba9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:22.747529 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-332d0c73-2074-4d2d-82bc-172711629ba9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:22.753920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-332d0c73-2074-4d2d-82bc-172711629ba9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:22.754397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-332d0c73-2074-4d2d-82bc-172711629ba9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:22.754858 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-332d0c73-2074-4d2d-82bc-172711629ba9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:22.755542 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-332d0c73-2074-4d2d-82bc-172711629ba9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:22.755986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-332d0c73-2074-4d2d-82bc-172711629ba9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:22.756473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-332d0c73-2074-4d2d-82bc-172711629ba9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:22.787017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-332d0c73-2074-4d2d-82bc-172711629ba9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046119 Sep 02 09:50:22.787566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 395/861] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:23.030358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2e6110f3-fd98-442c-ae1b-db74c254be93 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:23.032450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2e6110f3-fd98-442c-ae1b-db74c254be93 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:23.039561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e6110f3-fd98-442c-ae1b-db74c254be93 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:23.040625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e6110f3-fd98-442c-ae1b-db74c254be93 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:23.041071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e6110f3-fd98-442c-ae1b-db74c254be93 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:23.041824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e6110f3-fd98-442c-ae1b-db74c254be93 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:23.042306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e6110f3-fd98-442c-ae1b-db74c254be93 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:23.043111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e6110f3-fd98-442c-ae1b-db74c254be93 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:23.077733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2e6110f3-fd98-442c-ae1b-db74c254be93 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051322 Sep 02 09:50:23.078334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 467/862] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:23 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:23.799938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a66243be-3162-496b-9343-028278d58f70 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:23.802077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a66243be-3162-496b-9343-028278d58f70 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:23.808466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a66243be-3162-496b-9343-028278d58f70 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:23.808947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a66243be-3162-496b-9343-028278d58f70 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:23.809382 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a66243be-3162-496b-9343-028278d58f70 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:23.810062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a66243be-3162-496b-9343-028278d58f70 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:23.810516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a66243be-3162-496b-9343-028278d58f70 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:23.810965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a66243be-3162-496b-9343-028278d58f70 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:23.840481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a66243be-3162-496b-9343-028278d58f70 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Sep 02 09:50:23.840973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 396/863] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:24.090797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-297ddfe2-338b-405b-be77-e68ef3a4fbc6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:24.092879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-297ddfe2-338b-405b-be77-e68ef3a4fbc6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:24.099270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-297ddfe2-338b-405b-be77-e68ef3a4fbc6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:24.099757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-297ddfe2-338b-405b-be77-e68ef3a4fbc6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:24.100195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-297ddfe2-338b-405b-be77-e68ef3a4fbc6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:24.100887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-297ddfe2-338b-405b-be77-e68ef3a4fbc6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:24.101346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-297ddfe2-338b-405b-be77-e68ef3a4fbc6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:24.101768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-297ddfe2-338b-405b-be77-e68ef3a4fbc6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:24.131684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-297ddfe2-338b-405b-be77-e68ef3a4fbc6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 Sep 02 09:50:24.132475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 468/864] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:24 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:50:24.851945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-40492004-7630-4952-80fa-17fd725186a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:24.854691 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-40492004-7630-4952-80fa-17fd725186a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:24.861477 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40492004-7630-4952-80fa-17fd725186a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:24.861966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40492004-7630-4952-80fa-17fd725186a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:24.862404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40492004-7630-4952-80fa-17fd725186a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:24.863155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40492004-7630-4952-80fa-17fd725186a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:24.863613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40492004-7630-4952-80fa-17fd725186a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:24.864034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40492004-7630-4952-80fa-17fd725186a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:24.893661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-40492004-7630-4952-80fa-17fd725186a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045605 Sep 02 09:50:24.894220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 397/865] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:25.144535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-02fc0148-4dfe-405c-8715-2592ec76e5eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:25.147040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-02fc0148-4dfe-405c-8715-2592ec76e5eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:25.149623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:50:25.149761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 09:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments (ip 10.222.0.57) !!! Sep 02 09:50:25.151063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:50:25.151189 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 09:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments (ip 10.222.0.57) !!! Sep 02 09:50:25.160546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02fc0148-4dfe-405c-8715-2592ec76e5eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:25.161036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02fc0148-4dfe-405c-8715-2592ec76e5eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:25.161478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02fc0148-4dfe-405c-8715-2592ec76e5eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:25.162200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02fc0148-4dfe-405c-8715-2592ec76e5eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:25.162652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02fc0148-4dfe-405c-8715-2592ec76e5eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:25.164632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02fc0148-4dfe-405c-8715-2592ec76e5eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:25.199777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-02fc0148-4dfe-405c-8715-2592ec76e5eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059171 Sep 02 09:50:25.200343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 469/866] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:25.906079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f4c7de95-1f31-4258-899d-b12369893169 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:25.908231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f4c7de95-1f31-4258-899d-b12369893169 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:25.915100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4c7de95-1f31-4258-899d-b12369893169 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:25.915585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4c7de95-1f31-4258-899d-b12369893169 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:25.916018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4c7de95-1f31-4258-899d-b12369893169 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:25.916697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4c7de95-1f31-4258-899d-b12369893169 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:25.917146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4c7de95-1f31-4258-899d-b12369893169 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:25.917566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4c7de95-1f31-4258-899d-b12369893169 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:25.947619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f4c7de95-1f31-4258-899d-b12369893169 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045502 Sep 02 09:50:25.948171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 398/867] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:25 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:26.211299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-570dadc0-0ea2-4a93-8752-370c878451a2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:26.213917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-570dadc0-0ea2-4a93-8752-370c878451a2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:26.220574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570dadc0-0ea2-4a93-8752-370c878451a2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:26.221069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570dadc0-0ea2-4a93-8752-370c878451a2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:26.221511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570dadc0-0ea2-4a93-8752-370c878451a2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:26.222202 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570dadc0-0ea2-4a93-8752-370c878451a2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:26.222659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570dadc0-0ea2-4a93-8752-370c878451a2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:26.223116 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570dadc0-0ea2-4a93-8752-370c878451a2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:26.253374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-570dadc0-0ea2-4a93-8752-370c878451a2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046016 Sep 02 09:50:26.253944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 470/868] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:26 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:26.959655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e4e7269-a725-4dce-85a8-96c740dd3ef9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:26.961871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e4e7269-a725-4dce-85a8-96c740dd3ef9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:26.968330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4e7269-a725-4dce-85a8-96c740dd3ef9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:26.968808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4e7269-a725-4dce-85a8-96c740dd3ef9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:26.969239 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4e7269-a725-4dce-85a8-96c740dd3ef9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:26.969919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4e7269-a725-4dce-85a8-96c740dd3ef9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:26.970376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4e7269-a725-4dce-85a8-96c740dd3ef9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:26.970829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e4e7269-a725-4dce-85a8-96c740dd3ef9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:26.999810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e4e7269-a725-4dce-85a8-96c740dd3ef9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Sep 02 09:50:27.000355 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 399/869] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:26 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:27.265667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ee9751b5-5709-4544-a04f-59fc2cb7febe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:27.267751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ee9751b5-5709-4544-a04f-59fc2cb7febe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:27.274305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee9751b5-5709-4544-a04f-59fc2cb7febe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:27.274824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee9751b5-5709-4544-a04f-59fc2cb7febe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:27.275264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee9751b5-5709-4544-a04f-59fc2cb7febe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:27.275947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee9751b5-5709-4544-a04f-59fc2cb7febe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:27.276405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee9751b5-5709-4544-a04f-59fc2cb7febe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:27.276825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee9751b5-5709-4544-a04f-59fc2cb7febe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:27.307309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ee9751b5-5709-4544-a04f-59fc2cb7febe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045671 Sep 02 09:50:27.307878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 471/870] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:27 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:28.011761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-78735c9e-e386-41d9-aeb1-25c12275642a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:28.013902 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-78735c9e-e386-41d9-aeb1-25c12275642a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:28.020303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78735c9e-e386-41d9-aeb1-25c12275642a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:28.021023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78735c9e-e386-41d9-aeb1-25c12275642a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:28.021447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78735c9e-e386-41d9-aeb1-25c12275642a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:28.022116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78735c9e-e386-41d9-aeb1-25c12275642a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:28.022560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78735c9e-e386-41d9-aeb1-25c12275642a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:28.023019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78735c9e-e386-41d9-aeb1-25c12275642a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:28.052404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-78735c9e-e386-41d9-aeb1-25c12275642a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Sep 02 09:50:28.052952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 400/871] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:28.322176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b7a4c0f1-4053-4141-8228-082e42d441c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:28.324258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b7a4c0f1-4053-4141-8228-082e42d441c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:28.330577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7a4c0f1-4053-4141-8228-082e42d441c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:28.331088 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7a4c0f1-4053-4141-8228-082e42d441c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:28.331521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7a4c0f1-4053-4141-8228-082e42d441c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:28.332201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7a4c0f1-4053-4141-8228-082e42d441c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:28.332729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7a4c0f1-4053-4141-8228-082e42d441c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:28.333169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7a4c0f1-4053-4141-8228-082e42d441c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:28.366612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b7a4c0f1-4053-4141-8228-082e42d441c4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050875 Sep 02 09:50:28.367220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 472/872] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:28 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:29.064568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-569871ff-c6ce-4e57-a7f9-5710314e8681 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:29.066779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-569871ff-c6ce-4e57-a7f9-5710314e8681 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:29.073268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-569871ff-c6ce-4e57-a7f9-5710314e8681 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:29.073744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-569871ff-c6ce-4e57-a7f9-5710314e8681 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:29.074176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-569871ff-c6ce-4e57-a7f9-5710314e8681 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:29.074888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-569871ff-c6ce-4e57-a7f9-5710314e8681 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:29.075351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-569871ff-c6ce-4e57-a7f9-5710314e8681 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:29.075776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-569871ff-c6ce-4e57-a7f9-5710314e8681 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:29.104485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-569871ff-c6ce-4e57-a7f9-5710314e8681 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Sep 02 09:50:29.104968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 401/873] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:29.379230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-497f3339-3d0a-4d1e-96b9-3d430ce68c5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:29.381291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-497f3339-3d0a-4d1e-96b9-3d430ce68c5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:29.387747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-497f3339-3d0a-4d1e-96b9-3d430ce68c5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:29.388242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-497f3339-3d0a-4d1e-96b9-3d430ce68c5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:29.388669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-497f3339-3d0a-4d1e-96b9-3d430ce68c5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:29.389353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-497f3339-3d0a-4d1e-96b9-3d430ce68c5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:29.389810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-497f3339-3d0a-4d1e-96b9-3d430ce68c5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:29.390232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-497f3339-3d0a-4d1e-96b9-3d430ce68c5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:29.420538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-497f3339-3d0a-4d1e-96b9-3d430ce68c5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Sep 02 09:50:29.421096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 473/874] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:29 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:30.116864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-00d7bbe4-6122-4b48-ad7d-35198146981e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:30.119449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-00d7bbe4-6122-4b48-ad7d-35198146981e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:30.125844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00d7bbe4-6122-4b48-ad7d-35198146981e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:30.126329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00d7bbe4-6122-4b48-ad7d-35198146981e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:30.126790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00d7bbe4-6122-4b48-ad7d-35198146981e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:30.127480 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00d7bbe4-6122-4b48-ad7d-35198146981e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:30.127934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00d7bbe4-6122-4b48-ad7d-35198146981e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:30.128360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00d7bbe4-6122-4b48-ad7d-35198146981e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:30.157981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-00d7bbe4-6122-4b48-ad7d-35198146981e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Sep 02 09:50:30.158518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 402/875] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:30.433451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1d9430a7-181a-44df-9578-476c1cf34c00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:30.435541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1d9430a7-181a-44df-9578-476c1cf34c00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:30.441879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d9430a7-181a-44df-9578-476c1cf34c00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:30.442362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d9430a7-181a-44df-9578-476c1cf34c00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:30.442830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d9430a7-181a-44df-9578-476c1cf34c00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:30.443516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d9430a7-181a-44df-9578-476c1cf34c00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:30.443969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d9430a7-181a-44df-9578-476c1cf34c00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:30.444391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d9430a7-181a-44df-9578-476c1cf34c00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:30.473137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1d9430a7-181a-44df-9578-476c1cf34c00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044359 Sep 02 09:50:30.473694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 474/876] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:30 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:31.169880 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9bd2907b-105a-4e3a-8ac5-862989ef4ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:31.172160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9bd2907b-105a-4e3a-8ac5-862989ef4ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:31.178549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bd2907b-105a-4e3a-8ac5-862989ef4ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:31.179070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bd2907b-105a-4e3a-8ac5-862989ef4ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:31.179500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bd2907b-105a-4e3a-8ac5-862989ef4ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:31.180201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bd2907b-105a-4e3a-8ac5-862989ef4ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:31.180690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bd2907b-105a-4e3a-8ac5-862989ef4ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:31.181109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bd2907b-105a-4e3a-8ac5-862989ef4ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:31.209972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9bd2907b-105a-4e3a-8ac5-862989ef4ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Sep 02 09:50:31.210510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 403/877] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:31.485184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-98b4aa70-b04c-4c89-8ea3-fb7f6498d36e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:31.487285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-98b4aa70-b04c-4c89-8ea3-fb7f6498d36e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:31.494094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98b4aa70-b04c-4c89-8ea3-fb7f6498d36e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:31.494576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98b4aa70-b04c-4c89-8ea3-fb7f6498d36e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:31.495041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98b4aa70-b04c-4c89-8ea3-fb7f6498d36e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:31.495727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98b4aa70-b04c-4c89-8ea3-fb7f6498d36e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:31.496181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98b4aa70-b04c-4c89-8ea3-fb7f6498d36e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:31.496606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-98b4aa70-b04c-4c89-8ea3-fb7f6498d36e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:31.526078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-98b4aa70-b04c-4c89-8ea3-fb7f6498d36e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Sep 02 09:50:31.526806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 475/878] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:31 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:32.222970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-145072b3-43e6-42f4-bcf9-4f1a7656f282 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:32.225122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-145072b3-43e6-42f4-bcf9-4f1a7656f282 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:32.231990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-145072b3-43e6-42f4-bcf9-4f1a7656f282 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:32.232461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-145072b3-43e6-42f4-bcf9-4f1a7656f282 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:32.232918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-145072b3-43e6-42f4-bcf9-4f1a7656f282 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:32.233593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-145072b3-43e6-42f4-bcf9-4f1a7656f282 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:32.234036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-145072b3-43e6-42f4-bcf9-4f1a7656f282 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:32.234466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-145072b3-43e6-42f4-bcf9-4f1a7656f282 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:32.262551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-145072b3-43e6-42f4-bcf9-4f1a7656f282 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043651 Sep 02 09:50:32.263120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 404/879] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:32.538253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-439b7c66-5b9e-41f3-9ef2-048f37899eba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:32.540341 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-439b7c66-5b9e-41f3-9ef2-048f37899eba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:32.546642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-439b7c66-5b9e-41f3-9ef2-048f37899eba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:32.547159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-439b7c66-5b9e-41f3-9ef2-048f37899eba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:32.547604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-439b7c66-5b9e-41f3-9ef2-048f37899eba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:32.548290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-439b7c66-5b9e-41f3-9ef2-048f37899eba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:32.548742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-439b7c66-5b9e-41f3-9ef2-048f37899eba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:32.549165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-439b7c66-5b9e-41f3-9ef2-048f37899eba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:32.578129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-439b7c66-5b9e-41f3-9ef2-048f37899eba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Sep 02 09:50:32.578687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 476/880] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:32 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:33.275067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-595ccbf7-e9b9-4046-b3d8-ac4dfd8af210 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:33.277287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-595ccbf7-e9b9-4046-b3d8-ac4dfd8af210 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:33.283623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-595ccbf7-e9b9-4046-b3d8-ac4dfd8af210 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:33.284099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-595ccbf7-e9b9-4046-b3d8-ac4dfd8af210 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:33.284526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-595ccbf7-e9b9-4046-b3d8-ac4dfd8af210 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:33.285196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-595ccbf7-e9b9-4046-b3d8-ac4dfd8af210 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:33.285642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-595ccbf7-e9b9-4046-b3d8-ac4dfd8af210 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:33.286064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-595ccbf7-e9b9-4046-b3d8-ac4dfd8af210 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:33.315553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-595ccbf7-e9b9-4046-b3d8-ac4dfd8af210 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Sep 02 09:50:33.316089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 405/881] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:33.592192 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c003b294-13b6-46e4-ac2f-98f7b1da9e3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:33.594377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c003b294-13b6-46e4-ac2f-98f7b1da9e3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:33.600962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c003b294-13b6-46e4-ac2f-98f7b1da9e3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:33.601452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c003b294-13b6-46e4-ac2f-98f7b1da9e3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:33.601891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c003b294-13b6-46e4-ac2f-98f7b1da9e3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:33.602583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c003b294-13b6-46e4-ac2f-98f7b1da9e3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:33.603068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c003b294-13b6-46e4-ac2f-98f7b1da9e3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:33.603496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c003b294-13b6-46e4-ac2f-98f7b1da9e3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:33.633795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c003b294-13b6-46e4-ac2f-98f7b1da9e3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Sep 02 09:50:33.633909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 477/882] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:33 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:34.328064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-198f587e-e609-4233-a534-176e1bd0e016 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:34.330313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-198f587e-e609-4233-a534-176e1bd0e016 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:34.336714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198f587e-e609-4233-a534-176e1bd0e016 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:34.337189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198f587e-e609-4233-a534-176e1bd0e016 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:34.337619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198f587e-e609-4233-a534-176e1bd0e016 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:34.338297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198f587e-e609-4233-a534-176e1bd0e016 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:34.338774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198f587e-e609-4233-a534-176e1bd0e016 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:34.339194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198f587e-e609-4233-a534-176e1bd0e016 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:34.342727 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:34.370230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-198f587e-e609-4233-a534-176e1bd0e016 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045604 Sep 02 09:50:34.370885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 406/883] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:34.644848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d449fd8e-5751-46ac-8532-7059170d25b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:34.647397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d449fd8e-5751-46ac-8532-7059170d25b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:34.653837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d449fd8e-5751-46ac-8532-7059170d25b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:34.659972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d449fd8e-5751-46ac-8532-7059170d25b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:34.659972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d449fd8e-5751-46ac-8532-7059170d25b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:34.659972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d449fd8e-5751-46ac-8532-7059170d25b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:34.659972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d449fd8e-5751-46ac-8532-7059170d25b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:34.660360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d449fd8e-5751-46ac-8532-7059170d25b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:34.686276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d449fd8e-5751-46ac-8532-7059170d25b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Sep 02 09:50:34.686845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 478/884] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:34 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:35.382769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7b0f627e-c5bb-4001-af72-1069cf0184a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:35.385598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7b0f627e-c5bb-4001-af72-1069cf0184a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:35.392087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0f627e-c5bb-4001-af72-1069cf0184a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:35.392563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0f627e-c5bb-4001-af72-1069cf0184a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:35.392995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0f627e-c5bb-4001-af72-1069cf0184a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:35.393667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0f627e-c5bb-4001-af72-1069cf0184a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:35.394118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0f627e-c5bb-4001-af72-1069cf0184a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:35.394535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b0f627e-c5bb-4001-af72-1069cf0184a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:35.423819 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7b0f627e-c5bb-4001-af72-1069cf0184a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045344 Sep 02 09:50:35.424364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 407/885] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:35.698038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d3823d6c-44ba-42dc-ae06-f726b92f2d1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:35.700198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d3823d6c-44ba-42dc-ae06-f726b92f2d1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:35.706530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3823d6c-44ba-42dc-ae06-f726b92f2d1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:35.707050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3823d6c-44ba-42dc-ae06-f726b92f2d1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:35.707485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3823d6c-44ba-42dc-ae06-f726b92f2d1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:35.708167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3823d6c-44ba-42dc-ae06-f726b92f2d1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:35.708622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3823d6c-44ba-42dc-ae06-f726b92f2d1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:35.709045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3823d6c-44ba-42dc-ae06-f726b92f2d1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:35.737898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d3823d6c-44ba-42dc-ae06-f726b92f2d1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 Sep 02 09:50:35.738430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 479/886] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:35 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:36.436042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-96069db0-02db-4033-818f-993cbc410716 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:36.438268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-96069db0-02db-4033-818f-993cbc410716 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:36.444874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96069db0-02db-4033-818f-993cbc410716 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:36.445350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96069db0-02db-4033-818f-993cbc410716 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:36.445783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96069db0-02db-4033-818f-993cbc410716 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:36.446458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96069db0-02db-4033-818f-993cbc410716 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:36.446941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96069db0-02db-4033-818f-993cbc410716 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:36.447356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96069db0-02db-4033-818f-993cbc410716 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:36.476624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-96069db0-02db-4033-818f-993cbc410716 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044651 Sep 02 09:50:36.477161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 408/887] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:36.750452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6f36a4bd-27e4-428c-aad6-4fa0da571c43 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:36.752641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6f36a4bd-27e4-428c-aad6-4fa0da571c43 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:36.758950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f36a4bd-27e4-428c-aad6-4fa0da571c43 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:36.759439 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f36a4bd-27e4-428c-aad6-4fa0da571c43 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:36.759877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f36a4bd-27e4-428c-aad6-4fa0da571c43 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:36.761246 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f36a4bd-27e4-428c-aad6-4fa0da571c43 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:36.761665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f36a4bd-27e4-428c-aad6-4fa0da571c43 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:36.762095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f36a4bd-27e4-428c-aad6-4fa0da571c43 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:36.791082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6f36a4bd-27e4-428c-aad6-4fa0da571c43 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Sep 02 09:50:36.791631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 480/888] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:36 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:37.488419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3862bff7-1faa-4afa-86fe-43a81ec62e76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:37.490539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3862bff7-1faa-4afa-86fe-43a81ec62e76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:37.496915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3862bff7-1faa-4afa-86fe-43a81ec62e76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:37.497398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3862bff7-1faa-4afa-86fe-43a81ec62e76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:37.497835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3862bff7-1faa-4afa-86fe-43a81ec62e76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:37.498514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3862bff7-1faa-4afa-86fe-43a81ec62e76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:37.498992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3862bff7-1faa-4afa-86fe-43a81ec62e76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:37.499415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3862bff7-1faa-4afa-86fe-43a81ec62e76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:37.529015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3862bff7-1faa-4afa-86fe-43a81ec62e76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044547 Sep 02 09:50:37.529549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 409/889] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:37.803722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c6df07a9-fa8b-4094-902e-672d9798bd2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:37.805863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c6df07a9-fa8b-4094-902e-672d9798bd2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:37.811961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6df07a9-fa8b-4094-902e-672d9798bd2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:37.812447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6df07a9-fa8b-4094-902e-672d9798bd2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:37.812877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6df07a9-fa8b-4094-902e-672d9798bd2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:37.813562 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6df07a9-fa8b-4094-902e-672d9798bd2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:37.814014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6df07a9-fa8b-4094-902e-672d9798bd2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:37.814437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6df07a9-fa8b-4094-902e-672d9798bd2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:37.840078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:37.844724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c6df07a9-fa8b-4094-902e-672d9798bd2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045231 Sep 02 09:50:37.845281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 481/890] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:37 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:38.541339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d11ff746-1cea-4cd1-a9fa-8b3f65569832 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:38.544008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d11ff746-1cea-4cd1-a9fa-8b3f65569832 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:38.550501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d11ff746-1cea-4cd1-a9fa-8b3f65569832 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:38.551018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d11ff746-1cea-4cd1-a9fa-8b3f65569832 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:38.551484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d11ff746-1cea-4cd1-a9fa-8b3f65569832 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:38.552169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d11ff746-1cea-4cd1-a9fa-8b3f65569832 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:38.552617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d11ff746-1cea-4cd1-a9fa-8b3f65569832 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:38.553044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d11ff746-1cea-4cd1-a9fa-8b3f65569832 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:38.582260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d11ff746-1cea-4cd1-a9fa-8b3f65569832 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Sep 02 09:50:38.582823 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 410/891] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:38.857574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fbf6642b-5b2f-466e-8c54-896a80b04977 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:38.859732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fbf6642b-5b2f-466e-8c54-896a80b04977 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:38.866446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf6642b-5b2f-466e-8c54-896a80b04977 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:38.866950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf6642b-5b2f-466e-8c54-896a80b04977 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:38.867381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf6642b-5b2f-466e-8c54-896a80b04977 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:38.868063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf6642b-5b2f-466e-8c54-896a80b04977 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:38.868511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf6642b-5b2f-466e-8c54-896a80b04977 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:38.868933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf6642b-5b2f-466e-8c54-896a80b04977 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:38.898463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fbf6642b-5b2f-466e-8c54-896a80b04977 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Sep 02 09:50:38.899046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 482/892] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:38 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:39.594046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-86ff4a7b-e171-4555-85c1-acaa19d0e4dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:39.596208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-86ff4a7b-e171-4555-85c1-acaa19d0e4dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:39.602666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86ff4a7b-e171-4555-85c1-acaa19d0e4dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:39.603181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86ff4a7b-e171-4555-85c1-acaa19d0e4dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:39.603615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86ff4a7b-e171-4555-85c1-acaa19d0e4dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:39.604294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86ff4a7b-e171-4555-85c1-acaa19d0e4dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:39.604744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86ff4a7b-e171-4555-85c1-acaa19d0e4dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:39.605170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86ff4a7b-e171-4555-85c1-acaa19d0e4dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:39.633775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-86ff4a7b-e171-4555-85c1-acaa19d0e4dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043700 Sep 02 09:50:39.634321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 411/893] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:39.911077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a5b7ea75-26a8-4e40-a4a8-00ddb77414e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:39.913344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a5b7ea75-26a8-4e40-a4a8-00ddb77414e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:39.919721 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5b7ea75-26a8-4e40-a4a8-00ddb77414e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:39.920203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5b7ea75-26a8-4e40-a4a8-00ddb77414e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:39.920639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5b7ea75-26a8-4e40-a4a8-00ddb77414e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:39.921316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5b7ea75-26a8-4e40-a4a8-00ddb77414e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:39.921763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5b7ea75-26a8-4e40-a4a8-00ddb77414e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:39.922180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5b7ea75-26a8-4e40-a4a8-00ddb77414e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:39.951563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a5b7ea75-26a8-4e40-a4a8-00ddb77414e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Sep 02 09:50:39.952106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 483/894] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:39 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:40.646451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5916b674-bbae-4793-8378-5656e11a1d3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:40.648595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5916b674-bbae-4793-8378-5656e11a1d3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:40.654989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5916b674-bbae-4793-8378-5656e11a1d3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:40.655470 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5916b674-bbae-4793-8378-5656e11a1d3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:40.655903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5916b674-bbae-4793-8378-5656e11a1d3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:40.656584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5916b674-bbae-4793-8378-5656e11a1d3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:40.657034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5916b674-bbae-4793-8378-5656e11a1d3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:40.657457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5916b674-bbae-4793-8378-5656e11a1d3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:40.686248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5916b674-bbae-4793-8378-5656e11a1d3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Sep 02 09:50:40.686835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 412/895] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:40.964278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-586895a1-b5d3-4e47-b669-8c23841a4272 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:40.966482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-586895a1-b5d3-4e47-b669-8c23841a4272 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:40.972885 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-586895a1-b5d3-4e47-b669-8c23841a4272 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:40.973368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-586895a1-b5d3-4e47-b669-8c23841a4272 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:40.973807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-586895a1-b5d3-4e47-b669-8c23841a4272 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:40.974489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-586895a1-b5d3-4e47-b669-8c23841a4272 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:40.975010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-586895a1-b5d3-4e47-b669-8c23841a4272 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:40.975443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-586895a1-b5d3-4e47-b669-8c23841a4272 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:41.004880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-586895a1-b5d3-4e47-b669-8c23841a4272 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Sep 02 09:50:41.005423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 484/896] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:40 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:41.698826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1fb19c61-dbd0-4b72-8feb-fd60d78504ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:41.700963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1fb19c61-dbd0-4b72-8feb-fd60d78504ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:41.707370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fb19c61-dbd0-4b72-8feb-fd60d78504ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:41.707851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fb19c61-dbd0-4b72-8feb-fd60d78504ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:41.708284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fb19c61-dbd0-4b72-8feb-fd60d78504ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:41.708960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fb19c61-dbd0-4b72-8feb-fd60d78504ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:41.709410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fb19c61-dbd0-4b72-8feb-fd60d78504ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:41.709831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fb19c61-dbd0-4b72-8feb-fd60d78504ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:41.738594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1fb19c61-dbd0-4b72-8feb-fd60d78504ea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Sep 02 09:50:41.739156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 413/897] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:42.017744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-779eabb6-1787-4454-8bba-bd3403100c1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:42.019919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-779eabb6-1787-4454-8bba-bd3403100c1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:42.026575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-779eabb6-1787-4454-8bba-bd3403100c1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:42.027103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-779eabb6-1787-4454-8bba-bd3403100c1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:42.027536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-779eabb6-1787-4454-8bba-bd3403100c1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:42.028217 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-779eabb6-1787-4454-8bba-bd3403100c1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:42.028669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-779eabb6-1787-4454-8bba-bd3403100c1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:42.029092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-779eabb6-1787-4454-8bba-bd3403100c1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:42.058091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-779eabb6-1787-4454-8bba-bd3403100c1c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043831 Sep 02 09:50:42.058631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 485/898] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:42 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:42.750320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f4f3a734-768a-417a-8939-f4d173ff8a35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:42.752466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f4f3a734-768a-417a-8939-f4d173ff8a35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:42.758880 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4f3a734-768a-417a-8939-f4d173ff8a35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:42.759366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4f3a734-768a-417a-8939-f4d173ff8a35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:42.759799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4f3a734-768a-417a-8939-f4d173ff8a35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:42.760514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4f3a734-768a-417a-8939-f4d173ff8a35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:42.760963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4f3a734-768a-417a-8939-f4d173ff8a35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:42.761414 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4f3a734-768a-417a-8939-f4d173ff8a35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:42.790338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f4f3a734-768a-417a-8939-f4d173ff8a35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043970 Sep 02 09:50:42.790906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 414/899] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:43.070268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e4ccedbb-6eca-49d3-a325-a4f6efd4872c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:43.072381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e4ccedbb-6eca-49d3-a325-a4f6efd4872c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:43.079344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ccedbb-6eca-49d3-a325-a4f6efd4872c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:43.079829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ccedbb-6eca-49d3-a325-a4f6efd4872c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:43.080267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ccedbb-6eca-49d3-a325-a4f6efd4872c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:43.080954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ccedbb-6eca-49d3-a325-a4f6efd4872c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:43.081408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ccedbb-6eca-49d3-a325-a4f6efd4872c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:43.081834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ccedbb-6eca-49d3-a325-a4f6efd4872c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:43.110657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e4ccedbb-6eca-49d3-a325-a4f6efd4872c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044412 Sep 02 09:50:43.111224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 486/900] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:43 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:43.803094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5f301987-25dd-4ddf-98c1-174d76432e23 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:43.805274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5f301987-25dd-4ddf-98c1-174d76432e23 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:43.812230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f301987-25dd-4ddf-98c1-174d76432e23 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:43.812708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f301987-25dd-4ddf-98c1-174d76432e23 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:43.813147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f301987-25dd-4ddf-98c1-174d76432e23 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:43.813838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f301987-25dd-4ddf-98c1-174d76432e23 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:43.814272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f301987-25dd-4ddf-98c1-174d76432e23 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:43.814691 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f301987-25dd-4ddf-98c1-174d76432e23 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:43.843067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5f301987-25dd-4ddf-98c1-174d76432e23 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Sep 02 09:50:43.843563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 415/901] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:44.123303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3b4ba9c1-7272-4a08-ba87-3a254a3c219c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:44.125520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3b4ba9c1-7272-4a08-ba87-3a254a3c219c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:44.131962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b4ba9c1-7272-4a08-ba87-3a254a3c219c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:44.132445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b4ba9c1-7272-4a08-ba87-3a254a3c219c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:44.132879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b4ba9c1-7272-4a08-ba87-3a254a3c219c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:44.133556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b4ba9c1-7272-4a08-ba87-3a254a3c219c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:44.134001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b4ba9c1-7272-4a08-ba87-3a254a3c219c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:44.134419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3b4ba9c1-7272-4a08-ba87-3a254a3c219c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:44.163262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3b4ba9c1-7272-4a08-ba87-3a254a3c219c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 Sep 02 09:50:44.163793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 487/902] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:44 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:44.855339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bc5a7eab-0943-4f5f-8e54-21a651eeed9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:44.857502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bc5a7eab-0943-4f5f-8e54-21a651eeed9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:44.863937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc5a7eab-0943-4f5f-8e54-21a651eeed9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:44.864418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc5a7eab-0943-4f5f-8e54-21a651eeed9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:44.864852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc5a7eab-0943-4f5f-8e54-21a651eeed9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:44.865532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc5a7eab-0943-4f5f-8e54-21a651eeed9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:44.865981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc5a7eab-0943-4f5f-8e54-21a651eeed9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:44.866403 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bc5a7eab-0943-4f5f-8e54-21a651eeed9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:44.896510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bc5a7eab-0943-4f5f-8e54-21a651eeed9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Sep 02 09:50:44.897059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 416/903] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:45.175846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a841ea11-10fd-48bf-8079-ef8d63740eca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:45.177910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a841ea11-10fd-48bf-8079-ef8d63740eca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:45.184898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a841ea11-10fd-48bf-8079-ef8d63740eca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:45.185388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a841ea11-10fd-48bf-8079-ef8d63740eca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:45.185830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a841ea11-10fd-48bf-8079-ef8d63740eca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:45.186564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a841ea11-10fd-48bf-8079-ef8d63740eca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:45.187049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a841ea11-10fd-48bf-8079-ef8d63740eca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:45.187477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a841ea11-10fd-48bf-8079-ef8d63740eca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:45.216627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a841ea11-10fd-48bf-8079-ef8d63740eca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Sep 02 09:50:45.217174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 488/904] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:45 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:50:45.908679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c1eeec8a-111a-4b37-99c6-3c6605578778 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:45.910831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c1eeec8a-111a-4b37-99c6-3c6605578778 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:45.917170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1eeec8a-111a-4b37-99c6-3c6605578778 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:45.917649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1eeec8a-111a-4b37-99c6-3c6605578778 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:45.918079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1eeec8a-111a-4b37-99c6-3c6605578778 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:45.918817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1eeec8a-111a-4b37-99c6-3c6605578778 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:45.919268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1eeec8a-111a-4b37-99c6-3c6605578778 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:45.919686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1eeec8a-111a-4b37-99c6-3c6605578778 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:45.949083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c1eeec8a-111a-4b37-99c6-3c6605578778 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044290 Sep 02 09:50:45.949555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 417/905] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:46.229492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-66a12794-944f-40b8-9026-d8aee45c0496 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:46.231664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-66a12794-944f-40b8-9026-d8aee45c0496 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:46.237937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66a12794-944f-40b8-9026-d8aee45c0496 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:46.238412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66a12794-944f-40b8-9026-d8aee45c0496 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:46.238898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66a12794-944f-40b8-9026-d8aee45c0496 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:46.239576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66a12794-944f-40b8-9026-d8aee45c0496 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:46.240025 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66a12794-944f-40b8-9026-d8aee45c0496 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:46.240444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66a12794-944f-40b8-9026-d8aee45c0496 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:46.269510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-66a12794-944f-40b8-9026-d8aee45c0496 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044620 Sep 02 09:50:46.270045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 489/906] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:46 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:46.961522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6315b217-813a-4cfc-a29e-2e395247fe21 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:46.964315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6315b217-813a-4cfc-a29e-2e395247fe21 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:46.970655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6315b217-813a-4cfc-a29e-2e395247fe21 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:46.971159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6315b217-813a-4cfc-a29e-2e395247fe21 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:46.971590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6315b217-813a-4cfc-a29e-2e395247fe21 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:46.972263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6315b217-813a-4cfc-a29e-2e395247fe21 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:46.972709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6315b217-813a-4cfc-a29e-2e395247fe21 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:46.973126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6315b217-813a-4cfc-a29e-2e395247fe21 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:47.001328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6315b217-813a-4cfc-a29e-2e395247fe21 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 Sep 02 09:50:47.001868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 418/907] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:47.281777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-41cbcecc-a704-4178-b1c1-34610079732a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:47.283849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-41cbcecc-a704-4178-b1c1-34610079732a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:47.290117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41cbcecc-a704-4178-b1c1-34610079732a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:47.290596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41cbcecc-a704-4178-b1c1-34610079732a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:47.291058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41cbcecc-a704-4178-b1c1-34610079732a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:47.291759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41cbcecc-a704-4178-b1c1-34610079732a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:47.292208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41cbcecc-a704-4178-b1c1-34610079732a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:47.292626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41cbcecc-a704-4178-b1c1-34610079732a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:47.321990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-41cbcecc-a704-4178-b1c1-34610079732a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Sep 02 09:50:47.322530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 490/908] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:47 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:48.013619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-02f8d5d9-d46b-42c1-bce8-075c922c0b40 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:48.015807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-02f8d5d9-d46b-42c1-bce8-075c922c0b40 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:48.022465 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02f8d5d9-d46b-42c1-bce8-075c922c0b40 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:48.022981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02f8d5d9-d46b-42c1-bce8-075c922c0b40 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:48.023412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02f8d5d9-d46b-42c1-bce8-075c922c0b40 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:48.024089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02f8d5d9-d46b-42c1-bce8-075c922c0b40 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:48.024536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02f8d5d9-d46b-42c1-bce8-075c922c0b40 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:48.024947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02f8d5d9-d46b-42c1-bce8-075c922c0b40 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:48.054024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-02f8d5d9-d46b-42c1-bce8-075c922c0b40 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Sep 02 09:50:48.054563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 419/909] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:48.334781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-187ef325-4733-42e9-9d40-d962507b000a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:48.336856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-187ef325-4733-42e9-9d40-d962507b000a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:48.339828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=60 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:48.344484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-187ef325-4733-42e9-9d40-d962507b000a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:48.344975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-187ef325-4733-42e9-9d40-d962507b000a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:48.345413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-187ef325-4733-42e9-9d40-d962507b000a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:48.346105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-187ef325-4733-42e9-9d40-d962507b000a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:48.346561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-187ef325-4733-42e9-9d40-d962507b000a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:48.347020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-187ef325-4733-42e9-9d40-d962507b000a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:48.376207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-187ef325-4733-42e9-9d40-d962507b000a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045520 Sep 02 09:50:48.376755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 491/910] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:48 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:49.066382 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5bae107c-2059-422e-8bfb-57f67cc5b113 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:49.068536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5bae107c-2059-422e-8bfb-57f67cc5b113 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:49.070981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=60 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:49.075664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bae107c-2059-422e-8bfb-57f67cc5b113 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:49.076243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bae107c-2059-422e-8bfb-57f67cc5b113 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:49.076682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bae107c-2059-422e-8bfb-57f67cc5b113 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:49.077398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bae107c-2059-422e-8bfb-57f67cc5b113 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:49.077854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bae107c-2059-422e-8bfb-57f67cc5b113 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:49.078277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bae107c-2059-422e-8bfb-57f67cc5b113 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:49.109436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5bae107c-2059-422e-8bfb-57f67cc5b113 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047126 Sep 02 09:50:49.109906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 420/911] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:49.388919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-12ea9bd9-ea5d-4aba-a572-be375e9eac51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:49.391011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-12ea9bd9-ea5d-4aba-a572-be375e9eac51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:49.397742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12ea9bd9-ea5d-4aba-a572-be375e9eac51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:49.398209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12ea9bd9-ea5d-4aba-a572-be375e9eac51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:49.398647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12ea9bd9-ea5d-4aba-a572-be375e9eac51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:49.399383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12ea9bd9-ea5d-4aba-a572-be375e9eac51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:49.399837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12ea9bd9-ea5d-4aba-a572-be375e9eac51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:49.400264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12ea9bd9-ea5d-4aba-a572-be375e9eac51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:49.429877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-12ea9bd9-ea5d-4aba-a572-be375e9eac51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045365 Sep 02 09:50:49.430417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 492/912] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:49 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:50.122085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a1db2bad-f062-41e3-ada6-27f890fa9cab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:50.124216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a1db2bad-f062-41e3-ada6-27f890fa9cab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:50.130582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1db2bad-f062-41e3-ada6-27f890fa9cab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:50.131094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1db2bad-f062-41e3-ada6-27f890fa9cab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:50.131528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1db2bad-f062-41e3-ada6-27f890fa9cab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:50.132209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1db2bad-f062-41e3-ada6-27f890fa9cab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:50.132659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1db2bad-f062-41e3-ada6-27f890fa9cab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:50.133080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1db2bad-f062-41e3-ada6-27f890fa9cab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:50.161784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a1db2bad-f062-41e3-ada6-27f890fa9cab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044232 Sep 02 09:50:50.162327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 421/913] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:50.441792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-951ebb08-21d4-4943-8618-3e16fd3b60bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:50.443926 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-951ebb08-21d4-4943-8618-3e16fd3b60bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:50.450882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-951ebb08-21d4-4943-8618-3e16fd3b60bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:50.454947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-951ebb08-21d4-4943-8618-3e16fd3b60bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:50.454947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-951ebb08-21d4-4943-8618-3e16fd3b60bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:50.454947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-951ebb08-21d4-4943-8618-3e16fd3b60bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:50.454947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-951ebb08-21d4-4943-8618-3e16fd3b60bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:50.455367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-951ebb08-21d4-4943-8618-3e16fd3b60bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:50.483027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-951ebb08-21d4-4943-8618-3e16fd3b60bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 Sep 02 09:50:50.483613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 493/914] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:50 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:51.173922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7c15444b-52d4-4ea6-994e-896bb26121a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:51.176095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7c15444b-52d4-4ea6-994e-896bb26121a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:51.182416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c15444b-52d4-4ea6-994e-896bb26121a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:51.182925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c15444b-52d4-4ea6-994e-896bb26121a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:51.183356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c15444b-52d4-4ea6-994e-896bb26121a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:51.184034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c15444b-52d4-4ea6-994e-896bb26121a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:51.184478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c15444b-52d4-4ea6-994e-896bb26121a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:51.184894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c15444b-52d4-4ea6-994e-896bb26121a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:51.208786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:51.213877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7c15444b-52d4-4ea6-994e-896bb26121a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043444 Sep 02 09:50:51.214417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 422/915] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:51.495061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-82e7606e-ae39-4b59-86a1-38e94cb24ed9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:51.497195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-82e7606e-ae39-4b59-86a1-38e94cb24ed9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:51.503582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e7606e-ae39-4b59-86a1-38e94cb24ed9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:51.504075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e7606e-ae39-4b59-86a1-38e94cb24ed9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:51.504505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e7606e-ae39-4b59-86a1-38e94cb24ed9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:51.505185 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e7606e-ae39-4b59-86a1-38e94cb24ed9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:51.505634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e7606e-ae39-4b59-86a1-38e94cb24ed9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:51.506055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e7606e-ae39-4b59-86a1-38e94cb24ed9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:51.537675 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-82e7606e-ae39-4b59-86a1-38e94cb24ed9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046577 Sep 02 09:50:51.538229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 494/916] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:51 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:52.225774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0b0a412f-5f4e-4bdb-9125-7abc77ba4683 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:52.227944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0b0a412f-5f4e-4bdb-9125-7abc77ba4683 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:52.234801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b0a412f-5f4e-4bdb-9125-7abc77ba4683 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:52.235281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b0a412f-5f4e-4bdb-9125-7abc77ba4683 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:52.235713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b0a412f-5f4e-4bdb-9125-7abc77ba4683 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:52.236394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b0a412f-5f4e-4bdb-9125-7abc77ba4683 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:52.236845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b0a412f-5f4e-4bdb-9125-7abc77ba4683 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:52.237267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b0a412f-5f4e-4bdb-9125-7abc77ba4683 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:52.266242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0b0a412f-5f4e-4bdb-9125-7abc77ba4683 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Sep 02 09:50:52.266808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 423/917] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:52.549951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2e0e7e26-147a-4230-bfba-fbb86e788f55 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:52.552052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2e0e7e26-147a-4230-bfba-fbb86e788f55 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:52.558451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e0e7e26-147a-4230-bfba-fbb86e788f55 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:52.558968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e0e7e26-147a-4230-bfba-fbb86e788f55 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:52.559407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e0e7e26-147a-4230-bfba-fbb86e788f55 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:52.560089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e0e7e26-147a-4230-bfba-fbb86e788f55 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:52.560542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e0e7e26-147a-4230-bfba-fbb86e788f55 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:52.560970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e0e7e26-147a-4230-bfba-fbb86e788f55 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:52.589976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2e0e7e26-147a-4230-bfba-fbb86e788f55 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Sep 02 09:50:52.590518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 495/918] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:52 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:53.278980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d7c36c50-4e29-4c88-b915-ad6822661699 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:53.281171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d7c36c50-4e29-4c88-b915-ad6822661699 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:53.287638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c36c50-4e29-4c88-b915-ad6822661699 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:53.288129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c36c50-4e29-4c88-b915-ad6822661699 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:53.288571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c36c50-4e29-4c88-b915-ad6822661699 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:53.289265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c36c50-4e29-4c88-b915-ad6822661699 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:53.289723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c36c50-4e29-4c88-b915-ad6822661699 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:53.290151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c36c50-4e29-4c88-b915-ad6822661699 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:53.319856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d7c36c50-4e29-4c88-b915-ad6822661699 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 Sep 02 09:50:53.320421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 424/919] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:53.601180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-abc43250-b311-4fd2-bfe4-ad6745eab645 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:53.603376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-abc43250-b311-4fd2-bfe4-ad6745eab645 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:53.610168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-abc43250-b311-4fd2-bfe4-ad6745eab645 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:53.610649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-abc43250-b311-4fd2-bfe4-ad6745eab645 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:53.611112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-abc43250-b311-4fd2-bfe4-ad6745eab645 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:53.611797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-abc43250-b311-4fd2-bfe4-ad6745eab645 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:53.612244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-abc43250-b311-4fd2-bfe4-ad6745eab645 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:53.612665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-abc43250-b311-4fd2-bfe4-ad6745eab645 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:53.642357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-abc43250-b311-4fd2-bfe4-ad6745eab645 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Sep 02 09:50:53.642854 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 496/920] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:53 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:50:54.332764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d071b53e-d428-496e-80aa-68d0bce062f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:54.334874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d071b53e-d428-496e-80aa-68d0bce062f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:54.341410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d071b53e-d428-496e-80aa-68d0bce062f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:54.341891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d071b53e-d428-496e-80aa-68d0bce062f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:54.342319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d071b53e-d428-496e-80aa-68d0bce062f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:54.343043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d071b53e-d428-496e-80aa-68d0bce062f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:54.343491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d071b53e-d428-496e-80aa-68d0bce062f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:54.343907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d071b53e-d428-496e-80aa-68d0bce062f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:54.373243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d071b53e-d428-496e-80aa-68d0bce062f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Sep 02 09:50:54.373782 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 425/921] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:54.655256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9594965d-938f-446a-8994-c0762fc6facc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:54.657429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9594965d-938f-446a-8994-c0762fc6facc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:54.663919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9594965d-938f-446a-8994-c0762fc6facc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:54.664400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9594965d-938f-446a-8994-c0762fc6facc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:54.664840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9594965d-938f-446a-8994-c0762fc6facc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:54.665524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9594965d-938f-446a-8994-c0762fc6facc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:54.665977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9594965d-938f-446a-8994-c0762fc6facc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:54.667066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9594965d-938f-446a-8994-c0762fc6facc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:54.696374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9594965d-938f-446a-8994-c0762fc6facc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045628 Sep 02 09:50:54.696916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 497/922] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:54 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:55.385869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aeeaf832-f04a-4db0-8edf-bdc4d8e8f4b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:55.388026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aeeaf832-f04a-4db0-8edf-bdc4d8e8f4b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:55.394433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aeeaf832-f04a-4db0-8edf-bdc4d8e8f4b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:55.395225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aeeaf832-f04a-4db0-8edf-bdc4d8e8f4b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:55.395665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aeeaf832-f04a-4db0-8edf-bdc4d8e8f4b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:55.396350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aeeaf832-f04a-4db0-8edf-bdc4d8e8f4b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:55.396801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aeeaf832-f04a-4db0-8edf-bdc4d8e8f4b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:55.397226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aeeaf832-f04a-4db0-8edf-bdc4d8e8f4b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:55.425686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aeeaf832-f04a-4db0-8edf-bdc4d8e8f4b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044414 Sep 02 09:50:55.426228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 426/923] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:55.708600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9e26dd84-1315-4b94-8b96-72c165aa0984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:55.710661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9e26dd84-1315-4b94-8b96-72c165aa0984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:55.717004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e26dd84-1315-4b94-8b96-72c165aa0984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:55.717485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e26dd84-1315-4b94-8b96-72c165aa0984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:55.717914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e26dd84-1315-4b94-8b96-72c165aa0984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:55.718634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e26dd84-1315-4b94-8b96-72c165aa0984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:55.719110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e26dd84-1315-4b94-8b96-72c165aa0984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:55.719528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e26dd84-1315-4b94-8b96-72c165aa0984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:55.736035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:50:55.749092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9e26dd84-1315-4b94-8b96-72c165aa0984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044524 Sep 02 09:50:55.749600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 498/924] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:55 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:56.437795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ec5ceea1-eeb4-4186-9ceb-5f6ce595c09c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:56.439947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ec5ceea1-eeb4-4186-9ceb-5f6ce595c09c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:56.446266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec5ceea1-eeb4-4186-9ceb-5f6ce595c09c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:56.446770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec5ceea1-eeb4-4186-9ceb-5f6ce595c09c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:56.447205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec5ceea1-eeb4-4186-9ceb-5f6ce595c09c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:56.447887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec5ceea1-eeb4-4186-9ceb-5f6ce595c09c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:56.448336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec5ceea1-eeb4-4186-9ceb-5f6ce595c09c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:56.448757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec5ceea1-eeb4-4186-9ceb-5f6ce595c09c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:56.477473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ec5ceea1-eeb4-4186-9ceb-5f6ce595c09c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Sep 02 09:50:56.478020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 427/925] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:56.761753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1f2cb2b9-3072-414b-86d8-5709fdd68cda tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:56.763967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1f2cb2b9-3072-414b-86d8-5709fdd68cda tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:56.770985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1f2cb2b9-3072-414b-86d8-5709fdd68cda tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:56.771474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1f2cb2b9-3072-414b-86d8-5709fdd68cda tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:56.771915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1f2cb2b9-3072-414b-86d8-5709fdd68cda tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:56.772641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1f2cb2b9-3072-414b-86d8-5709fdd68cda tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:56.773099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1f2cb2b9-3072-414b-86d8-5709fdd68cda tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:56.773522 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1f2cb2b9-3072-414b-86d8-5709fdd68cda tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:56.803048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1f2cb2b9-3072-414b-86d8-5709fdd68cda tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Sep 02 09:50:56.803600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 499/926] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:56 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:57.490164 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e8dab7e1-96dc-4830-8c09-2dfe8c168f43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:57.492306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e8dab7e1-96dc-4830-8c09-2dfe8c168f43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:57.499295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dab7e1-96dc-4830-8c09-2dfe8c168f43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:57.499774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dab7e1-96dc-4830-8c09-2dfe8c168f43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:57.500209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dab7e1-96dc-4830-8c09-2dfe8c168f43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:57.500890 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dab7e1-96dc-4830-8c09-2dfe8c168f43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:57.501341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dab7e1-96dc-4830-8c09-2dfe8c168f43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:57.501761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8dab7e1-96dc-4830-8c09-2dfe8c168f43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:57.530247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e8dab7e1-96dc-4830-8c09-2dfe8c168f43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044032 Sep 02 09:50:57.530932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 428/927] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:57.815239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e61f5320-d3e2-4e6d-99fd-cff81f3a598f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:57.817653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e61f5320-d3e2-4e6d-99fd-cff81f3a598f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:57.823999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e61f5320-d3e2-4e6d-99fd-cff81f3a598f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:57.824477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e61f5320-d3e2-4e6d-99fd-cff81f3a598f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:57.824908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e61f5320-d3e2-4e6d-99fd-cff81f3a598f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:57.825585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e61f5320-d3e2-4e6d-99fd-cff81f3a598f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:57.826031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e61f5320-d3e2-4e6d-99fd-cff81f3a598f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:57.826448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e61f5320-d3e2-4e6d-99fd-cff81f3a598f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:57.858241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e61f5320-d3e2-4e6d-99fd-cff81f3a598f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Sep 02 09:50:57.858818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 500/928] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:57 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:58.541720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d66300a-33e5-4ddb-93f1-ef5a33a76176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:58.543817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6d66300a-33e5-4ddb-93f1-ef5a33a76176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:58.550352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d66300a-33e5-4ddb-93f1-ef5a33a76176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:58.550892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d66300a-33e5-4ddb-93f1-ef5a33a76176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:58.551329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d66300a-33e5-4ddb-93f1-ef5a33a76176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:58.552034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d66300a-33e5-4ddb-93f1-ef5a33a76176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:58.552481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d66300a-33e5-4ddb-93f1-ef5a33a76176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:58.552947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d66300a-33e5-4ddb-93f1-ef5a33a76176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:58.582500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6d66300a-33e5-4ddb-93f1-ef5a33a76176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044883 Sep 02 09:50:58.583085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 429/929] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:58.871227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-519259c4-bbc3-4c9c-a9c1-019b06bfb018 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:58.873374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-519259c4-bbc3-4c9c-a9c1-019b06bfb018 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:58.880501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-519259c4-bbc3-4c9c-a9c1-019b06bfb018 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:58.880989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-519259c4-bbc3-4c9c-a9c1-019b06bfb018 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:58.881420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-519259c4-bbc3-4c9c-a9c1-019b06bfb018 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:58.882106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-519259c4-bbc3-4c9c-a9c1-019b06bfb018 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:58.882557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-519259c4-bbc3-4c9c-a9c1-019b06bfb018 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:58.883017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-519259c4-bbc3-4c9c-a9c1-019b06bfb018 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:58.911858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-519259c4-bbc3-4c9c-a9c1-019b06bfb018 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Sep 02 09:50:58.912404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 501/930] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:58 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:59.594571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7c6fb0f6-7a4f-455e-9fdd-2f2184fe24c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:59.596721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7c6fb0f6-7a4f-455e-9fdd-2f2184fe24c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:59.603224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f6-7a4f-455e-9fdd-2f2184fe24c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:59.603706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f6-7a4f-455e-9fdd-2f2184fe24c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:59.604141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f6-7a4f-455e-9fdd-2f2184fe24c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:59.604822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f6-7a4f-455e-9fdd-2f2184fe24c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:59.605276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f6-7a4f-455e-9fdd-2f2184fe24c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:59.605699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c6fb0f6-7a4f-455e-9fdd-2f2184fe24c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:59.634044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7c6fb0f6-7a4f-455e-9fdd-2f2184fe24c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043495 Sep 02 09:50:59.634587 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 430/931] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:50:59.924564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-df765220-dd73-401d-aeef-d68c3937868a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:50:59.926720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-df765220-dd73-401d-aeef-d68c3937868a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:50:59.933582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df765220-dd73-401d-aeef-d68c3937868a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:59.934071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df765220-dd73-401d-aeef-d68c3937868a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:59.934505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df765220-dd73-401d-aeef-d68c3937868a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:59.935221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df765220-dd73-401d-aeef-d68c3937868a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:50:59.935676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df765220-dd73-401d-aeef-d68c3937868a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:50:59.936101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df765220-dd73-401d-aeef-d68c3937868a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:50:59.965846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-df765220-dd73-401d-aeef-d68c3937868a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Sep 02 09:50:59.966402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 502/932] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:50:59 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:00.646970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6300db59-2954-4349-90db-d72c81429d6b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:00.649111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6300db59-2954-4349-90db-d72c81429d6b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:00.656085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6300db59-2954-4349-90db-d72c81429d6b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:00.656617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6300db59-2954-4349-90db-d72c81429d6b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:00.657045 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6300db59-2954-4349-90db-d72c81429d6b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:00.657723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6300db59-2954-4349-90db-d72c81429d6b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:00.658169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6300db59-2954-4349-90db-d72c81429d6b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:00.659126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6300db59-2954-4349-90db-d72c81429d6b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:00.688211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6300db59-2954-4349-90db-d72c81429d6b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045548 Sep 02 09:51:00.688756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 431/933] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:00.977523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-93a4ece3-a9ad-46ef-8630-17ff7bc18192 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:00.980312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-93a4ece3-a9ad-46ef-8630-17ff7bc18192 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:00.986777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93a4ece3-a9ad-46ef-8630-17ff7bc18192 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:00.987264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93a4ece3-a9ad-46ef-8630-17ff7bc18192 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:00.987705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93a4ece3-a9ad-46ef-8630-17ff7bc18192 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:00.988398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93a4ece3-a9ad-46ef-8630-17ff7bc18192 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:00.988857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93a4ece3-a9ad-46ef-8630-17ff7bc18192 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:00.989286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93a4ece3-a9ad-46ef-8630-17ff7bc18192 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:01.018301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-93a4ece3-a9ad-46ef-8630-17ff7bc18192 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Sep 02 09:51:01.019060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 503/934] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:00 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:01.701163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6ef6f26e-e34c-4eb1-b9e4-0ac65af3e432 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:01.703316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6ef6f26e-e34c-4eb1-b9e4-0ac65af3e432 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:01.709433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ef6f26e-e34c-4eb1-b9e4-0ac65af3e432 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:01.709910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ef6f26e-e34c-4eb1-b9e4-0ac65af3e432 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:01.710341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ef6f26e-e34c-4eb1-b9e4-0ac65af3e432 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:01.711044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ef6f26e-e34c-4eb1-b9e4-0ac65af3e432 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:01.711494 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ef6f26e-e34c-4eb1-b9e4-0ac65af3e432 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:01.711913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ef6f26e-e34c-4eb1-b9e4-0ac65af3e432 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:01.741171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6ef6f26e-e34c-4eb1-b9e4-0ac65af3e432 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044831 Sep 02 09:51:01.741720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 432/935] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:02.031415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-52cc22c7-b612-4903-890c-4bc39ddef3f1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:02.033613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-52cc22c7-b612-4903-890c-4bc39ddef3f1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:02.039976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52cc22c7-b612-4903-890c-4bc39ddef3f1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:02.040462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52cc22c7-b612-4903-890c-4bc39ddef3f1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:02.040899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52cc22c7-b612-4903-890c-4bc39ddef3f1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:02.041592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52cc22c7-b612-4903-890c-4bc39ddef3f1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:02.042047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52cc22c7-b612-4903-890c-4bc39ddef3f1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:02.042471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52cc22c7-b612-4903-890c-4bc39ddef3f1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:02.071011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-52cc22c7-b612-4903-890c-4bc39ddef3f1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043594 Sep 02 09:51:02.071549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 504/936] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:02 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:02.753814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ab07aa89-c7c0-40da-8c0b-3813f750bffb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:02.756005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ab07aa89-c7c0-40da-8c0b-3813f750bffb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:02.762586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab07aa89-c7c0-40da-8c0b-3813f750bffb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:02.763096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab07aa89-c7c0-40da-8c0b-3813f750bffb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:02.763537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab07aa89-c7c0-40da-8c0b-3813f750bffb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:02.764217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab07aa89-c7c0-40da-8c0b-3813f750bffb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:02.764664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab07aa89-c7c0-40da-8c0b-3813f750bffb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:02.765083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ab07aa89-c7c0-40da-8c0b-3813f750bffb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:02.794215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ab07aa89-c7c0-40da-8c0b-3813f750bffb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044385 Sep 02 09:51:02.794771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 433/937] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:03.083911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c6c1f33b-8a3c-474f-9ebf-7fca2367f5e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:03.086007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c6c1f33b-8a3c-474f-9ebf-7fca2367f5e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:03.092869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1f33b-8a3c-474f-9ebf-7fca2367f5e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:03.093357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1f33b-8a3c-474f-9ebf-7fca2367f5e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:03.093799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1f33b-8a3c-474f-9ebf-7fca2367f5e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:03.094484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1f33b-8a3c-474f-9ebf-7fca2367f5e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:03.094974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1f33b-8a3c-474f-9ebf-7fca2367f5e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:03.095403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1f33b-8a3c-474f-9ebf-7fca2367f5e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:03.124436 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c6c1f33b-8a3c-474f-9ebf-7fca2367f5e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044572 Sep 02 09:51:03.124985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 505/938] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:03 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:51:03.807190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c5d6d088-8089-4927-b93f-359d9c36c15f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:03.809272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c5d6d088-8089-4927-b93f-359d9c36c15f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:03.817114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5d6d088-8089-4927-b93f-359d9c36c15f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:03.817598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5d6d088-8089-4927-b93f-359d9c36c15f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:03.818031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5d6d088-8089-4927-b93f-359d9c36c15f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:03.818722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5d6d088-8089-4927-b93f-359d9c36c15f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:03.819185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5d6d088-8089-4927-b93f-359d9c36c15f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:03.819607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5d6d088-8089-4927-b93f-359d9c36c15f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:03.852738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c5d6d088-8089-4927-b93f-359d9c36c15f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050021 Sep 02 09:51:03.853306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 434/939] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:04.136395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-961fe84d-5a21-49ba-bb4f-618af0271c8c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:04.138575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-961fe84d-5a21-49ba-bb4f-618af0271c8c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:04.145296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-961fe84d-5a21-49ba-bb4f-618af0271c8c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:04.145781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-961fe84d-5a21-49ba-bb4f-618af0271c8c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:04.146216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-961fe84d-5a21-49ba-bb4f-618af0271c8c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:04.146930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-961fe84d-5a21-49ba-bb4f-618af0271c8c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:04.147386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-961fe84d-5a21-49ba-bb4f-618af0271c8c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:04.147817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-961fe84d-5a21-49ba-bb4f-618af0271c8c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:04.176763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-961fe84d-5a21-49ba-bb4f-618af0271c8c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Sep 02 09:51:04.177315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 506/940] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:04 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:04.864970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-76dd54f6-248b-4009-9950-bac937555e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:04.867132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-76dd54f6-248b-4009-9950-bac937555e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:04.873581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76dd54f6-248b-4009-9950-bac937555e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:04.874065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76dd54f6-248b-4009-9950-bac937555e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:04.874492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76dd54f6-248b-4009-9950-bac937555e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:04.875209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76dd54f6-248b-4009-9950-bac937555e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:04.875659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76dd54f6-248b-4009-9950-bac937555e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:04.876077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76dd54f6-248b-4009-9950-bac937555e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:04.906072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-76dd54f6-248b-4009-9950-bac937555e14 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045106 Sep 02 09:51:04.906618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 435/941] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:05.188853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a4c6b833-e811-45bf-8731-1b5631edaff3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:05.191073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a4c6b833-e811-45bf-8731-1b5631edaff3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:05.198115 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4c6b833-e811-45bf-8731-1b5631edaff3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:05.198579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4c6b833-e811-45bf-8731-1b5631edaff3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:05.199051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4c6b833-e811-45bf-8731-1b5631edaff3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:05.199737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4c6b833-e811-45bf-8731-1b5631edaff3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:05.200189 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4c6b833-e811-45bf-8731-1b5631edaff3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:05.200616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4c6b833-e811-45bf-8731-1b5631edaff3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:05.234723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a4c6b833-e811-45bf-8731-1b5631edaff3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049794 Sep 02 09:51:05.235288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 507/942] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:05 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:05.918150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a719194b-7a3b-4e2d-a5cd-375195ecc1bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:05.920318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a719194b-7a3b-4e2d-a5cd-375195ecc1bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:05.926789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a719194b-7a3b-4e2d-a5cd-375195ecc1bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:05.927277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a719194b-7a3b-4e2d-a5cd-375195ecc1bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:05.927712 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a719194b-7a3b-4e2d-a5cd-375195ecc1bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:05.928393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a719194b-7a3b-4e2d-a5cd-375195ecc1bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:05.928845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a719194b-7a3b-4e2d-a5cd-375195ecc1bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:05.929268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a719194b-7a3b-4e2d-a5cd-375195ecc1bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:05.958243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a719194b-7a3b-4e2d-a5cd-375195ecc1bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Sep 02 09:51:05.958806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 436/943] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:06.246876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-208638b1-9a5b-4e40-ad4b-3c7b2b17e7eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:06.248997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-208638b1-9a5b-4e40-ad4b-3c7b2b17e7eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:06.255364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-208638b1-9a5b-4e40-ad4b-3c7b2b17e7eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:06.255847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-208638b1-9a5b-4e40-ad4b-3c7b2b17e7eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:06.256284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-208638b1-9a5b-4e40-ad4b-3c7b2b17e7eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:06.256968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-208638b1-9a5b-4e40-ad4b-3c7b2b17e7eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:06.257421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-208638b1-9a5b-4e40-ad4b-3c7b2b17e7eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:06.257845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-208638b1-9a5b-4e40-ad4b-3c7b2b17e7eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:06.287560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-208638b1-9a5b-4e40-ad4b-3c7b2b17e7eb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Sep 02 09:51:06.288100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 508/944] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:06 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:06.969481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3a5ecd1-fdb3-4dfb-ba0a-739fe68ed02c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:06.971635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3a5ecd1-fdb3-4dfb-ba0a-739fe68ed02c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:06.977948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a5ecd1-fdb3-4dfb-ba0a-739fe68ed02c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:06.978961 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a5ecd1-fdb3-4dfb-ba0a-739fe68ed02c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:06.979395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a5ecd1-fdb3-4dfb-ba0a-739fe68ed02c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:06.980100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a5ecd1-fdb3-4dfb-ba0a-739fe68ed02c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:06.980546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a5ecd1-fdb3-4dfb-ba0a-739fe68ed02c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:06.980969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a5ecd1-fdb3-4dfb-ba0a-739fe68ed02c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:07.010048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3a5ecd1-fdb3-4dfb-ba0a-739fe68ed02c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044510 Sep 02 09:51:07.010588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 437/945] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:07.299541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d7960f54-7dfd-40cd-82ff-954de23acbbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:07.301620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d7960f54-7dfd-40cd-82ff-954de23acbbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:07.308672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7960f54-7dfd-40cd-82ff-954de23acbbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:07.309158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7960f54-7dfd-40cd-82ff-954de23acbbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:07.309599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7960f54-7dfd-40cd-82ff-954de23acbbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:07.310318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7960f54-7dfd-40cd-82ff-954de23acbbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:07.310827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7960f54-7dfd-40cd-82ff-954de23acbbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:07.311259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7960f54-7dfd-40cd-82ff-954de23acbbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:07.339478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d7960f54-7dfd-40cd-82ff-954de23acbbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043956 Sep 02 09:51:07.340018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 509/946] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:07 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:08.021913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9f59a5cf-d419-45d1-a804-cd0ac0210581 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:08.024039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9f59a5cf-d419-45d1-a804-cd0ac0210581 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:08.031049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f59a5cf-d419-45d1-a804-cd0ac0210581 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:08.031536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f59a5cf-d419-45d1-a804-cd0ac0210581 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:08.031975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f59a5cf-d419-45d1-a804-cd0ac0210581 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:08.032662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f59a5cf-d419-45d1-a804-cd0ac0210581 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:08.033112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f59a5cf-d419-45d1-a804-cd0ac0210581 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:08.033534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f59a5cf-d419-45d1-a804-cd0ac0210581 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:08.062247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9f59a5cf-d419-45d1-a804-cd0ac0210581 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Sep 02 09:51:08.062873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 438/947] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:08.351633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0fb3afdb-69fc-4e6f-89e7-b0e2f9708c10 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:08.353786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0fb3afdb-69fc-4e6f-89e7-b0e2f9708c10 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:08.359861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fb3afdb-69fc-4e6f-89e7-b0e2f9708c10 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:08.360347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fb3afdb-69fc-4e6f-89e7-b0e2f9708c10 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:08.360786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fb3afdb-69fc-4e6f-89e7-b0e2f9708c10 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:08.361471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fb3afdb-69fc-4e6f-89e7-b0e2f9708c10 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:08.361925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fb3afdb-69fc-4e6f-89e7-b0e2f9708c10 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:08.362351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0fb3afdb-69fc-4e6f-89e7-b0e2f9708c10 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:08.392351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0fb3afdb-69fc-4e6f-89e7-b0e2f9708c10 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Sep 02 09:51:08.393146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 510/948] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:08 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:09.074242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d8e227d0-3274-4cc9-ac76-812a08b94bce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:09.076368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d8e227d0-3274-4cc9-ac76-812a08b94bce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:09.082945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8e227d0-3274-4cc9-ac76-812a08b94bce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:09.083432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8e227d0-3274-4cc9-ac76-812a08b94bce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:09.083870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8e227d0-3274-4cc9-ac76-812a08b94bce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:09.084553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8e227d0-3274-4cc9-ac76-812a08b94bce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:09.085004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8e227d0-3274-4cc9-ac76-812a08b94bce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:09.085427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8e227d0-3274-4cc9-ac76-812a08b94bce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:09.101961 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:51:09.115068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d8e227d0-3274-4cc9-ac76-812a08b94bce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044858 Sep 02 09:51:09.115611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 439/949] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:09.405342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7e584e7c-f6d6-42c6-9528-d933a69b9f24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:09.407519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7e584e7c-f6d6-42c6-9528-d933a69b9f24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:09.413879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e584e7c-f6d6-42c6-9528-d933a69b9f24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:09.414367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e584e7c-f6d6-42c6-9528-d933a69b9f24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:09.414838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e584e7c-f6d6-42c6-9528-d933a69b9f24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:09.415526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e584e7c-f6d6-42c6-9528-d933a69b9f24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:09.415978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e584e7c-f6d6-42c6-9528-d933a69b9f24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:09.416402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e584e7c-f6d6-42c6-9528-d933a69b9f24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:09.444817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7e584e7c-f6d6-42c6-9528-d933a69b9f24 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043515 Sep 02 09:51:09.445351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 511/950] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:09 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:10.127221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-32ec30db-0fb5-48ea-956b-e3dc0341c3b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:10.129365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-32ec30db-0fb5-48ea-956b-e3dc0341c3b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:10.136986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32ec30db-0fb5-48ea-956b-e3dc0341c3b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:10.137478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32ec30db-0fb5-48ea-956b-e3dc0341c3b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:10.137920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32ec30db-0fb5-48ea-956b-e3dc0341c3b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:10.138608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32ec30db-0fb5-48ea-956b-e3dc0341c3b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:10.139108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32ec30db-0fb5-48ea-956b-e3dc0341c3b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:10.139534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32ec30db-0fb5-48ea-956b-e3dc0341c3b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:10.169040 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-32ec30db-0fb5-48ea-956b-e3dc0341c3b0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045755 Sep 02 09:51:10.169588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 440/951] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:10.457578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3eeec11f-415d-4de5-9d44-538ecc66cf86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:10.459679 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3eeec11f-415d-4de5-9d44-538ecc66cf86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:10.466006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3eeec11f-415d-4de5-9d44-538ecc66cf86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:10.466483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3eeec11f-415d-4de5-9d44-538ecc66cf86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:10.466954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3eeec11f-415d-4de5-9d44-538ecc66cf86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:10.467633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3eeec11f-415d-4de5-9d44-538ecc66cf86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:10.468083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3eeec11f-415d-4de5-9d44-538ecc66cf86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:10.468503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3eeec11f-415d-4de5-9d44-538ecc66cf86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:10.497051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3eeec11f-415d-4de5-9d44-538ecc66cf86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Sep 02 09:51:10.497587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 512/952] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:10 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:11.181244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8cce94a9-783a-4589-9136-853740277046 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:11.183401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8cce94a9-783a-4589-9136-853740277046 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:11.189722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cce94a9-783a-4589-9136-853740277046 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:11.190320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cce94a9-783a-4589-9136-853740277046 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:11.190672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cce94a9-783a-4589-9136-853740277046 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:11.196706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cce94a9-783a-4589-9136-853740277046 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:11.196706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cce94a9-783a-4589-9136-853740277046 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:11.196706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cce94a9-783a-4589-9136-853740277046 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:11.221198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8cce94a9-783a-4589-9136-853740277046 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Sep 02 09:51:11.221746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 441/953] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:11.509017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1ccc724d-906d-4504-bd97-d99751b37541 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:11.511628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1ccc724d-906d-4504-bd97-d99751b37541 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:11.518014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ccc724d-906d-4504-bd97-d99751b37541 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:11.518502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ccc724d-906d-4504-bd97-d99751b37541 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:11.518980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ccc724d-906d-4504-bd97-d99751b37541 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:11.519924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ccc724d-906d-4504-bd97-d99751b37541 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:11.520380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ccc724d-906d-4504-bd97-d99751b37541 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:11.520807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ccc724d-906d-4504-bd97-d99751b37541 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:11.549973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1ccc724d-906d-4504-bd97-d99751b37541 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045100 Sep 02 09:51:11.550516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 513/954] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:11 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:12.234045 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-10fe8cf9-f7de-4adc-9efe-80433cfd0bd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:12.236181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-10fe8cf9-f7de-4adc-9efe-80433cfd0bd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:12.242501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10fe8cf9-f7de-4adc-9efe-80433cfd0bd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:12.243007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10fe8cf9-f7de-4adc-9efe-80433cfd0bd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:12.243440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10fe8cf9-f7de-4adc-9efe-80433cfd0bd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:12.244750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10fe8cf9-f7de-4adc-9efe-80433cfd0bd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:12.245198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10fe8cf9-f7de-4adc-9efe-80433cfd0bd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:12.245616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10fe8cf9-f7de-4adc-9efe-80433cfd0bd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:12.273733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-10fe8cf9-f7de-4adc-9efe-80433cfd0bd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Sep 02 09:51:12.274271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 442/955] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:12.562749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-61b29289-91ee-4ad4-b652-6976b001267e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:12.564829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-61b29289-91ee-4ad4-b652-6976b001267e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:12.570772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b29289-91ee-4ad4-b652-6976b001267e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:12.571262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b29289-91ee-4ad4-b652-6976b001267e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:12.571703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b29289-91ee-4ad4-b652-6976b001267e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:12.572886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b29289-91ee-4ad4-b652-6976b001267e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:12.573339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b29289-91ee-4ad4-b652-6976b001267e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:12.573765 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b29289-91ee-4ad4-b652-6976b001267e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:12.603553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-61b29289-91ee-4ad4-b652-6976b001267e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045442 Sep 02 09:51:12.604096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 514/956] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:12 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:51:13.285868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9df0dcd4-ad09-4ebc-9670-c4d442c5e0eb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:13.287967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9df0dcd4-ad09-4ebc-9670-c4d442c5e0eb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:13.294847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9df0dcd4-ad09-4ebc-9670-c4d442c5e0eb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:13.295328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9df0dcd4-ad09-4ebc-9670-c4d442c5e0eb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:13.295753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9df0dcd4-ad09-4ebc-9670-c4d442c5e0eb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:13.296420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9df0dcd4-ad09-4ebc-9670-c4d442c5e0eb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:13.296863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9df0dcd4-ad09-4ebc-9670-c4d442c5e0eb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:13.297276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9df0dcd4-ad09-4ebc-9670-c4d442c5e0eb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:13.325905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9df0dcd4-ad09-4ebc-9670-c4d442c5e0eb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044090 Sep 02 09:51:13.326438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 443/957] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:13.615606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-405e6440-4a20-4ee3-83d5-4e5e66e56a27 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:13.617725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-405e6440-4a20-4ee3-83d5-4e5e66e56a27 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:13.624733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-405e6440-4a20-4ee3-83d5-4e5e66e56a27 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:13.625215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-405e6440-4a20-4ee3-83d5-4e5e66e56a27 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:13.625646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-405e6440-4a20-4ee3-83d5-4e5e66e56a27 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:13.626326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-405e6440-4a20-4ee3-83d5-4e5e66e56a27 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:13.626838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-405e6440-4a20-4ee3-83d5-4e5e66e56a27 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:13.627263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-405e6440-4a20-4ee3-83d5-4e5e66e56a27 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:13.630790 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:51:13.656326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-405e6440-4a20-4ee3-83d5-4e5e66e56a27 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Sep 02 09:51:13.656861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 515/958] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:13 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:14.339595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-96386fd9-b793-43c3-a853-b8890fcd68e9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:14.341632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-96386fd9-b793-43c3-a853-b8890fcd68e9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:14.347935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96386fd9-b793-43c3-a853-b8890fcd68e9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:14.348408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96386fd9-b793-43c3-a853-b8890fcd68e9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:14.348837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96386fd9-b793-43c3-a853-b8890fcd68e9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:14.349504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96386fd9-b793-43c3-a853-b8890fcd68e9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:14.349948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96386fd9-b793-43c3-a853-b8890fcd68e9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:14.350362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-96386fd9-b793-43c3-a853-b8890fcd68e9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:14.380118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-96386fd9-b793-43c3-a853-b8890fcd68e9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Sep 02 09:51:14.380670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 444/959] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:14.669274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-623dd97b-5641-45be-908a-e412a879fb90 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:14.671490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-623dd97b-5641-45be-908a-e412a879fb90 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:14.678630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-623dd97b-5641-45be-908a-e412a879fb90 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:14.679145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-623dd97b-5641-45be-908a-e412a879fb90 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:14.679578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-623dd97b-5641-45be-908a-e412a879fb90 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:14.680256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-623dd97b-5641-45be-908a-e412a879fb90 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:14.680706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-623dd97b-5641-45be-908a-e412a879fb90 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:14.681127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-623dd97b-5641-45be-908a-e412a879fb90 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:14.710274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-623dd97b-5641-45be-908a-e412a879fb90 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045432 Sep 02 09:51:14.710848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 516/960] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:14 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:15.392650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7810e774-0a98-49fa-ba84-af33f9f71828 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:15.395050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7810e774-0a98-49fa-ba84-af33f9f71828 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:15.402070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7810e774-0a98-49fa-ba84-af33f9f71828 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:15.402550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7810e774-0a98-49fa-ba84-af33f9f71828 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:15.403030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7810e774-0a98-49fa-ba84-af33f9f71828 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:15.403713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7810e774-0a98-49fa-ba84-af33f9f71828 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:15.404166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7810e774-0a98-49fa-ba84-af33f9f71828 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:15.404586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7810e774-0a98-49fa-ba84-af33f9f71828 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:15.433189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7810e774-0a98-49fa-ba84-af33f9f71828 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Sep 02 09:51:15.433741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 445/961] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:15.722500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e29acaf0-2825-4bfa-9354-980d55adb68a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:51:15.724607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e29acaf0-2825-4bfa-9354-980d55adb68a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:15.731067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e29acaf0-2825-4bfa-9354-980d55adb68a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:15.731548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e29acaf0-2825-4bfa-9354-980d55adb68a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:15.731978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e29acaf0-2825-4bfa-9354-980d55adb68a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:15.732658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e29acaf0-2825-4bfa-9354-980d55adb68a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:15.733108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e29acaf0-2825-4bfa-9354-980d55adb68a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:15.733522 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e29acaf0-2825-4bfa-9354-980d55adb68a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:15.838250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e29acaf0-2825-4bfa-9354-980d55adb68a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "POST /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/action" status: 200 len: 76101 microversion: 2.1 time: 0.119478 Sep 02 09:51:15.838975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 517/962] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 09:51:15 2022] POST /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f/action => generated 76101 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 09:51:16.445257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-161c8da2-9be8-41cf-ab26-ac84ea633e3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:16.447451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-161c8da2-9be8-41cf-ab26-ac84ea633e3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:16.453839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-161c8da2-9be8-41cf-ab26-ac84ea633e3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:16.454328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-161c8da2-9be8-41cf-ab26-ac84ea633e3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:16.454797 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-161c8da2-9be8-41cf-ab26-ac84ea633e3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:16.455489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-161c8da2-9be8-41cf-ab26-ac84ea633e3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:16.455954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-161c8da2-9be8-41cf-ab26-ac84ea633e3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:16.456381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-161c8da2-9be8-41cf-ab26-ac84ea633e3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:16.485964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-161c8da2-9be8-41cf-ab26-ac84ea633e3b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Sep 02 09:51:16.486516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 446/963] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:17.499187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3d2e87dc-930a-42e5-bf70-505050d20c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:17.501521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3d2e87dc-930a-42e5-bf70-505050d20c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:17.508490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d2e87dc-930a-42e5-bf70-505050d20c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:17.508971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d2e87dc-930a-42e5-bf70-505050d20c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:17.509408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d2e87dc-930a-42e5-bf70-505050d20c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:17.510126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d2e87dc-930a-42e5-bf70-505050d20c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:17.510579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d2e87dc-930a-42e5-bf70-505050d20c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:17.511048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d2e87dc-930a-42e5-bf70-505050d20c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:17.540665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3d2e87dc-930a-42e5-bf70-505050d20c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046458 Sep 02 09:51:17.541698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 518/964] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:18.553418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-84545ebb-13de-4556-b76b-c458014d0139 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:18.555710 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-84545ebb-13de-4556-b76b-c458014d0139 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:18.562771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84545ebb-13de-4556-b76b-c458014d0139 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:18.563260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84545ebb-13de-4556-b76b-c458014d0139 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:18.563701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84545ebb-13de-4556-b76b-c458014d0139 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:18.564393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84545ebb-13de-4556-b76b-c458014d0139 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:18.564852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84545ebb-13de-4556-b76b-c458014d0139 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:18.565281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84545ebb-13de-4556-b76b-c458014d0139 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:18.593877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-84545ebb-13de-4556-b76b-c458014d0139 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Sep 02 09:51:18.594422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 447/965] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:19.605931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-44649ce3-629f-4dd4-a7a4-fc8a266e9c0d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:19.608113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-44649ce3-629f-4dd4-a7a4-fc8a266e9c0d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:19.610512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=56 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:51:19.615210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44649ce3-629f-4dd4-a7a4-fc8a266e9c0d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:19.624540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44649ce3-629f-4dd4-a7a4-fc8a266e9c0d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:19.624540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44649ce3-629f-4dd4-a7a4-fc8a266e9c0d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:19.624540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44649ce3-629f-4dd4-a7a4-fc8a266e9c0d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:19.624540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44649ce3-629f-4dd4-a7a4-fc8a266e9c0d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:19.624989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-44649ce3-629f-4dd4-a7a4-fc8a266e9c0d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:19.647740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-44649ce3-629f-4dd4-a7a4-fc8a266e9c0d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045776 Sep 02 09:51:19.648286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 519/966] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:20.660289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8655b0a2-443e-4807-936e-64fdb762c537 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:20.662444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8655b0a2-443e-4807-936e-64fdb762c537 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:20.664855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=56 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:51:20.669476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8655b0a2-443e-4807-936e-64fdb762c537 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:20.669957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8655b0a2-443e-4807-936e-64fdb762c537 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:20.670393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8655b0a2-443e-4807-936e-64fdb762c537 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:20.671114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8655b0a2-443e-4807-936e-64fdb762c537 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:20.671612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8655b0a2-443e-4807-936e-64fdb762c537 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:20.678560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8655b0a2-443e-4807-936e-64fdb762c537 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:20.701688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8655b0a2-443e-4807-936e-64fdb762c537 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045356 Sep 02 09:51:20.702229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 448/967] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:21.713531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-379ecaa1-190c-497d-a13c-7637b1b87e2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:21.716342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-379ecaa1-190c-497d-a13c-7637b1b87e2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:21.722670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-379ecaa1-190c-497d-a13c-7637b1b87e2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:21.723183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-379ecaa1-190c-497d-a13c-7637b1b87e2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:21.723618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-379ecaa1-190c-497d-a13c-7637b1b87e2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:21.724293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-379ecaa1-190c-497d-a13c-7637b1b87e2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:21.724752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-379ecaa1-190c-497d-a13c-7637b1b87e2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:21.725174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-379ecaa1-190c-497d-a13c-7637b1b87e2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:21.753669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-379ecaa1-190c-497d-a13c-7637b1b87e2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Sep 02 09:51:21.754151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 520/968] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:22.765748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8730a598-f457-49c3-bf0a-effb160ca16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:22.767876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8730a598-f457-49c3-bf0a-effb160ca16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:22.774527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8730a598-f457-49c3-bf0a-effb160ca16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:22.775039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8730a598-f457-49c3-bf0a-effb160ca16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:22.775476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8730a598-f457-49c3-bf0a-effb160ca16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:22.776159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8730a598-f457-49c3-bf0a-effb160ca16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:22.776610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8730a598-f457-49c3-bf0a-effb160ca16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:22.777513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8730a598-f457-49c3-bf0a-effb160ca16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:22.806380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8730a598-f457-49c3-bf0a-effb160ca16e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Sep 02 09:51:22.806952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 449/969] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:23.818778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ab139ee9-f8d8-4c64-af4a-9287a2252058 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:23.820914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ab139ee9-f8d8-4c64-af4a-9287a2252058 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:23.828165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab139ee9-f8d8-4c64-af4a-9287a2252058 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:23.828659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab139ee9-f8d8-4c64-af4a-9287a2252058 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:23.829134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab139ee9-f8d8-4c64-af4a-9287a2252058 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:23.829825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab139ee9-f8d8-4c64-af4a-9287a2252058 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:23.830283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab139ee9-f8d8-4c64-af4a-9287a2252058 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:23.830733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab139ee9-f8d8-4c64-af4a-9287a2252058 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:23.859883 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ab139ee9-f8d8-4c64-af4a-9287a2252058 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045080 Sep 02 09:51:23.860435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 521/970] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:24.872117 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-534a6afe-193c-43ab-9057-a56fcd1f2043 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:24.874279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-534a6afe-193c-43ab-9057-a56fcd1f2043 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:24.880891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534a6afe-193c-43ab-9057-a56fcd1f2043 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:24.881377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534a6afe-193c-43ab-9057-a56fcd1f2043 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:24.881815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534a6afe-193c-43ab-9057-a56fcd1f2043 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:24.882511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534a6afe-193c-43ab-9057-a56fcd1f2043 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:24.882986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534a6afe-193c-43ab-9057-a56fcd1f2043 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:24.883411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534a6afe-193c-43ab-9057-a56fcd1f2043 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:24.912908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-534a6afe-193c-43ab-9057-a56fcd1f2043 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044794 Sep 02 09:51:24.913453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 450/971] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:25.924960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-91f98332-340f-4528-bc73-75c87d4838a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:25.927082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-91f98332-340f-4528-bc73-75c87d4838a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:25.934470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91f98332-340f-4528-bc73-75c87d4838a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:25.934987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91f98332-340f-4528-bc73-75c87d4838a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:25.935427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91f98332-340f-4528-bc73-75c87d4838a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:25.936119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91f98332-340f-4528-bc73-75c87d4838a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:25.936604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91f98332-340f-4528-bc73-75c87d4838a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:25.937055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91f98332-340f-4528-bc73-75c87d4838a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:25.965827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-91f98332-340f-4528-bc73-75c87d4838a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Sep 02 09:51:25.966366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 522/972] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:25 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:26.977739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ee1bd030-0d15-4722-b975-73ff345290a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:26.979827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ee1bd030-0d15-4722-b975-73ff345290a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:26.986138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee1bd030-0d15-4722-b975-73ff345290a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:26.986615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee1bd030-0d15-4722-b975-73ff345290a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:26.987079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee1bd030-0d15-4722-b975-73ff345290a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:26.987754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee1bd030-0d15-4722-b975-73ff345290a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:26.988201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee1bd030-0d15-4722-b975-73ff345290a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:26.988621 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee1bd030-0d15-4722-b975-73ff345290a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:27.018295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ee1bd030-0d15-4722-b975-73ff345290a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Sep 02 09:51:27.019433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 451/973] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:26 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:28.031249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9c9daad8-f554-4f2b-9736-ee616661b214 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:28.033340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9c9daad8-f554-4f2b-9736-ee616661b214 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:28.039651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c9daad8-f554-4f2b-9736-ee616661b214 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:28.040131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c9daad8-f554-4f2b-9736-ee616661b214 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:28.040561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c9daad8-f554-4f2b-9736-ee616661b214 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:28.041236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c9daad8-f554-4f2b-9736-ee616661b214 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:28.041709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c9daad8-f554-4f2b-9736-ee616661b214 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:28.042129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c9daad8-f554-4f2b-9736-ee616661b214 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:28.071529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9c9daad8-f554-4f2b-9736-ee616661b214 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 Sep 02 09:51:28.072059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 523/974] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:29.084240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ff63c806-90d7-4861-98ad-e8c21f9fa955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:29.086309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ff63c806-90d7-4861-98ad-e8c21f9fa955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:29.092851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff63c806-90d7-4861-98ad-e8c21f9fa955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:29.093331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff63c806-90d7-4861-98ad-e8c21f9fa955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:29.093762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff63c806-90d7-4861-98ad-e8c21f9fa955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:29.094441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff63c806-90d7-4861-98ad-e8c21f9fa955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:29.094926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff63c806-90d7-4861-98ad-e8c21f9fa955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:29.095344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff63c806-90d7-4861-98ad-e8c21f9fa955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:29.124056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ff63c806-90d7-4861-98ad-e8c21f9fa955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Sep 02 09:51:29.124596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 452/975] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:30.136147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e45bd44c-f55a-40a0-919f-bffff3411c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:30.138893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e45bd44c-f55a-40a0-919f-bffff3411c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:30.145496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e45bd44c-f55a-40a0-919f-bffff3411c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:30.145981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e45bd44c-f55a-40a0-919f-bffff3411c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:30.146421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e45bd44c-f55a-40a0-919f-bffff3411c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:30.147144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e45bd44c-f55a-40a0-919f-bffff3411c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:30.147598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e45bd44c-f55a-40a0-919f-bffff3411c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:30.148021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e45bd44c-f55a-40a0-919f-bffff3411c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:30.176394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e45bd44c-f55a-40a0-919f-bffff3411c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044247 Sep 02 09:51:30.176928 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 524/976] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:31.189527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-da79b99a-1e18-47e9-864a-61b8c533ad5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:31.191589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-da79b99a-1e18-47e9-864a-61b8c533ad5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:31.197991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da79b99a-1e18-47e9-864a-61b8c533ad5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:31.198472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da79b99a-1e18-47e9-864a-61b8c533ad5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:31.198955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da79b99a-1e18-47e9-864a-61b8c533ad5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:31.199640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da79b99a-1e18-47e9-864a-61b8c533ad5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:31.200095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da79b99a-1e18-47e9-864a-61b8c533ad5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:31.200516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da79b99a-1e18-47e9-864a-61b8c533ad5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:31.228653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-da79b99a-1e18-47e9-864a-61b8c533ad5c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043221 Sep 02 09:51:31.229196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 453/977] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:32.240720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-64aa9f2f-95e8-441e-a8be-5bcb1e8d940a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:32.242817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-64aa9f2f-95e8-441e-a8be-5bcb1e8d940a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:32.249320 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64aa9f2f-95e8-441e-a8be-5bcb1e8d940a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:32.249809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64aa9f2f-95e8-441e-a8be-5bcb1e8d940a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:32.250255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64aa9f2f-95e8-441e-a8be-5bcb1e8d940a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:32.251037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64aa9f2f-95e8-441e-a8be-5bcb1e8d940a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:32.251495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64aa9f2f-95e8-441e-a8be-5bcb1e8d940a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:32.251922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64aa9f2f-95e8-441e-a8be-5bcb1e8d940a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:32.282289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-64aa9f2f-95e8-441e-a8be-5bcb1e8d940a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Sep 02 09:51:32.282868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 525/978] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:33.295036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2d63d188-7d35-405c-bf2d-fff911e79de9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:33.297106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2d63d188-7d35-405c-bf2d-fff911e79de9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:33.303411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d63d188-7d35-405c-bf2d-fff911e79de9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:33.303893 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d63d188-7d35-405c-bf2d-fff911e79de9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:33.304324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d63d188-7d35-405c-bf2d-fff911e79de9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:33.305005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d63d188-7d35-405c-bf2d-fff911e79de9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:33.305451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d63d188-7d35-405c-bf2d-fff911e79de9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:33.305892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d63d188-7d35-405c-bf2d-fff911e79de9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:33.334559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2d63d188-7d35-405c-bf2d-fff911e79de9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Sep 02 09:51:33.335130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 454/979] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:34.346612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-24315229-580d-4f64-977f-d8e0a1888a73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:34.348813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-24315229-580d-4f64-977f-d8e0a1888a73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:34.355213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24315229-580d-4f64-977f-d8e0a1888a73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:34.355696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24315229-580d-4f64-977f-d8e0a1888a73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:34.356131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24315229-580d-4f64-977f-d8e0a1888a73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:34.356812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24315229-580d-4f64-977f-d8e0a1888a73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:34.357264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24315229-580d-4f64-977f-d8e0a1888a73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:34.357689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24315229-580d-4f64-977f-d8e0a1888a73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:34.387134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-24315229-580d-4f64-977f-d8e0a1888a73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043783 Sep 02 09:51:34.387676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 526/980] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:35.399586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d4abf09c-f841-4c86-85ea-ac9116bed0ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:35.402261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d4abf09c-f841-4c86-85ea-ac9116bed0ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:35.408661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4abf09c-f841-4c86-85ea-ac9116bed0ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:35.409148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4abf09c-f841-4c86-85ea-ac9116bed0ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:35.409588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4abf09c-f841-4c86-85ea-ac9116bed0ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:35.410279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4abf09c-f841-4c86-85ea-ac9116bed0ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:35.410763 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4abf09c-f841-4c86-85ea-ac9116bed0ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:35.411193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4abf09c-f841-4c86-85ea-ac9116bed0ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:35.440361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d4abf09c-f841-4c86-85ea-ac9116bed0ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044748 Sep 02 09:51:35.440913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 455/981] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:36.452264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8febd2ed-2b4a-4993-8de1-faf9db15b522 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:36.454573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8febd2ed-2b4a-4993-8de1-faf9db15b522 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:36.461000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8febd2ed-2b4a-4993-8de1-faf9db15b522 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:36.461479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8febd2ed-2b4a-4993-8de1-faf9db15b522 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:36.461906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8febd2ed-2b4a-4993-8de1-faf9db15b522 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:36.462578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8febd2ed-2b4a-4993-8de1-faf9db15b522 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:36.463054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8febd2ed-2b4a-4993-8de1-faf9db15b522 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:36.463472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8febd2ed-2b4a-4993-8de1-faf9db15b522 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:36.493053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8febd2ed-2b4a-4993-8de1-faf9db15b522 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Sep 02 09:51:36.493918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 527/982] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:37.506530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-25f1ceac-9eeb-4030-9b18-7c79c7758665 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:37.508679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-25f1ceac-9eeb-4030-9b18-7c79c7758665 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:37.515640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25f1ceac-9eeb-4030-9b18-7c79c7758665 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:37.516118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25f1ceac-9eeb-4030-9b18-7c79c7758665 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:37.516551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25f1ceac-9eeb-4030-9b18-7c79c7758665 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:37.517223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25f1ceac-9eeb-4030-9b18-7c79c7758665 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:37.517669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25f1ceac-9eeb-4030-9b18-7c79c7758665 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:37.518085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25f1ceac-9eeb-4030-9b18-7c79c7758665 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:37.522073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:51:37.547344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-25f1ceac-9eeb-4030-9b18-7c79c7758665 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Sep 02 09:51:37.547890 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 456/983] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:38.559670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-02825454-4d80-4cc8-9334-93055106a663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:38.561746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-02825454-4d80-4cc8-9334-93055106a663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:38.568154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02825454-4d80-4cc8-9334-93055106a663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:38.568642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02825454-4d80-4cc8-9334-93055106a663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:38.569078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02825454-4d80-4cc8-9334-93055106a663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:38.569766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02825454-4d80-4cc8-9334-93055106a663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:38.570252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02825454-4d80-4cc8-9334-93055106a663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:38.570675 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-02825454-4d80-4cc8-9334-93055106a663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:38.600919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-02825454-4d80-4cc8-9334-93055106a663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045295 Sep 02 09:51:38.601470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 528/984] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:39.613128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5af5b2a6-85e4-42fa-b4c4-c934b0c89609 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:39.615314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5af5b2a6-85e4-42fa-b4c4-c934b0c89609 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:39.622099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5af5b2a6-85e4-42fa-b4c4-c934b0c89609 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:39.622772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5af5b2a6-85e4-42fa-b4c4-c934b0c89609 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:39.623566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5af5b2a6-85e4-42fa-b4c4-c934b0c89609 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:39.624761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5af5b2a6-85e4-42fa-b4c4-c934b0c89609 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:39.625244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5af5b2a6-85e4-42fa-b4c4-c934b0c89609 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:39.625675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5af5b2a6-85e4-42fa-b4c4-c934b0c89609 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:39.658188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5af5b2a6-85e4-42fa-b4c4-c934b0c89609 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049115 Sep 02 09:51:39.658758 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 457/985] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:40.671204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4be23d34-52f6-4850-88c0-6515c8a91ff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:40.673264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4be23d34-52f6-4850-88c0-6515c8a91ff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:40.679651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4be23d34-52f6-4850-88c0-6515c8a91ff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:40.680179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4be23d34-52f6-4850-88c0-6515c8a91ff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:40.680659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4be23d34-52f6-4850-88c0-6515c8a91ff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:40.681359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4be23d34-52f6-4850-88c0-6515c8a91ff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:40.681816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4be23d34-52f6-4850-88c0-6515c8a91ff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:40.682242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4be23d34-52f6-4850-88c0-6515c8a91ff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:40.712497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4be23d34-52f6-4850-88c0-6515c8a91ff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046114 Sep 02 09:51:40.713054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 529/986] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:41.725447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2fde44e6-fdc4-485d-994c-8780b8333cc7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:41.727633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2fde44e6-fdc4-485d-994c-8780b8333cc7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:41.734404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fde44e6-fdc4-485d-994c-8780b8333cc7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:41.734927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fde44e6-fdc4-485d-994c-8780b8333cc7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:41.735369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fde44e6-fdc4-485d-994c-8780b8333cc7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:41.736050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fde44e6-fdc4-485d-994c-8780b8333cc7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:41.736501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fde44e6-fdc4-485d-994c-8780b8333cc7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:41.736924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fde44e6-fdc4-485d-994c-8780b8333cc7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:41.765722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2fde44e6-fdc4-485d-994c-8780b8333cc7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Sep 02 09:51:41.766270 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 458/987] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:42.778729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ed013dad-20a4-4669-b87d-ff5b6c47b906 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:42.780825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ed013dad-20a4-4669-b87d-ff5b6c47b906 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:42.787166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed013dad-20a4-4669-b87d-ff5b6c47b906 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:42.787647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed013dad-20a4-4669-b87d-ff5b6c47b906 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:42.788077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed013dad-20a4-4669-b87d-ff5b6c47b906 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:42.788755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed013dad-20a4-4669-b87d-ff5b6c47b906 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:42.789199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed013dad-20a4-4669-b87d-ff5b6c47b906 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:42.789620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed013dad-20a4-4669-b87d-ff5b6c47b906 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:42.818432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ed013dad-20a4-4669-b87d-ff5b6c47b906 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044246 Sep 02 09:51:42.819000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 530/988] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:43.830603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-11472282-225a-4d52-8d47-d88e8cdac9ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:43.832724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-11472282-225a-4d52-8d47-d88e8cdac9ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:43.839322 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11472282-225a-4d52-8d47-d88e8cdac9ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:43.839807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11472282-225a-4d52-8d47-d88e8cdac9ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:43.840242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11472282-225a-4d52-8d47-d88e8cdac9ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:43.840930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11472282-225a-4d52-8d47-d88e8cdac9ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:43.841388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11472282-225a-4d52-8d47-d88e8cdac9ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:43.841809 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11472282-225a-4d52-8d47-d88e8cdac9ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:43.871806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-11472282-225a-4d52-8d47-d88e8cdac9ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Sep 02 09:51:43.872360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 459/989] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:44.884081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b4b53fe7-df10-4b83-af09-a4fdd015264e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:44.886159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b4b53fe7-df10-4b83-af09-a4fdd015264e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:44.893180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b4b53fe7-df10-4b83-af09-a4fdd015264e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:44.893916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b4b53fe7-df10-4b83-af09-a4fdd015264e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:44.894345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b4b53fe7-df10-4b83-af09-a4fdd015264e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:44.895061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b4b53fe7-df10-4b83-af09-a4fdd015264e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:44.895511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b4b53fe7-df10-4b83-af09-a4fdd015264e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:44.895932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b4b53fe7-df10-4b83-af09-a4fdd015264e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:44.898223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=93 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:51:44.925246 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b4b53fe7-df10-4b83-af09-a4fdd015264e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045268 Sep 02 09:51:44.925785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 531/990] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:45.936748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-31192bc6-647d-4ee9-9ec0-38bcab581d99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:45.938842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-31192bc6-647d-4ee9-9ec0-38bcab581d99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:45.945327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31192bc6-647d-4ee9-9ec0-38bcab581d99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:45.945813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31192bc6-647d-4ee9-9ec0-38bcab581d99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:45.946255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31192bc6-647d-4ee9-9ec0-38bcab581d99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:45.946985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31192bc6-647d-4ee9-9ec0-38bcab581d99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:45.947445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31192bc6-647d-4ee9-9ec0-38bcab581d99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:45.948141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-31192bc6-647d-4ee9-9ec0-38bcab581d99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:45.977839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-31192bc6-647d-4ee9-9ec0-38bcab581d99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Sep 02 09:51:45.978402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 460/991] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:46.989948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6ce8de81-2631-4696-a44b-0572148d8337 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:46.992062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6ce8de81-2631-4696-a44b-0572148d8337 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:46.999481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce8de81-2631-4696-a44b-0572148d8337 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:46.999956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce8de81-2631-4696-a44b-0572148d8337 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:47.000386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce8de81-2631-4696-a44b-0572148d8337 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:47.001071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce8de81-2631-4696-a44b-0572148d8337 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:47.001518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce8de81-2631-4696-a44b-0572148d8337 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:47.001938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce8de81-2631-4696-a44b-0572148d8337 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:47.030853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6ce8de81-2631-4696-a44b-0572148d8337 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045236 Sep 02 09:51:47.031404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 532/992] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:48.042643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5f1fc96d-f897-4a87-8e8d-62d732fd18c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:48.044726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5f1fc96d-f897-4a87-8e8d-62d732fd18c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:48.051132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f1fc96d-f897-4a87-8e8d-62d732fd18c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:48.051615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f1fc96d-f897-4a87-8e8d-62d732fd18c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:48.052050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f1fc96d-f897-4a87-8e8d-62d732fd18c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:48.052737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f1fc96d-f897-4a87-8e8d-62d732fd18c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:48.053188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f1fc96d-f897-4a87-8e8d-62d732fd18c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:48.053611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f1fc96d-f897-4a87-8e8d-62d732fd18c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:48.083083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5f1fc96d-f897-4a87-8e8d-62d732fd18c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044439 Sep 02 09:51:48.083635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 461/993] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:49.095214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4ef49b1d-8f73-47ff-80e7-7c9c24bee539 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:49.097342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4ef49b1d-8f73-47ff-80e7-7c9c24bee539 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:49.103685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ef49b1d-8f73-47ff-80e7-7c9c24bee539 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:49.104163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ef49b1d-8f73-47ff-80e7-7c9c24bee539 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:49.104598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ef49b1d-8f73-47ff-80e7-7c9c24bee539 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:49.105272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ef49b1d-8f73-47ff-80e7-7c9c24bee539 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:49.105717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ef49b1d-8f73-47ff-80e7-7c9c24bee539 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:49.106629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ef49b1d-8f73-47ff-80e7-7c9c24bee539 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:49.135857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4ef49b1d-8f73-47ff-80e7-7c9c24bee539 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044597 Sep 02 09:51:49.136404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 533/994] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:50.148394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c7c62106-c051-41c3-af65-e4cff3a9b2d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:50.150423 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c7c62106-c051-41c3-af65-e4cff3a9b2d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:50.156860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c62106-c051-41c3-af65-e4cff3a9b2d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:50.157345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c62106-c051-41c3-af65-e4cff3a9b2d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:50.157778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c62106-c051-41c3-af65-e4cff3a9b2d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:50.158451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c62106-c051-41c3-af65-e4cff3a9b2d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:50.158931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c62106-c051-41c3-af65-e4cff3a9b2d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:50.159348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7c62106-c051-41c3-af65-e4cff3a9b2d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:50.187805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c7c62106-c051-41c3-af65-e4cff3a9b2d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043400 Sep 02 09:51:50.188341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 462/995] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:51.200546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0a493d35-0b47-440e-8ddc-c34cdfbb33e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:51.202835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0a493d35-0b47-440e-8ddc-c34cdfbb33e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:51.205122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=30 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:51:51.209678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a493d35-0b47-440e-8ddc-c34cdfbb33e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:51.210224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a493d35-0b47-440e-8ddc-c34cdfbb33e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:51.210779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a493d35-0b47-440e-8ddc-c34cdfbb33e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:51.211470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a493d35-0b47-440e-8ddc-c34cdfbb33e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:51.211918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a493d35-0b47-440e-8ddc-c34cdfbb33e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:51.212342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a493d35-0b47-440e-8ddc-c34cdfbb33e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:51.243035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0a493d35-0b47-440e-8ddc-c34cdfbb33e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046995 Sep 02 09:51:51.243589 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 534/996] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:51:52.255248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-992a5b1b-8c7d-4c26-a020-c846352e85f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:52.257301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-992a5b1b-8c7d-4c26-a020-c846352e85f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:52.259661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=30 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:51:52.264778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-992a5b1b-8c7d-4c26-a020-c846352e85f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:52.265305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-992a5b1b-8c7d-4c26-a020-c846352e85f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:52.265738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-992a5b1b-8c7d-4c26-a020-c846352e85f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:52.266416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-992a5b1b-8c7d-4c26-a020-c846352e85f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:52.266898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-992a5b1b-8c7d-4c26-a020-c846352e85f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:52.267316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-992a5b1b-8c7d-4c26-a020-c846352e85f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:52.297719 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-992a5b1b-8c7d-4c26-a020-c846352e85f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046543 Sep 02 09:51:52.298275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 463/997] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:53.309767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-64bebcfa-b851-4f19-aab5-2150d54b78f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:53.311968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-64bebcfa-b851-4f19-aab5-2150d54b78f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:53.318370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64bebcfa-b851-4f19-aab5-2150d54b78f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:53.318839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64bebcfa-b851-4f19-aab5-2150d54b78f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:53.319306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64bebcfa-b851-4f19-aab5-2150d54b78f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:53.319991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64bebcfa-b851-4f19-aab5-2150d54b78f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:53.320446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64bebcfa-b851-4f19-aab5-2150d54b78f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:53.320884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64bebcfa-b851-4f19-aab5-2150d54b78f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:53.349506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-64bebcfa-b851-4f19-aab5-2150d54b78f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Sep 02 09:51:53.350053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 535/998] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:54.362152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5bec41ef-e478-4f78-a21b-28edd53ecc5a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:54.364293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5bec41ef-e478-4f78-a21b-28edd53ecc5a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:54.370635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bec41ef-e478-4f78-a21b-28edd53ecc5a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:54.371149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bec41ef-e478-4f78-a21b-28edd53ecc5a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:54.372171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bec41ef-e478-4f78-a21b-28edd53ecc5a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:54.372844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bec41ef-e478-4f78-a21b-28edd53ecc5a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:54.373288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bec41ef-e478-4f78-a21b-28edd53ecc5a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:54.373705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bec41ef-e478-4f78-a21b-28edd53ecc5a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:54.401998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5bec41ef-e478-4f78-a21b-28edd53ecc5a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043701 Sep 02 09:51:54.402483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 464/999] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:55.413943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-66ee253f-a1e6-4b94-b497-0f472b62b89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:55.416127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-66ee253f-a1e6-4b94-b497-0f472b62b89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:55.422464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66ee253f-a1e6-4b94-b497-0f472b62b89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:55.422993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66ee253f-a1e6-4b94-b497-0f472b62b89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:55.423432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66ee253f-a1e6-4b94-b497-0f472b62b89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:55.424123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66ee253f-a1e6-4b94-b497-0f472b62b89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:55.424577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66ee253f-a1e6-4b94-b497-0f472b62b89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:55.425002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66ee253f-a1e6-4b94-b497-0f472b62b89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:55.456176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-66ee253f-a1e6-4b94-b497-0f472b62b89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046169 Sep 02 09:51:55.456750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 536/1000] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:56.468327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d562cb3d-cb69-4b31-9197-f2e5d5c7420c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:56.470435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d562cb3d-cb69-4b31-9197-f2e5d5c7420c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:56.476814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d562cb3d-cb69-4b31-9197-f2e5d5c7420c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:56.477299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d562cb3d-cb69-4b31-9197-f2e5d5c7420c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:56.477735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d562cb3d-cb69-4b31-9197-f2e5d5c7420c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:56.478420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d562cb3d-cb69-4b31-9197-f2e5d5c7420c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:56.478908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d562cb3d-cb69-4b31-9197-f2e5d5c7420c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:56.479335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d562cb3d-cb69-4b31-9197-f2e5d5c7420c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:56.507385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d562cb3d-cb69-4b31-9197-f2e5d5c7420c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Sep 02 09:51:56.507923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 465/1001] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:57.519785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-92f8cb1c-5f77-4eb1-bcbb-dd7ff93e8331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:57.521841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-92f8cb1c-5f77-4eb1-bcbb-dd7ff93e8331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:57.528765 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92f8cb1c-5f77-4eb1-bcbb-dd7ff93e8331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:57.529271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92f8cb1c-5f77-4eb1-bcbb-dd7ff93e8331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:57.529714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92f8cb1c-5f77-4eb1-bcbb-dd7ff93e8331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:57.530405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92f8cb1c-5f77-4eb1-bcbb-dd7ff93e8331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:57.530889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92f8cb1c-5f77-4eb1-bcbb-dd7ff93e8331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:57.531315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92f8cb1c-5f77-4eb1-bcbb-dd7ff93e8331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:57.560622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-92f8cb1c-5f77-4eb1-bcbb-dd7ff93e8331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045116 Sep 02 09:51:57.561164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 537/1002] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:58.572834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f2431ee7-2de2-4ef6-9b46-909e17b67ca3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:58.574977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f2431ee7-2de2-4ef6-9b46-909e17b67ca3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:58.581958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2431ee7-2de2-4ef6-9b46-909e17b67ca3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:58.582442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2431ee7-2de2-4ef6-9b46-909e17b67ca3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:58.582915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2431ee7-2de2-4ef6-9b46-909e17b67ca3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:58.583599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2431ee7-2de2-4ef6-9b46-909e17b67ca3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:58.584053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2431ee7-2de2-4ef6-9b46-909e17b67ca3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:58.584474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f2431ee7-2de2-4ef6-9b46-909e17b67ca3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:58.613120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f2431ee7-2de2-4ef6-9b46-909e17b67ca3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Sep 02 09:51:58.613742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 466/1003] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:51:59.625367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-32b3c9eb-03d0-4787-a4a6-a6a68bed31fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:51:59.627585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-32b3c9eb-03d0-4787-a4a6-a6a68bed31fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:51:59.633935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b3c9eb-03d0-4787-a4a6-a6a68bed31fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:59.634424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b3c9eb-03d0-4787-a4a6-a6a68bed31fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:59.634897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b3c9eb-03d0-4787-a4a6-a6a68bed31fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:59.635590 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b3c9eb-03d0-4787-a4a6-a6a68bed31fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:51:59.636047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b3c9eb-03d0-4787-a4a6-a6a68bed31fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:51:59.636476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b3c9eb-03d0-4787-a4a6-a6a68bed31fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:51:59.666407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-32b3c9eb-03d0-4787-a4a6-a6a68bed31fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Sep 02 09:51:59.666922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 538/1004] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:51:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:00.677490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-644b2eac-1723-4707-99d6-27e433613d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:00.679673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-644b2eac-1723-4707-99d6-27e433613d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:00.686153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-644b2eac-1723-4707-99d6-27e433613d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:00.686634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-644b2eac-1723-4707-99d6-27e433613d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:00.687095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-644b2eac-1723-4707-99d6-27e433613d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:00.687773 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-644b2eac-1723-4707-99d6-27e433613d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:00.688223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-644b2eac-1723-4707-99d6-27e433613d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:00.688642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-644b2eac-1723-4707-99d6-27e433613d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:00.717288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-644b2eac-1723-4707-99d6-27e433613d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Sep 02 09:52:00.717764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 467/1005] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:01.729490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d6e824b6-0aeb-4979-98e4-01b4db13f28f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:01.731697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d6e824b6-0aeb-4979-98e4-01b4db13f28f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:01.737990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6e824b6-0aeb-4979-98e4-01b4db13f28f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:01.738474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6e824b6-0aeb-4979-98e4-01b4db13f28f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:01.738944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6e824b6-0aeb-4979-98e4-01b4db13f28f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:01.739630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6e824b6-0aeb-4979-98e4-01b4db13f28f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:01.740082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6e824b6-0aeb-4979-98e4-01b4db13f28f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:01.740506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d6e824b6-0aeb-4979-98e4-01b4db13f28f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:01.770137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d6e824b6-0aeb-4979-98e4-01b4db13f28f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Sep 02 09:52:01.770629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 539/1006] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:02.782111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0c456ec0-c075-4d0f-bc6b-819c13b851d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:02.784255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0c456ec0-c075-4d0f-bc6b-819c13b851d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:02.786250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:52:02.786398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:52:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments (ip 10.222.0.57) !!! Sep 02 09:52:02.787401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:52:02.787547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:52:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments (ip 10.222.0.57) !!! Sep 02 09:52:02.796705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c456ec0-c075-4d0f-bc6b-819c13b851d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:02.797185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c456ec0-c075-4d0f-bc6b-819c13b851d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:02.797620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c456ec0-c075-4d0f-bc6b-819c13b851d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:02.798307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c456ec0-c075-4d0f-bc6b-819c13b851d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:02.798791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c456ec0-c075-4d0f-bc6b-819c13b851d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:02.799218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c456ec0-c075-4d0f-bc6b-819c13b851d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:02.829451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0c456ec0-c075-4d0f-bc6b-819c13b851d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051804 Sep 02 09:52:02.829940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 468/1007] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:03.841470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2be19bf6-7612-4f32-9541-d7c7e1432e96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:03.843691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2be19bf6-7612-4f32-9541-d7c7e1432e96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:03.850169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2be19bf6-7612-4f32-9541-d7c7e1432e96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:03.850653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2be19bf6-7612-4f32-9541-d7c7e1432e96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:03.851125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2be19bf6-7612-4f32-9541-d7c7e1432e96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:03.851818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2be19bf6-7612-4f32-9541-d7c7e1432e96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:03.852268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2be19bf6-7612-4f32-9541-d7c7e1432e96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:03.852690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2be19bf6-7612-4f32-9541-d7c7e1432e96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:03.882268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2be19bf6-7612-4f32-9541-d7c7e1432e96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Sep 02 09:52:03.882773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 540/1008] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:04.895070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f34030f0-ead5-4dbb-a0a6-9daf2347064a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:04.897175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f34030f0-ead5-4dbb-a0a6-9daf2347064a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:04.903624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f34030f0-ead5-4dbb-a0a6-9daf2347064a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:04.904105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f34030f0-ead5-4dbb-a0a6-9daf2347064a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:04.904535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f34030f0-ead5-4dbb-a0a6-9daf2347064a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:04.905880 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f34030f0-ead5-4dbb-a0a6-9daf2347064a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:04.906326 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f34030f0-ead5-4dbb-a0a6-9daf2347064a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:04.906763 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f34030f0-ead5-4dbb-a0a6-9daf2347064a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:04.934957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f34030f0-ead5-4dbb-a0a6-9daf2347064a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044036 Sep 02 09:52:04.935483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 469/1009] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:05.947337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2eaf14b2-489a-4a55-a1f6-47f45c0e9061 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:05.949748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2eaf14b2-489a-4a55-a1f6-47f45c0e9061 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:05.957209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2eaf14b2-489a-4a55-a1f6-47f45c0e9061 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:05.957690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2eaf14b2-489a-4a55-a1f6-47f45c0e9061 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:05.958125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2eaf14b2-489a-4a55-a1f6-47f45c0e9061 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:05.958837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2eaf14b2-489a-4a55-a1f6-47f45c0e9061 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:05.959342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2eaf14b2-489a-4a55-a1f6-47f45c0e9061 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:05.959724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2eaf14b2-489a-4a55-a1f6-47f45c0e9061 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:05.988457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2eaf14b2-489a-4a55-a1f6-47f45c0e9061 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Sep 02 09:52:05.989011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 541/1010] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:07.001336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-852f25fe-aefe-4b79-8715-1be58b6708b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:07.003569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-852f25fe-aefe-4b79-8715-1be58b6708b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:07.010508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852f25fe-aefe-4b79-8715-1be58b6708b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:07.011060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852f25fe-aefe-4b79-8715-1be58b6708b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:07.011540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852f25fe-aefe-4b79-8715-1be58b6708b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:07.012238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852f25fe-aefe-4b79-8715-1be58b6708b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:07.012692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852f25fe-aefe-4b79-8715-1be58b6708b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:07.013115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852f25fe-aefe-4b79-8715-1be58b6708b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:07.047003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-852f25fe-aefe-4b79-8715-1be58b6708b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049634 Sep 02 09:52:07.047864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 470/1011] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:08.060022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bcaf2071-4c4a-491c-8ee0-f9194d47feb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:08.062161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bcaf2071-4c4a-491c-8ee0-f9194d47feb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:08.068394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcaf2071-4c4a-491c-8ee0-f9194d47feb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:08.068880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcaf2071-4c4a-491c-8ee0-f9194d47feb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:08.069317 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcaf2071-4c4a-491c-8ee0-f9194d47feb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:08.069999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcaf2071-4c4a-491c-8ee0-f9194d47feb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:08.070453 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcaf2071-4c4a-491c-8ee0-f9194d47feb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:08.070909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcaf2071-4c4a-491c-8ee0-f9194d47feb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:08.099661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bcaf2071-4c4a-491c-8ee0-f9194d47feb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043548 Sep 02 09:52:08.100136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 542/1012] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:09.111997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-777cc016-ce05-4ec9-a6ef-8c19c65355ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:09.114114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-777cc016-ce05-4ec9-a6ef-8c19c65355ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:09.120660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-777cc016-ce05-4ec9-a6ef-8c19c65355ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:09.121138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-777cc016-ce05-4ec9-a6ef-8c19c65355ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:09.121564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-777cc016-ce05-4ec9-a6ef-8c19c65355ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:09.122241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-777cc016-ce05-4ec9-a6ef-8c19c65355ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:09.122687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-777cc016-ce05-4ec9-a6ef-8c19c65355ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:09.123135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-777cc016-ce05-4ec9-a6ef-8c19c65355ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:09.152282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-777cc016-ce05-4ec9-a6ef-8c19c65355ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Sep 02 09:52:09.152815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 471/1013] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:10.164354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1d08844a-2809-4ebb-aa97-02a4362806b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:10.166512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1d08844a-2809-4ebb-aa97-02a4362806b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:10.172922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d08844a-2809-4ebb-aa97-02a4362806b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:10.173400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d08844a-2809-4ebb-aa97-02a4362806b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:10.173829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d08844a-2809-4ebb-aa97-02a4362806b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:10.174507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d08844a-2809-4ebb-aa97-02a4362806b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:10.174993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d08844a-2809-4ebb-aa97-02a4362806b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:10.175415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d08844a-2809-4ebb-aa97-02a4362806b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:10.204659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1d08844a-2809-4ebb-aa97-02a4362806b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Sep 02 09:52:10.205123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 543/1014] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:11.217273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-53c44c7b-03e2-45ad-9a89-d8babfa9e311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:11.219942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-53c44c7b-03e2-45ad-9a89-d8babfa9e311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:11.226241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53c44c7b-03e2-45ad-9a89-d8babfa9e311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:11.226755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53c44c7b-03e2-45ad-9a89-d8babfa9e311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:11.227244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53c44c7b-03e2-45ad-9a89-d8babfa9e311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:11.227936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53c44c7b-03e2-45ad-9a89-d8babfa9e311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:11.228368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53c44c7b-03e2-45ad-9a89-d8babfa9e311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:11.228784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53c44c7b-03e2-45ad-9a89-d8babfa9e311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:11.232340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=95 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:52:11.257974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-53c44c7b-03e2-45ad-9a89-d8babfa9e311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Sep 02 09:52:11.258531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 472/1015] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:12.270421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7a9ee458-768d-470c-8ae6-a3c228d6dc3e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:12.272533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7a9ee458-768d-470c-8ae6-a3c228d6dc3e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:12.278861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a9ee458-768d-470c-8ae6-a3c228d6dc3e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:12.279347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a9ee458-768d-470c-8ae6-a3c228d6dc3e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:12.279781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a9ee458-768d-470c-8ae6-a3c228d6dc3e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:12.280467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a9ee458-768d-470c-8ae6-a3c228d6dc3e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:12.280921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a9ee458-768d-470c-8ae6-a3c228d6dc3e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:12.281347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a9ee458-768d-470c-8ae6-a3c228d6dc3e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:12.310167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7a9ee458-768d-470c-8ae6-a3c228d6dc3e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 Sep 02 09:52:12.310737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 544/1016] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:13.322298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-27b9edcb-f122-448b-b858-0ac2478500fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:13.324687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-27b9edcb-f122-448b-b858-0ac2478500fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:13.331735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27b9edcb-f122-448b-b858-0ac2478500fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:13.332214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27b9edcb-f122-448b-b858-0ac2478500fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:13.332643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27b9edcb-f122-448b-b858-0ac2478500fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:13.333342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27b9edcb-f122-448b-b858-0ac2478500fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:13.333789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27b9edcb-f122-448b-b858-0ac2478500fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:13.334208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27b9edcb-f122-448b-b858-0ac2478500fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:13.362235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-27b9edcb-f122-448b-b858-0ac2478500fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044149 Sep 02 09:52:13.362725 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 473/1017] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:14.373428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fee83f30-2d96-4c4a-805d-2aa96b30c277 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:14.375642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fee83f30-2d96-4c4a-805d-2aa96b30c277 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:14.382025 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fee83f30-2d96-4c4a-805d-2aa96b30c277 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:14.382555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fee83f30-2d96-4c4a-805d-2aa96b30c277 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:14.383031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fee83f30-2d96-4c4a-805d-2aa96b30c277 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:14.383725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fee83f30-2d96-4c4a-805d-2aa96b30c277 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:14.384179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fee83f30-2d96-4c4a-805d-2aa96b30c277 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:14.384607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fee83f30-2d96-4c4a-805d-2aa96b30c277 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:14.414324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fee83f30-2d96-4c4a-805d-2aa96b30c277 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Sep 02 09:52:14.414898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 545/1018] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:15.426255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7248afca-e7d4-4261-b1f6-b6040d10b5c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:15.428369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7248afca-e7d4-4261-b1f6-b6040d10b5c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:15.435413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7248afca-e7d4-4261-b1f6-b6040d10b5c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:15.435891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7248afca-e7d4-4261-b1f6-b6040d10b5c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:15.436319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7248afca-e7d4-4261-b1f6-b6040d10b5c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:15.436998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7248afca-e7d4-4261-b1f6-b6040d10b5c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:15.437445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7248afca-e7d4-4261-b1f6-b6040d10b5c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:15.437863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7248afca-e7d4-4261-b1f6-b6040d10b5c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:15.466391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7248afca-e7d4-4261-b1f6-b6040d10b5c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Sep 02 09:52:15.466963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 474/1019] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:16.478604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-28cb1ae5-9672-448f-bdce-30a73fb60008 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:16.480696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-28cb1ae5-9672-448f-bdce-30a73fb60008 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:16.487799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28cb1ae5-9672-448f-bdce-30a73fb60008 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:16.488284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28cb1ae5-9672-448f-bdce-30a73fb60008 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:16.488724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28cb1ae5-9672-448f-bdce-30a73fb60008 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:16.489409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28cb1ae5-9672-448f-bdce-30a73fb60008 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:16.489862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28cb1ae5-9672-448f-bdce-30a73fb60008 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:16.490286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28cb1ae5-9672-448f-bdce-30a73fb60008 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:16.519299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-28cb1ae5-9672-448f-bdce-30a73fb60008 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Sep 02 09:52:16.519846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 546/1020] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:17.530999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-750b1a8f-8553-4252-b2ea-baaf98d652ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:17.533192 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-750b1a8f-8553-4252-b2ea-baaf98d652ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:17.539565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750b1a8f-8553-4252-b2ea-baaf98d652ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:17.540054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750b1a8f-8553-4252-b2ea-baaf98d652ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:17.540489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750b1a8f-8553-4252-b2ea-baaf98d652ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:17.541172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750b1a8f-8553-4252-b2ea-baaf98d652ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:17.541624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750b1a8f-8553-4252-b2ea-baaf98d652ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:17.542051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750b1a8f-8553-4252-b2ea-baaf98d652ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:17.571524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-750b1a8f-8553-4252-b2ea-baaf98d652ba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044533 Sep 02 09:52:17.572077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 475/1021] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:18.584222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-387de55e-043f-43f6-831a-3ab1b26b655c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:18.586398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-387de55e-043f-43f6-831a-3ab1b26b655c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:18.592927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387de55e-043f-43f6-831a-3ab1b26b655c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:18.593410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387de55e-043f-43f6-831a-3ab1b26b655c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:18.593848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387de55e-043f-43f6-831a-3ab1b26b655c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:18.594532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387de55e-043f-43f6-831a-3ab1b26b655c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:18.595025 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387de55e-043f-43f6-831a-3ab1b26b655c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:18.595482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387de55e-043f-43f6-831a-3ab1b26b655c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:18.599108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=96 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:52:18.625904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-387de55e-043f-43f6-831a-3ab1b26b655c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046330 Sep 02 09:52:18.626463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 547/1022] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:19.638424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-241f7af4-c4be-415d-af00-4338e5a3770a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:19.640615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-241f7af4-c4be-415d-af00-4338e5a3770a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:19.647997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-241f7af4-c4be-415d-af00-4338e5a3770a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:19.648484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-241f7af4-c4be-415d-af00-4338e5a3770a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:19.648920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-241f7af4-c4be-415d-af00-4338e5a3770a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:19.649653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-241f7af4-c4be-415d-af00-4338e5a3770a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:19.650106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-241f7af4-c4be-415d-af00-4338e5a3770a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:19.650554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-241f7af4-c4be-415d-af00-4338e5a3770a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:19.680097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-241f7af4-c4be-415d-af00-4338e5a3770a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045552 Sep 02 09:52:19.680650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 476/1023] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:20.692402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6f6ce021-b31e-4fa7-8880-fd45a151cad6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:20.694571 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6f6ce021-b31e-4fa7-8880-fd45a151cad6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:20.701463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6ce021-b31e-4fa7-8880-fd45a151cad6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:20.701947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6ce021-b31e-4fa7-8880-fd45a151cad6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:20.702384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6ce021-b31e-4fa7-8880-fd45a151cad6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:20.703106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6ce021-b31e-4fa7-8880-fd45a151cad6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:20.703562 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6ce021-b31e-4fa7-8880-fd45a151cad6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:20.703986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6ce021-b31e-4fa7-8880-fd45a151cad6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:20.732715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6f6ce021-b31e-4fa7-8880-fd45a151cad6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Sep 02 09:52:20.733261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 548/1024] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:21.745605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-49869b90-b16e-4983-b911-6d6afdfaa5fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:21.747744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-49869b90-b16e-4983-b911-6d6afdfaa5fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:21.754607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49869b90-b16e-4983-b911-6d6afdfaa5fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:21.755108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49869b90-b16e-4983-b911-6d6afdfaa5fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:21.755535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49869b90-b16e-4983-b911-6d6afdfaa5fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:21.756208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49869b90-b16e-4983-b911-6d6afdfaa5fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:21.756653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49869b90-b16e-4983-b911-6d6afdfaa5fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:21.757070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49869b90-b16e-4983-b911-6d6afdfaa5fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:21.785605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-49869b90-b16e-4983-b911-6d6afdfaa5fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043935 Sep 02 09:52:21.786141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 477/1025] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:22.797466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b37037a2-1dfb-4fb5-ad74-9ce02ab8c67b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:22.799626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b37037a2-1dfb-4fb5-ad74-9ce02ab8c67b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:22.801956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=30 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:52:22.806556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b37037a2-1dfb-4fb5-ad74-9ce02ab8c67b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:22.807064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b37037a2-1dfb-4fb5-ad74-9ce02ab8c67b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:22.807499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b37037a2-1dfb-4fb5-ad74-9ce02ab8c67b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:22.808184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b37037a2-1dfb-4fb5-ad74-9ce02ab8c67b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:22.808711 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b37037a2-1dfb-4fb5-ad74-9ce02ab8c67b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:22.809138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b37037a2-1dfb-4fb5-ad74-9ce02ab8c67b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:22.839827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b37037a2-1dfb-4fb5-ad74-9ce02ab8c67b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046335 Sep 02 09:52:22.840374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 549/1026] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:23.852569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-40d77e6b-9164-4a02-a86a-427df04480aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:23.854681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-40d77e6b-9164-4a02-a86a-427df04480aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:23.857089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=30 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:52:23.861679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d77e6b-9164-4a02-a86a-427df04480aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:23.862752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d77e6b-9164-4a02-a86a-427df04480aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:23.863217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d77e6b-9164-4a02-a86a-427df04480aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:23.863896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d77e6b-9164-4a02-a86a-427df04480aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:23.864343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d77e6b-9164-4a02-a86a-427df04480aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:23.864812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40d77e6b-9164-4a02-a86a-427df04480aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:23.896333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-40d77e6b-9164-4a02-a86a-427df04480aa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047703 Sep 02 09:52:23.896899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 478/1027] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:24.908448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7685b611-1f81-4d8c-9a17-947c766ed99b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:24.911221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7685b611-1f81-4d8c-9a17-947c766ed99b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:24.917521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7685b611-1f81-4d8c-9a17-947c766ed99b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:24.917996 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7685b611-1f81-4d8c-9a17-947c766ed99b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:24.918429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7685b611-1f81-4d8c-9a17-947c766ed99b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:24.919130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7685b611-1f81-4d8c-9a17-947c766ed99b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:24.919576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7685b611-1f81-4d8c-9a17-947c766ed99b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:24.919993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7685b611-1f81-4d8c-9a17-947c766ed99b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:24.950443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7685b611-1f81-4d8c-9a17-947c766ed99b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045910 Sep 02 09:52:24.951041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 550/1028] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:25.963930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-182d71f0-0fe5-4a12-92c7-181544a9723c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:25.966041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-182d71f0-0fe5-4a12-92c7-181544a9723c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:25.972891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-182d71f0-0fe5-4a12-92c7-181544a9723c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:25.973364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-182d71f0-0fe5-4a12-92c7-181544a9723c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:25.973794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-182d71f0-0fe5-4a12-92c7-181544a9723c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:25.974462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-182d71f0-0fe5-4a12-92c7-181544a9723c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:25.974939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-182d71f0-0fe5-4a12-92c7-181544a9723c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:25.975358 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-182d71f0-0fe5-4a12-92c7-181544a9723c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:26.008441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-182d71f0-0fe5-4a12-92c7-181544a9723c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048472 Sep 02 09:52:26.008984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 479/1029] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:25 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:27.021527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-51bb42ce-bf7a-4f0b-8a53-e0f80b82a8f6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:27.024001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-51bb42ce-bf7a-4f0b-8a53-e0f80b82a8f6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:27.030532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51bb42ce-bf7a-4f0b-8a53-e0f80b82a8f6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:27.031056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51bb42ce-bf7a-4f0b-8a53-e0f80b82a8f6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:27.031495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51bb42ce-bf7a-4f0b-8a53-e0f80b82a8f6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:27.032184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51bb42ce-bf7a-4f0b-8a53-e0f80b82a8f6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:27.032636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51bb42ce-bf7a-4f0b-8a53-e0f80b82a8f6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:27.033062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51bb42ce-bf7a-4f0b-8a53-e0f80b82a8f6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:27.062215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-51bb42ce-bf7a-4f0b-8a53-e0f80b82a8f6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Sep 02 09:52:27.062776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 551/1030] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:28.074692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3e3cfa9-623a-42a0-94b8-507597fd7e5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:28.077028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3e3cfa9-623a-42a0-94b8-507597fd7e5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:28.083530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3e3cfa9-623a-42a0-94b8-507597fd7e5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:28.084015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3e3cfa9-623a-42a0-94b8-507597fd7e5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:28.084451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3e3cfa9-623a-42a0-94b8-507597fd7e5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:28.085135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3e3cfa9-623a-42a0-94b8-507597fd7e5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:28.085589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3e3cfa9-623a-42a0-94b8-507597fd7e5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:28.086011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3e3cfa9-623a-42a0-94b8-507597fd7e5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:28.115471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3e3cfa9-623a-42a0-94b8-507597fd7e5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044795 Sep 02 09:52:28.116017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 480/1031] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:29.128049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6d965f92-9abe-4d91-9371-92935cca5310 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:29.130187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6d965f92-9abe-4d91-9371-92935cca5310 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:29.136615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d965f92-9abe-4d91-9371-92935cca5310 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:29.137087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d965f92-9abe-4d91-9371-92935cca5310 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:29.137515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d965f92-9abe-4d91-9371-92935cca5310 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:29.138190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d965f92-9abe-4d91-9371-92935cca5310 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:29.138635 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d965f92-9abe-4d91-9371-92935cca5310 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:29.139082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d965f92-9abe-4d91-9371-92935cca5310 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:29.168196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6d965f92-9abe-4d91-9371-92935cca5310 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Sep 02 09:52:29.168733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 552/1032] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:30.180286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cc625e99-299c-4a9b-ac1e-bdd73f42692d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:30.182400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cc625e99-299c-4a9b-ac1e-bdd73f42692d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:30.188780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc625e99-299c-4a9b-ac1e-bdd73f42692d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:30.189265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc625e99-299c-4a9b-ac1e-bdd73f42692d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:30.189737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc625e99-299c-4a9b-ac1e-bdd73f42692d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:30.190418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc625e99-299c-4a9b-ac1e-bdd73f42692d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:30.190901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc625e99-299c-4a9b-ac1e-bdd73f42692d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:30.191322 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc625e99-299c-4a9b-ac1e-bdd73f42692d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:30.220319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cc625e99-299c-4a9b-ac1e-bdd73f42692d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 Sep 02 09:52:30.221525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 481/1033] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:31.233073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-022c466b-53c4-4121-96de-af22af902c52 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:31.235220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-022c466b-53c4-4121-96de-af22af902c52 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:31.242224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-022c466b-53c4-4121-96de-af22af902c52 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:31.242731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-022c466b-53c4-4121-96de-af22af902c52 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:31.243161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-022c466b-53c4-4121-96de-af22af902c52 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:31.243839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-022c466b-53c4-4121-96de-af22af902c52 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:31.244286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-022c466b-53c4-4121-96de-af22af902c52 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:31.244707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-022c466b-53c4-4121-96de-af22af902c52 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:31.273241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-022c466b-53c4-4121-96de-af22af902c52 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Sep 02 09:52:31.273769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 553/1034] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:32.284983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-708e4e44-cdaa-47d1-8221-57c07251cd76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:32.287159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-708e4e44-cdaa-47d1-8221-57c07251cd76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:32.293087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-708e4e44-cdaa-47d1-8221-57c07251cd76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:32.293576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-708e4e44-cdaa-47d1-8221-57c07251cd76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:32.294014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-708e4e44-cdaa-47d1-8221-57c07251cd76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:32.294750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-708e4e44-cdaa-47d1-8221-57c07251cd76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:32.295215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-708e4e44-cdaa-47d1-8221-57c07251cd76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:32.295653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-708e4e44-cdaa-47d1-8221-57c07251cd76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:32.325636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-708e4e44-cdaa-47d1-8221-57c07251cd76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 Sep 02 09:52:32.326204 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 482/1035] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:33.337772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0526cc1e-8501-43aa-8bdf-111f9af85780 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:33.339998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0526cc1e-8501-43aa-8bdf-111f9af85780 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:33.346301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0526cc1e-8501-43aa-8bdf-111f9af85780 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:33.346810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0526cc1e-8501-43aa-8bdf-111f9af85780 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:33.347732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0526cc1e-8501-43aa-8bdf-111f9af85780 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:33.348416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0526cc1e-8501-43aa-8bdf-111f9af85780 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:33.348865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0526cc1e-8501-43aa-8bdf-111f9af85780 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:33.349286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0526cc1e-8501-43aa-8bdf-111f9af85780 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:33.378000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0526cc1e-8501-43aa-8bdf-111f9af85780 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 Sep 02 09:52:33.378537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 554/1036] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:34.389407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2fb4dbcf-46aa-44cb-9a60-7221491c0763 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:34.391591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2fb4dbcf-46aa-44cb-9a60-7221491c0763 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:34.398234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fb4dbcf-46aa-44cb-9a60-7221491c0763 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:34.398730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fb4dbcf-46aa-44cb-9a60-7221491c0763 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:34.399181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fb4dbcf-46aa-44cb-9a60-7221491c0763 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:34.399860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fb4dbcf-46aa-44cb-9a60-7221491c0763 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:34.400311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fb4dbcf-46aa-44cb-9a60-7221491c0763 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:34.400731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2fb4dbcf-46aa-44cb-9a60-7221491c0763 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:34.430187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2fb4dbcf-46aa-44cb-9a60-7221491c0763 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Sep 02 09:52:34.430804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 483/1037] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:35.442125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bb2d07cb-76a2-467c-9679-73058a579f24 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:35.444335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bb2d07cb-76a2-467c-9679-73058a579f24 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:35.450686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb2d07cb-76a2-467c-9679-73058a579f24 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:35.451275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb2d07cb-76a2-467c-9679-73058a579f24 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:35.451717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb2d07cb-76a2-467c-9679-73058a579f24 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:35.452405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb2d07cb-76a2-467c-9679-73058a579f24 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:35.452863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb2d07cb-76a2-467c-9679-73058a579f24 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:35.453292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb2d07cb-76a2-467c-9679-73058a579f24 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:35.481807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bb2d07cb-76a2-467c-9679-73058a579f24 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Sep 02 09:52:35.482348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 555/1038] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:36.493812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0b2b7996-960c-4ee1-a500-ed30d48540c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:36.495968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0b2b7996-960c-4ee1-a500-ed30d48540c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:36.502332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b2b7996-960c-4ee1-a500-ed30d48540c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:36.502842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b2b7996-960c-4ee1-a500-ed30d48540c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:36.503278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b2b7996-960c-4ee1-a500-ed30d48540c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:36.504456 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b2b7996-960c-4ee1-a500-ed30d48540c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:36.504911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b2b7996-960c-4ee1-a500-ed30d48540c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:36.505330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b2b7996-960c-4ee1-a500-ed30d48540c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:36.534928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0b2b7996-960c-4ee1-a500-ed30d48540c3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Sep 02 09:52:36.535476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 484/1039] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:37.546641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1a3e2bac-555e-4e45-9119-f97f02946c95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:37.548848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1a3e2bac-555e-4e45-9119-f97f02946c95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:37.554840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a3e2bac-555e-4e45-9119-f97f02946c95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:37.555330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a3e2bac-555e-4e45-9119-f97f02946c95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:37.555766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a3e2bac-555e-4e45-9119-f97f02946c95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:37.556452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a3e2bac-555e-4e45-9119-f97f02946c95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:37.556905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a3e2bac-555e-4e45-9119-f97f02946c95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:37.557328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a3e2bac-555e-4e45-9119-f97f02946c95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:37.587020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1a3e2bac-555e-4e45-9119-f97f02946c95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Sep 02 09:52:37.587581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 556/1040] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:38.604325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e668172f-7b31-4f35-a59d-198c829b1aae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:38.606468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e668172f-7b31-4f35-a59d-198c829b1aae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:38.613538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e668172f-7b31-4f35-a59d-198c829b1aae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:38.614023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e668172f-7b31-4f35-a59d-198c829b1aae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:38.614460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e668172f-7b31-4f35-a59d-198c829b1aae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:38.615184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e668172f-7b31-4f35-a59d-198c829b1aae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:38.615634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e668172f-7b31-4f35-a59d-198c829b1aae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:38.616062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e668172f-7b31-4f35-a59d-198c829b1aae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:38.644665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e668172f-7b31-4f35-a59d-198c829b1aae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Sep 02 09:52:38.645209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 485/1041] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:39.656761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-158339be-0b89-43f4-a2b6-1d808c074add tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:39.659322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-158339be-0b89-43f4-a2b6-1d808c074add tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:39.666262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-158339be-0b89-43f4-a2b6-1d808c074add tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:39.666746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-158339be-0b89-43f4-a2b6-1d808c074add tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:39.667191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-158339be-0b89-43f4-a2b6-1d808c074add tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:39.667866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-158339be-0b89-43f4-a2b6-1d808c074add tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:39.668313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-158339be-0b89-43f4-a2b6-1d808c074add tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:39.668730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-158339be-0b89-43f4-a2b6-1d808c074add tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:39.697585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-158339be-0b89-43f4-a2b6-1d808c074add tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Sep 02 09:52:39.698129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 557/1042] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:40.709551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d6b4ea15-b114-4db5-8475-68fb502a9d42 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:40.711737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d6b4ea15-b114-4db5-8475-68fb502a9d42 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:40.718129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6b4ea15-b114-4db5-8475-68fb502a9d42 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:40.718615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6b4ea15-b114-4db5-8475-68fb502a9d42 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:40.719089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6b4ea15-b114-4db5-8475-68fb502a9d42 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:40.719775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6b4ea15-b114-4db5-8475-68fb502a9d42 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:40.720229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6b4ea15-b114-4db5-8475-68fb502a9d42 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:40.720656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6b4ea15-b114-4db5-8475-68fb502a9d42 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:40.749505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d6b4ea15-b114-4db5-8475-68fb502a9d42 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Sep 02 09:52:40.750042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 486/1043] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:41.761618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6bd433f9-14d6-4add-a1e1-8be57b9fcb34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:41.763791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6bd433f9-14d6-4add-a1e1-8be57b9fcb34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:41.770343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd433f9-14d6-4add-a1e1-8be57b9fcb34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:41.770865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd433f9-14d6-4add-a1e1-8be57b9fcb34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:41.771303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd433f9-14d6-4add-a1e1-8be57b9fcb34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:41.771990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd433f9-14d6-4add-a1e1-8be57b9fcb34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:41.772442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd433f9-14d6-4add-a1e1-8be57b9fcb34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:41.772867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bd433f9-14d6-4add-a1e1-8be57b9fcb34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:41.802503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6bd433f9-14d6-4add-a1e1-8be57b9fcb34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Sep 02 09:52:41.803071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 558/1044] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:42.814850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-050e04f4-1b70-4ff3-83c0-5c2723e3a935 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:42.816967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-050e04f4-1b70-4ff3-83c0-5c2723e3a935 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:42.823948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-050e04f4-1b70-4ff3-83c0-5c2723e3a935 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:42.824438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-050e04f4-1b70-4ff3-83c0-5c2723e3a935 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:42.824875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-050e04f4-1b70-4ff3-83c0-5c2723e3a935 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:42.825562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-050e04f4-1b70-4ff3-83c0-5c2723e3a935 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:42.826019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-050e04f4-1b70-4ff3-83c0-5c2723e3a935 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:42.826491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-050e04f4-1b70-4ff3-83c0-5c2723e3a935 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:42.857280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-050e04f4-1b70-4ff3-83c0-5c2723e3a935 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Sep 02 09:52:42.857844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 487/1045] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:43.869273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-80d5abdd-1194-4b59-9a5f-9896c7962622 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:43.871436 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-80d5abdd-1194-4b59-9a5f-9896c7962622 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:43.877842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-80d5abdd-1194-4b59-9a5f-9896c7962622 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:43.878330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-80d5abdd-1194-4b59-9a5f-9896c7962622 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:43.878797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-80d5abdd-1194-4b59-9a5f-9896c7962622 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:43.879496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-80d5abdd-1194-4b59-9a5f-9896c7962622 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:43.880471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-80d5abdd-1194-4b59-9a5f-9896c7962622 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:43.880897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-80d5abdd-1194-4b59-9a5f-9896c7962622 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:43.910946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-80d5abdd-1194-4b59-9a5f-9896c7962622 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Sep 02 09:52:43.911505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 559/1046] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:44.923210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d90b098c-f2ce-4458-bfd2-ce7afbdd5a5f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:44.925349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d90b098c-f2ce-4458-bfd2-ce7afbdd5a5f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:44.931777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d90b098c-f2ce-4458-bfd2-ce7afbdd5a5f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:44.932256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d90b098c-f2ce-4458-bfd2-ce7afbdd5a5f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:44.932687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d90b098c-f2ce-4458-bfd2-ce7afbdd5a5f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:44.933360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d90b098c-f2ce-4458-bfd2-ce7afbdd5a5f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:44.933805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d90b098c-f2ce-4458-bfd2-ce7afbdd5a5f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:44.934224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d90b098c-f2ce-4458-bfd2-ce7afbdd5a5f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:44.936559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=96 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:52:44.964209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d90b098c-f2ce-4458-bfd2-ce7afbdd5a5f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Sep 02 09:52:44.964759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 488/1047] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:45.976226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-51af5246-4f51-4fc1-bdb0-0d906087e073 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:45.978353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-51af5246-4f51-4fc1-bdb0-0d906087e073 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:45.984746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51af5246-4f51-4fc1-bdb0-0d906087e073 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:45.985223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51af5246-4f51-4fc1-bdb0-0d906087e073 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:45.985677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51af5246-4f51-4fc1-bdb0-0d906087e073 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:45.986343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51af5246-4f51-4fc1-bdb0-0d906087e073 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:45.986835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51af5246-4f51-4fc1-bdb0-0d906087e073 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:45.987261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51af5246-4f51-4fc1-bdb0-0d906087e073 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:46.016580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-51af5246-4f51-4fc1-bdb0-0d906087e073 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Sep 02 09:52:46.017392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 560/1048] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:47.028639 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4f3dbf39-ef87-4c28-82eb-83013f7fdc1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:47.030793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4f3dbf39-ef87-4c28-82eb-83013f7fdc1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:47.037594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f3dbf39-ef87-4c28-82eb-83013f7fdc1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:47.038077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f3dbf39-ef87-4c28-82eb-83013f7fdc1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:47.038512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f3dbf39-ef87-4c28-82eb-83013f7fdc1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:47.039231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f3dbf39-ef87-4c28-82eb-83013f7fdc1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:47.039682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f3dbf39-ef87-4c28-82eb-83013f7fdc1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:47.040103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f3dbf39-ef87-4c28-82eb-83013f7fdc1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:47.069437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4f3dbf39-ef87-4c28-82eb-83013f7fdc1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044709 Sep 02 09:52:47.069978 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 489/1049] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:48.081286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-28fb41a3-3822-4a01-99de-d77bf198d443 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:48.084056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-28fb41a3-3822-4a01-99de-d77bf198d443 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:48.090406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28fb41a3-3822-4a01-99de-d77bf198d443 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:48.091002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28fb41a3-3822-4a01-99de-d77bf198d443 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:48.091446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28fb41a3-3822-4a01-99de-d77bf198d443 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:48.092130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28fb41a3-3822-4a01-99de-d77bf198d443 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:48.092589 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28fb41a3-3822-4a01-99de-d77bf198d443 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:48.093015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28fb41a3-3822-4a01-99de-d77bf198d443 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:48.122111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-28fb41a3-3822-4a01-99de-d77bf198d443 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Sep 02 09:52:48.122596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 561/1050] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:49.134117 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ef8042e4-0e99-45c3-bfce-c949c8466d6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:49.136343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ef8042e4-0e99-45c3-bfce-c949c8466d6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:49.142976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef8042e4-0e99-45c3-bfce-c949c8466d6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:49.143464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef8042e4-0e99-45c3-bfce-c949c8466d6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:49.143896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef8042e4-0e99-45c3-bfce-c949c8466d6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:49.144579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef8042e4-0e99-45c3-bfce-c949c8466d6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:49.145031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef8042e4-0e99-45c3-bfce-c949c8466d6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:49.145453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef8042e4-0e99-45c3-bfce-c949c8466d6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:49.174334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ef8042e4-0e99-45c3-bfce-c949c8466d6d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044247 Sep 02 09:52:49.174892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 490/1051] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:50.187158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cf42f5e8-9c09-4245-804f-8a622ec9ce8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:50.189267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cf42f5e8-9c09-4245-804f-8a622ec9ce8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:50.196283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf42f5e8-9c09-4245-804f-8a622ec9ce8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:50.196761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf42f5e8-9c09-4245-804f-8a622ec9ce8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:50.197194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf42f5e8-9c09-4245-804f-8a622ec9ce8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:50.197874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf42f5e8-9c09-4245-804f-8a622ec9ce8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:50.198325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf42f5e8-9c09-4245-804f-8a622ec9ce8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:50.198773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf42f5e8-9c09-4245-804f-8a622ec9ce8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:50.227035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cf42f5e8-9c09-4245-804f-8a622ec9ce8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043818 Sep 02 09:52:50.227589 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 562/1052] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:51.239105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-50be8b15-4b92-4696-a063-33e1437fd58e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:51.241447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-50be8b15-4b92-4696-a063-33e1437fd58e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:51.247739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50be8b15-4b92-4696-a063-33e1437fd58e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:51.248216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50be8b15-4b92-4696-a063-33e1437fd58e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:51.248647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50be8b15-4b92-4696-a063-33e1437fd58e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:51.249319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50be8b15-4b92-4696-a063-33e1437fd58e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:51.249766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50be8b15-4b92-4696-a063-33e1437fd58e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:51.250182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50be8b15-4b92-4696-a063-33e1437fd58e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:51.278879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-50be8b15-4b92-4696-a063-33e1437fd58e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 Sep 02 09:52:51.279410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 491/1053] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:52.291307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-49136f6d-ca82-4c58-9e3d-6e39bdd1a9fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:52.293440 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-49136f6d-ca82-4c58-9e3d-6e39bdd1a9fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:52.299725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49136f6d-ca82-4c58-9e3d-6e39bdd1a9fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:52.300208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49136f6d-ca82-4c58-9e3d-6e39bdd1a9fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:52.300641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49136f6d-ca82-4c58-9e3d-6e39bdd1a9fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:52.301327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49136f6d-ca82-4c58-9e3d-6e39bdd1a9fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:52.301775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49136f6d-ca82-4c58-9e3d-6e39bdd1a9fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:52.302801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49136f6d-ca82-4c58-9e3d-6e39bdd1a9fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:52.306393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=96 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:52:52.331914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-49136f6d-ca82-4c58-9e3d-6e39bdd1a9fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Sep 02 09:52:52.332480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 563/1054] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:53.344255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-16e1e679-3bde-44fb-bc00-08260a98a79d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:53.346424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-16e1e679-3bde-44fb-bc00-08260a98a79d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:53.353244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16e1e679-3bde-44fb-bc00-08260a98a79d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:53.353722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16e1e679-3bde-44fb-bc00-08260a98a79d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:53.354156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16e1e679-3bde-44fb-bc00-08260a98a79d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:53.354916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16e1e679-3bde-44fb-bc00-08260a98a79d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:53.355327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16e1e679-3bde-44fb-bc00-08260a98a79d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:53.355754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-16e1e679-3bde-44fb-bc00-08260a98a79d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:53.384851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-16e1e679-3bde-44fb-bc00-08260a98a79d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 Sep 02 09:52:53.385419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 492/1055] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:54.397531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bb1cbd82-b028-414f-b523-9c0c04cfd46a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:54.399715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bb1cbd82-b028-414f-b523-9c0c04cfd46a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:54.402050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=30 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:52:54.406787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd82-b028-414f-b523-9c0c04cfd46a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:54.407275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd82-b028-414f-b523-9c0c04cfd46a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:54.407714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd82-b028-414f-b523-9c0c04cfd46a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:54.408405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd82-b028-414f-b523-9c0c04cfd46a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:54.408858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd82-b028-414f-b523-9c0c04cfd46a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:54.409283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb1cbd82-b028-414f-b523-9c0c04cfd46a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:54.438596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bb1cbd82-b028-414f-b523-9c0c04cfd46a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045352 Sep 02 09:52:54.439174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 564/1056] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:55.451422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7698fb30-a293-420b-9086-efb2159134e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:55.453590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7698fb30-a293-420b-9086-efb2159134e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:55.455982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=30 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:52:55.461314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7698fb30-a293-420b-9086-efb2159134e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:55.461810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7698fb30-a293-420b-9086-efb2159134e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:55.462248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7698fb30-a293-420b-9086-efb2159134e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:55.462971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7698fb30-a293-420b-9086-efb2159134e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:55.463446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7698fb30-a293-420b-9086-efb2159134e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:55.463857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7698fb30-a293-420b-9086-efb2159134e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:55.493532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7698fb30-a293-420b-9086-efb2159134e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046060 Sep 02 09:52:55.494099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 493/1057] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:56.505497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-290206f5-3bf0-4a98-a58a-7f44b4b9c8a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:56.507689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-290206f5-3bf0-4a98-a58a-7f44b4b9c8a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:56.514333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-290206f5-3bf0-4a98-a58a-7f44b4b9c8a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:56.514847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-290206f5-3bf0-4a98-a58a-7f44b4b9c8a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:56.515290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-290206f5-3bf0-4a98-a58a-7f44b4b9c8a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:56.515981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-290206f5-3bf0-4a98-a58a-7f44b4b9c8a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:56.516676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-290206f5-3bf0-4a98-a58a-7f44b4b9c8a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:56.517106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-290206f5-3bf0-4a98-a58a-7f44b4b9c8a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:56.547905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-290206f5-3bf0-4a98-a58a-7f44b4b9c8a5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046307 Sep 02 09:52:56.548459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 565/1058] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:57.560421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4ab80d28-cd93-4b15-96bc-ef6dc9fed05a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:57.562545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4ab80d28-cd93-4b15-96bc-ef6dc9fed05a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:57.569570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ab80d28-cd93-4b15-96bc-ef6dc9fed05a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:57.570049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ab80d28-cd93-4b15-96bc-ef6dc9fed05a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:57.570481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ab80d28-cd93-4b15-96bc-ef6dc9fed05a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:57.571184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ab80d28-cd93-4b15-96bc-ef6dc9fed05a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:57.571639 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ab80d28-cd93-4b15-96bc-ef6dc9fed05a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:57.572059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ab80d28-cd93-4b15-96bc-ef6dc9fed05a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:57.600338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4ab80d28-cd93-4b15-96bc-ef6dc9fed05a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044051 Sep 02 09:52:57.600889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 494/1059] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:58.612596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-26bb0754-644c-4ba8-bf16-552c244d2cac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:58.614792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-26bb0754-644c-4ba8-bf16-552c244d2cac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:58.621134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-26bb0754-644c-4ba8-bf16-552c244d2cac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:58.621615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-26bb0754-644c-4ba8-bf16-552c244d2cac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:58.622062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-26bb0754-644c-4ba8-bf16-552c244d2cac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:58.622764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-26bb0754-644c-4ba8-bf16-552c244d2cac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:58.623218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-26bb0754-644c-4ba8-bf16-552c244d2cac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:58.623638 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-26bb0754-644c-4ba8-bf16-552c244d2cac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:58.653569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-26bb0754-644c-4ba8-bf16-552c244d2cac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Sep 02 09:52:58.654121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 566/1060] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:52:59.666088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0c333ff7-0680-4cf6-a916-65cd7810bcb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:52:59.668249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0c333ff7-0680-4cf6-a916-65cd7810bcb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:52:59.674601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c333ff7-0680-4cf6-a916-65cd7810bcb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:59.675143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c333ff7-0680-4cf6-a916-65cd7810bcb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:59.675580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c333ff7-0680-4cf6-a916-65cd7810bcb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:59.676261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c333ff7-0680-4cf6-a916-65cd7810bcb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:52:59.676716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c333ff7-0680-4cf6-a916-65cd7810bcb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:52:59.677142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c333ff7-0680-4cf6-a916-65cd7810bcb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:52:59.705220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0c333ff7-0680-4cf6-a916-65cd7810bcb3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043730 Sep 02 09:52:59.705755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 495/1061] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:52:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:00.717397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-08bf3dcc-3b05-4e3e-a294-2be6e48504b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:00.719555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-08bf3dcc-3b05-4e3e-a294-2be6e48504b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:00.725899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08bf3dcc-3b05-4e3e-a294-2be6e48504b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:00.726379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08bf3dcc-3b05-4e3e-a294-2be6e48504b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:00.726850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08bf3dcc-3b05-4e3e-a294-2be6e48504b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:00.727531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08bf3dcc-3b05-4e3e-a294-2be6e48504b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:00.727982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08bf3dcc-3b05-4e3e-a294-2be6e48504b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:00.728404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08bf3dcc-3b05-4e3e-a294-2be6e48504b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:00.757239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-08bf3dcc-3b05-4e3e-a294-2be6e48504b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Sep 02 09:53:00.757719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 567/1062] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:01.771183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-991dbf31-90d0-4c9c-9ef9-985df0e1d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:01.773792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-991dbf31-90d0-4c9c-9ef9-985df0e1d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:01.779677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-991dbf31-90d0-4c9c-9ef9-985df0e1d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:01.780160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-991dbf31-90d0-4c9c-9ef9-985df0e1d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:01.780621 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-991dbf31-90d0-4c9c-9ef9-985df0e1d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:01.781306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-991dbf31-90d0-4c9c-9ef9-985df0e1d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:01.781756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-991dbf31-90d0-4c9c-9ef9-985df0e1d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:01.782178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-991dbf31-90d0-4c9c-9ef9-985df0e1d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:01.811023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-991dbf31-90d0-4c9c-9ef9-985df0e1d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043879 Sep 02 09:53:01.811559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 496/1063] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:02.822548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-14c0801b-d157-4fa9-91c0-ceaa9ef65c10 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:02.824817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-14c0801b-d157-4fa9-91c0-ceaa9ef65c10 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:02.831038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14c0801b-d157-4fa9-91c0-ceaa9ef65c10 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:02.831519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14c0801b-d157-4fa9-91c0-ceaa9ef65c10 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:02.831954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14c0801b-d157-4fa9-91c0-ceaa9ef65c10 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:02.832641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14c0801b-d157-4fa9-91c0-ceaa9ef65c10 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:02.833091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14c0801b-d157-4fa9-91c0-ceaa9ef65c10 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:02.833513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14c0801b-d157-4fa9-91c0-ceaa9ef65c10 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:02.862577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-14c0801b-d157-4fa9-91c0-ceaa9ef65c10 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Sep 02 09:53:02.863103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 568/1064] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:03.875217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2d34fab9-a5a3-4fc3-8f66-3e34658f06c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:03.877465 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2d34fab9-a5a3-4fc3-8f66-3e34658f06c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:03.884521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d34fab9-a5a3-4fc3-8f66-3e34658f06c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:03.885006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d34fab9-a5a3-4fc3-8f66-3e34658f06c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:03.885441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d34fab9-a5a3-4fc3-8f66-3e34658f06c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:03.886128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d34fab9-a5a3-4fc3-8f66-3e34658f06c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:03.886581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d34fab9-a5a3-4fc3-8f66-3e34658f06c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:03.887028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d34fab9-a5a3-4fc3-8f66-3e34658f06c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:03.916238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2d34fab9-a5a3-4fc3-8f66-3e34658f06c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Sep 02 09:53:03.916791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 497/1065] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:04.927837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bcba54b8-ed2b-4a24-9117-d01bea4a8222 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:04.930158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bcba54b8-ed2b-4a24-9117-d01bea4a8222 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:04.936430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcba54b8-ed2b-4a24-9117-d01bea4a8222 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:04.936910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcba54b8-ed2b-4a24-9117-d01bea4a8222 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:04.937346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcba54b8-ed2b-4a24-9117-d01bea4a8222 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:04.938035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcba54b8-ed2b-4a24-9117-d01bea4a8222 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:04.938490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcba54b8-ed2b-4a24-9117-d01bea4a8222 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:04.938942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcba54b8-ed2b-4a24-9117-d01bea4a8222 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:04.968046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bcba54b8-ed2b-4a24-9117-d01bea4a8222 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Sep 02 09:53:04.968592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 569/1066] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:05.979705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b0e34853-e48a-4fe5-b153-5a9f1dd3d715 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:05.981877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b0e34853-e48a-4fe5-b153-5a9f1dd3d715 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:05.988386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0e34853-e48a-4fe5-b153-5a9f1dd3d715 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:05.988867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0e34853-e48a-4fe5-b153-5a9f1dd3d715 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:05.989300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0e34853-e48a-4fe5-b153-5a9f1dd3d715 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:05.989982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0e34853-e48a-4fe5-b153-5a9f1dd3d715 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:05.991127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0e34853-e48a-4fe5-b153-5a9f1dd3d715 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:05.991554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b0e34853-e48a-4fe5-b153-5a9f1dd3d715 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:06.020155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b0e34853-e48a-4fe5-b153-5a9f1dd3d715 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Sep 02 09:53:06.020706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 498/1067] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:07.031389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-721b544d-1bf7-4054-a9de-670f721c5b88 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:07.033525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-721b544d-1bf7-4054-a9de-670f721c5b88 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:07.040442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-721b544d-1bf7-4054-a9de-670f721c5b88 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:07.040929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-721b544d-1bf7-4054-a9de-670f721c5b88 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:07.041416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-721b544d-1bf7-4054-a9de-670f721c5b88 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:07.042084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-721b544d-1bf7-4054-a9de-670f721c5b88 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:07.042536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-721b544d-1bf7-4054-a9de-670f721c5b88 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:07.042993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-721b544d-1bf7-4054-a9de-670f721c5b88 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:07.071372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-721b544d-1bf7-4054-a9de-670f721c5b88 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043862 Sep 02 09:53:07.071918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 570/1068] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:08.084789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-32720da2-0a4d-450c-85c6-6da30ed20b82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:08.087040 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-32720da2-0a4d-450c-85c6-6da30ed20b82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:08.093497 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32720da2-0a4d-450c-85c6-6da30ed20b82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:08.093985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32720da2-0a4d-450c-85c6-6da30ed20b82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:08.094430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32720da2-0a4d-450c-85c6-6da30ed20b82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:08.095139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32720da2-0a4d-450c-85c6-6da30ed20b82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:08.095594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32720da2-0a4d-450c-85c6-6da30ed20b82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:08.096018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32720da2-0a4d-450c-85c6-6da30ed20b82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:08.126062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-32720da2-0a4d-450c-85c6-6da30ed20b82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046474 Sep 02 09:53:08.126620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 499/1069] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:09.138165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-18c3b966-892e-439b-98fc-150f85b8c985 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:09.140394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-18c3b966-892e-439b-98fc-150f85b8c985 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:09.146468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c3b966-892e-439b-98fc-150f85b8c985 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:09.146990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c3b966-892e-439b-98fc-150f85b8c985 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:09.147435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c3b966-892e-439b-98fc-150f85b8c985 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:09.148122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c3b966-892e-439b-98fc-150f85b8c985 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:09.148570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c3b966-892e-439b-98fc-150f85b8c985 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:09.148995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c3b966-892e-439b-98fc-150f85b8c985 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:09.179474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-18c3b966-892e-439b-98fc-150f85b8c985 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045327 Sep 02 09:53:09.180027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 571/1070] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:10.191445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9487dd8f-6bdf-461b-8d3e-410645dff826 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:10.194254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9487dd8f-6bdf-461b-8d3e-410645dff826 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:10.200633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9487dd8f-6bdf-461b-8d3e-410645dff826 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:10.201118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9487dd8f-6bdf-461b-8d3e-410645dff826 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:10.201556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9487dd8f-6bdf-461b-8d3e-410645dff826 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:10.202305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9487dd8f-6bdf-461b-8d3e-410645dff826 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:10.202789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9487dd8f-6bdf-461b-8d3e-410645dff826 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:10.203216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9487dd8f-6bdf-461b-8d3e-410645dff826 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:10.231510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9487dd8f-6bdf-461b-8d3e-410645dff826 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Sep 02 09:53:10.232066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 500/1071] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:11.243310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9994a462-e1f5-4fd5-a8f7-03c4027cfb85 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:11.245457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9994a462-e1f5-4fd5-a8f7-03c4027cfb85 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:11.251767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9994a462-e1f5-4fd5-a8f7-03c4027cfb85 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:11.252260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9994a462-e1f5-4fd5-a8f7-03c4027cfb85 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:11.252661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9994a462-e1f5-4fd5-a8f7-03c4027cfb85 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:11.253347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9994a462-e1f5-4fd5-a8f7-03c4027cfb85 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:11.253791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9994a462-e1f5-4fd5-a8f7-03c4027cfb85 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:11.254207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9994a462-e1f5-4fd5-a8f7-03c4027cfb85 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:11.283914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9994a462-e1f5-4fd5-a8f7-03c4027cfb85 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Sep 02 09:53:11.284459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 572/1072] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:12.295244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-353a289c-e400-48d6-82c0-4a93c90d280c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:12.297437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-353a289c-e400-48d6-82c0-4a93c90d280c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:12.303765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-353a289c-e400-48d6-82c0-4a93c90d280c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:12.304257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-353a289c-e400-48d6-82c0-4a93c90d280c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:12.304690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-353a289c-e400-48d6-82c0-4a93c90d280c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:12.305379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-353a289c-e400-48d6-82c0-4a93c90d280c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:12.305832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-353a289c-e400-48d6-82c0-4a93c90d280c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:12.306257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-353a289c-e400-48d6-82c0-4a93c90d280c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:12.336945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-353a289c-e400-48d6-82c0-4a93c90d280c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045497 Sep 02 09:53:12.337722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 501/1073] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:13.348964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-20e95829-8134-4387-8b03-7a25b27a7784 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:13.352012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-20e95829-8134-4387-8b03-7a25b27a7784 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:13.358498 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20e95829-8134-4387-8b03-7a25b27a7784 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:13.359017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20e95829-8134-4387-8b03-7a25b27a7784 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:13.359456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20e95829-8134-4387-8b03-7a25b27a7784 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:13.360152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20e95829-8134-4387-8b03-7a25b27a7784 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:13.360611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20e95829-8134-4387-8b03-7a25b27a7784 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:13.361040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20e95829-8134-4387-8b03-7a25b27a7784 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:13.390839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-20e95829-8134-4387-8b03-7a25b27a7784 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045807 Sep 02 09:53:13.391658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 573/1074] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:14.402282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-98b54953-eed9-4ad7-b173-3db47de66e93 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:14.404478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-98b54953-eed9-4ad7-b173-3db47de66e93 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:14.410730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98b54953-eed9-4ad7-b173-3db47de66e93 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:14.411230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98b54953-eed9-4ad7-b173-3db47de66e93 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:14.411669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98b54953-eed9-4ad7-b173-3db47de66e93 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:14.412349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98b54953-eed9-4ad7-b173-3db47de66e93 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:14.412802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98b54953-eed9-4ad7-b173-3db47de66e93 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:14.413722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-98b54953-eed9-4ad7-b173-3db47de66e93 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:14.443250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-98b54953-eed9-4ad7-b173-3db47de66e93 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Sep 02 09:53:14.443793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 502/1075] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:15.454744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0d035c55-4de9-4664-9f4e-7979e294d15e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:15.456923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0d035c55-4de9-4664-9f4e-7979e294d15e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:15.463149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d035c55-4de9-4664-9f4e-7979e294d15e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:15.463726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d035c55-4de9-4664-9f4e-7979e294d15e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:15.464050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d035c55-4de9-4664-9f4e-7979e294d15e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:15.464739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d035c55-4de9-4664-9f4e-7979e294d15e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:15.465186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d035c55-4de9-4664-9f4e-7979e294d15e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:15.465663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d035c55-4de9-4664-9f4e-7979e294d15e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:15.495402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0d035c55-4de9-4664-9f4e-7979e294d15e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044516 Sep 02 09:53:15.495941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 574/1076] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:16.508172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1774beff-7ade-4af9-8a8b-88d0b7497f4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:16.510316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1774beff-7ade-4af9-8a8b-88d0b7497f4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:16.517022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1774beff-7ade-4af9-8a8b-88d0b7497f4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:16.517506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1774beff-7ade-4af9-8a8b-88d0b7497f4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:16.517940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1774beff-7ade-4af9-8a8b-88d0b7497f4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:16.518627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1774beff-7ade-4af9-8a8b-88d0b7497f4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:16.519107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1774beff-7ade-4af9-8a8b-88d0b7497f4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:16.519533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1774beff-7ade-4af9-8a8b-88d0b7497f4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:16.549658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1774beff-7ade-4af9-8a8b-88d0b7497f4d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046204 Sep 02 09:53:16.550199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 503/1077] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:17.561419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-37b39aa8-5837-4a7c-a0e8-08fece203332 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:17.563479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-37b39aa8-5837-4a7c-a0e8-08fece203332 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:17.569749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37b39aa8-5837-4a7c-a0e8-08fece203332 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:17.570232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37b39aa8-5837-4a7c-a0e8-08fece203332 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:17.570676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37b39aa8-5837-4a7c-a0e8-08fece203332 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:17.571386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37b39aa8-5837-4a7c-a0e8-08fece203332 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:17.571836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37b39aa8-5837-4a7c-a0e8-08fece203332 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:17.572260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37b39aa8-5837-4a7c-a0e8-08fece203332 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:17.607929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-37b39aa8-5837-4a7c-a0e8-08fece203332 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Sep 02 09:53:17.607929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 575/1078] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:18.617806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b9ad1cf7-79c0-498b-aa9c-d2687a87e8b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:18.620115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b9ad1cf7-79c0-498b-aa9c-d2687a87e8b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:18.626754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9ad1cf7-79c0-498b-aa9c-d2687a87e8b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:18.627243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9ad1cf7-79c0-498b-aa9c-d2687a87e8b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:18.627711 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9ad1cf7-79c0-498b-aa9c-d2687a87e8b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:18.628420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9ad1cf7-79c0-498b-aa9c-d2687a87e8b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:18.628871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9ad1cf7-79c0-498b-aa9c-d2687a87e8b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:18.629293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9ad1cf7-79c0-498b-aa9c-d2687a87e8b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:18.632243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=96 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:53:18.660856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b9ad1cf7-79c0-498b-aa9c-d2687a87e8b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047072 Sep 02 09:53:18.661419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 504/1079] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:19.672887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-809ec797-267a-42aa-87d5-6b45a63ec670 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:19.675039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-809ec797-267a-42aa-87d5-6b45a63ec670 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:19.682233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-809ec797-267a-42aa-87d5-6b45a63ec670 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:19.682741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-809ec797-267a-42aa-87d5-6b45a63ec670 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:19.683164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-809ec797-267a-42aa-87d5-6b45a63ec670 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:19.683846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-809ec797-267a-42aa-87d5-6b45a63ec670 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:19.684296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-809ec797-267a-42aa-87d5-6b45a63ec670 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:19.684715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-809ec797-267a-42aa-87d5-6b45a63ec670 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:19.714276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-809ec797-267a-42aa-87d5-6b45a63ec670 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Sep 02 09:53:19.715057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 576/1080] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:20.727353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b4a9fb11-74fc-435e-b035-461752799790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:20.729539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b4a9fb11-74fc-435e-b035-461752799790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:20.737036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a9fb11-74fc-435e-b035-461752799790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:20.737541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a9fb11-74fc-435e-b035-461752799790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:20.737960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a9fb11-74fc-435e-b035-461752799790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:20.738655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a9fb11-74fc-435e-b035-461752799790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:20.739128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a9fb11-74fc-435e-b035-461752799790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:20.739552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4a9fb11-74fc-435e-b035-461752799790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:20.769075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b4a9fb11-74fc-435e-b035-461752799790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046610 Sep 02 09:53:20.769642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 505/1081] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:53:21.781730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-15bee3e3-0daa-4cd1-80ec-a02e551df874 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:21.783910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-15bee3e3-0daa-4cd1-80ec-a02e551df874 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:21.790312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15bee3e3-0daa-4cd1-80ec-a02e551df874 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:21.790817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15bee3e3-0daa-4cd1-80ec-a02e551df874 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:21.791253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15bee3e3-0daa-4cd1-80ec-a02e551df874 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:21.791931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15bee3e3-0daa-4cd1-80ec-a02e551df874 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:21.792378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15bee3e3-0daa-4cd1-80ec-a02e551df874 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:21.792800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15bee3e3-0daa-4cd1-80ec-a02e551df874 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:21.823776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-15bee3e3-0daa-4cd1-80ec-a02e551df874 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045893 Sep 02 09:53:21.828207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 577/1082] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:22.834946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-99e543be-dfa6-41cd-b3d4-e0db32536e13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:22.837162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-99e543be-dfa6-41cd-b3d4-e0db32536e13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:22.843686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e543be-dfa6-41cd-b3d4-e0db32536e13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:22.844174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e543be-dfa6-41cd-b3d4-e0db32536e13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:22.844613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e543be-dfa6-41cd-b3d4-e0db32536e13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:22.845304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e543be-dfa6-41cd-b3d4-e0db32536e13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:22.845927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e543be-dfa6-41cd-b3d4-e0db32536e13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:22.846170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e543be-dfa6-41cd-b3d4-e0db32536e13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:22.876114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-99e543be-dfa6-41cd-b3d4-e0db32536e13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 Sep 02 09:53:22.876883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 506/1083] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:23.888730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-baa1528a-b336-42c3-a26d-ccbec2df0cd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:23.891167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-baa1528a-b336-42c3-a26d-ccbec2df0cd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:23.898224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baa1528a-b336-42c3-a26d-ccbec2df0cd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:23.898727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baa1528a-b336-42c3-a26d-ccbec2df0cd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:23.899175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baa1528a-b336-42c3-a26d-ccbec2df0cd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:23.899864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baa1528a-b336-42c3-a26d-ccbec2df0cd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:23.900339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baa1528a-b336-42c3-a26d-ccbec2df0cd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:23.900753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baa1528a-b336-42c3-a26d-ccbec2df0cd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:23.929578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-baa1528a-b336-42c3-a26d-ccbec2df0cd2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Sep 02 09:53:23.930135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 578/1084] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:24.941223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4e5c5e2f-7183-47e2-8fe0-4c8ca687a2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:24.943394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4e5c5e2f-7183-47e2-8fe0-4c8ca687a2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:24.949703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e5c5e2f-7183-47e2-8fe0-4c8ca687a2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:24.950182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e5c5e2f-7183-47e2-8fe0-4c8ca687a2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:24.950613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e5c5e2f-7183-47e2-8fe0-4c8ca687a2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:24.951334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e5c5e2f-7183-47e2-8fe0-4c8ca687a2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:24.951785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e5c5e2f-7183-47e2-8fe0-4c8ca687a2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:24.952205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e5c5e2f-7183-47e2-8fe0-4c8ca687a2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:24.982077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4e5c5e2f-7183-47e2-8fe0-4c8ca687a2d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044829 Sep 02 09:53:24.982659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 507/1085] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:25.993500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e4499462-e838-4725-9763-721d0a73dd47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:25.995619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e4499462-e838-4725-9763-721d0a73dd47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:26.002154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4499462-e838-4725-9763-721d0a73dd47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:26.002629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4499462-e838-4725-9763-721d0a73dd47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:26.003095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4499462-e838-4725-9763-721d0a73dd47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:26.003810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4499462-e838-4725-9763-721d0a73dd47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:26.004260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4499462-e838-4725-9763-721d0a73dd47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:26.004674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4499462-e838-4725-9763-721d0a73dd47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:26.007038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=96 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:53:26.035028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e4499462-e838-4725-9763-721d0a73dd47 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Sep 02 09:53:26.035583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 579/1086] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:25 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:27.047305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-277b217d-f647-4b35-86f4-b9467282e0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:27.049344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-277b217d-f647-4b35-86f4-b9467282e0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:27.056430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-277b217d-f647-4b35-86f4-b9467282e0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:27.056909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-277b217d-f647-4b35-86f4-b9467282e0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:27.057337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-277b217d-f647-4b35-86f4-b9467282e0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:27.058011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-277b217d-f647-4b35-86f4-b9467282e0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:27.058458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-277b217d-f647-4b35-86f4-b9467282e0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:27.058934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-277b217d-f647-4b35-86f4-b9467282e0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:27.087997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-277b217d-f647-4b35-86f4-b9467282e0c0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Sep 02 09:53:27.088632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 508/1087] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:28.100178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b32c6cf5-52e6-4d82-8bbf-bd49305abce0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:28.102361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b32c6cf5-52e6-4d82-8bbf-bd49305abce0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:28.104939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=32 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:53:28.109567 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b32c6cf5-52e6-4d82-8bbf-bd49305abce0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:28.110044 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b32c6cf5-52e6-4d82-8bbf-bd49305abce0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:28.110524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b32c6cf5-52e6-4d82-8bbf-bd49305abce0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:28.111234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b32c6cf5-52e6-4d82-8bbf-bd49305abce0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:28.111678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b32c6cf5-52e6-4d82-8bbf-bd49305abce0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:28.112092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b32c6cf5-52e6-4d82-8bbf-bd49305abce0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:28.142248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b32c6cf5-52e6-4d82-8bbf-bd49305abce0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Sep 02 09:53:28.142801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 580/1088] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:29.154003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0222c52f-3936-44d9-a1ac-20e0d64fca82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:29.156069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0222c52f-3936-44d9-a1ac-20e0d64fca82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:29.158366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=32 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:53:29.162956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0222c52f-3936-44d9-a1ac-20e0d64fca82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:29.163434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0222c52f-3936-44d9-a1ac-20e0d64fca82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:29.163864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0222c52f-3936-44d9-a1ac-20e0d64fca82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:29.164539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0222c52f-3936-44d9-a1ac-20e0d64fca82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:29.164988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0222c52f-3936-44d9-a1ac-20e0d64fca82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:29.165404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0222c52f-3936-44d9-a1ac-20e0d64fca82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:29.194486 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0222c52f-3936-44d9-a1ac-20e0d64fca82 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Sep 02 09:53:29.195547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 509/1089] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:30.207150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d9f8a970-8779-45b2-bc51-6fc97d4500e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:30.209227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d9f8a970-8779-45b2-bc51-6fc97d4500e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:30.216167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f8a970-8779-45b2-bc51-6fc97d4500e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:30.216652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f8a970-8779-45b2-bc51-6fc97d4500e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:30.217094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f8a970-8779-45b2-bc51-6fc97d4500e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:30.217807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f8a970-8779-45b2-bc51-6fc97d4500e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:30.218231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f8a970-8779-45b2-bc51-6fc97d4500e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:30.218687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f8a970-8779-45b2-bc51-6fc97d4500e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:30.247828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d9f8a970-8779-45b2-bc51-6fc97d4500e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Sep 02 09:53:30.248377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 581/1090] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:31.260924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cee80fc7-cc98-45c9-88c0-2bfca9d27d08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:31.263131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cee80fc7-cc98-45c9-88c0-2bfca9d27d08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:31.269637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cee80fc7-cc98-45c9-88c0-2bfca9d27d08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:31.270117 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cee80fc7-cc98-45c9-88c0-2bfca9d27d08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:31.270568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cee80fc7-cc98-45c9-88c0-2bfca9d27d08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:31.271269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cee80fc7-cc98-45c9-88c0-2bfca9d27d08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:31.271723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cee80fc7-cc98-45c9-88c0-2bfca9d27d08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:31.272149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cee80fc7-cc98-45c9-88c0-2bfca9d27d08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:31.300176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cee80fc7-cc98-45c9-88c0-2bfca9d27d08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Sep 02 09:53:31.300749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 510/1091] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:32.312250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2f498aed-1f55-463f-9d4c-e4f5576e0e57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:32.314339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2f498aed-1f55-463f-9d4c-e4f5576e0e57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:32.321321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f498aed-1f55-463f-9d4c-e4f5576e0e57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:32.321807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f498aed-1f55-463f-9d4c-e4f5576e0e57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:32.322251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f498aed-1f55-463f-9d4c-e4f5576e0e57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:32.322971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f498aed-1f55-463f-9d4c-e4f5576e0e57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:32.323428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f498aed-1f55-463f-9d4c-e4f5576e0e57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:32.323860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f498aed-1f55-463f-9d4c-e4f5576e0e57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:32.354819 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2f498aed-1f55-463f-9d4c-e4f5576e0e57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Sep 02 09:53:32.355383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 582/1092] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:33.367392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0b98caca-4ecf-4ad2-99bb-b3423db9d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:33.369574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0b98caca-4ecf-4ad2-99bb-b3423db9d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:33.375802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b98caca-4ecf-4ad2-99bb-b3423db9d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:33.376287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b98caca-4ecf-4ad2-99bb-b3423db9d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:33.376724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b98caca-4ecf-4ad2-99bb-b3423db9d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:33.377407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b98caca-4ecf-4ad2-99bb-b3423db9d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:33.377859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b98caca-4ecf-4ad2-99bb-b3423db9d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:33.378284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0b98caca-4ecf-4ad2-99bb-b3423db9d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:33.407696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0b98caca-4ecf-4ad2-99bb-b3423db9d306 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044779 Sep 02 09:53:33.408244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 511/1093] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:34.420259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-50ac3bf4-4090-4d8e-bde6-ef6b64182bec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:34.422404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-50ac3bf4-4090-4d8e-bde6-ef6b64182bec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:34.429190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50ac3bf4-4090-4d8e-bde6-ef6b64182bec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:34.429675 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50ac3bf4-4090-4d8e-bde6-ef6b64182bec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:34.430110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50ac3bf4-4090-4d8e-bde6-ef6b64182bec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:34.430841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50ac3bf4-4090-4d8e-bde6-ef6b64182bec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:34.431292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50ac3bf4-4090-4d8e-bde6-ef6b64182bec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:34.431712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50ac3bf4-4090-4d8e-bde6-ef6b64182bec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:34.463697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-50ac3bf4-4090-4d8e-bde6-ef6b64182bec tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047498 Sep 02 09:53:34.464249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 583/1094] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:35.476129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-75320a50-1d54-467c-8fbb-11de9e64ff2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:35.478174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-75320a50-1d54-467c-8fbb-11de9e64ff2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:35.484554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75320a50-1d54-467c-8fbb-11de9e64ff2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:35.485029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75320a50-1d54-467c-8fbb-11de9e64ff2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:35.485458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75320a50-1d54-467c-8fbb-11de9e64ff2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:35.486131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75320a50-1d54-467c-8fbb-11de9e64ff2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:35.486577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75320a50-1d54-467c-8fbb-11de9e64ff2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:35.487023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75320a50-1d54-467c-8fbb-11de9e64ff2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:35.518271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-75320a50-1d54-467c-8fbb-11de9e64ff2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Sep 02 09:53:35.522935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 512/1095] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:36.533253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c02874d2-4e08-4ad1-af95-d686e0afef1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:36.535327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c02874d2-4e08-4ad1-af95-d686e0afef1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:36.542229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c02874d2-4e08-4ad1-af95-d686e0afef1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:36.542730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c02874d2-4e08-4ad1-af95-d686e0afef1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:36.543164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c02874d2-4e08-4ad1-af95-d686e0afef1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:36.543837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c02874d2-4e08-4ad1-af95-d686e0afef1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:36.544282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c02874d2-4e08-4ad1-af95-d686e0afef1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:36.544699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c02874d2-4e08-4ad1-af95-d686e0afef1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:36.573714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c02874d2-4e08-4ad1-af95-d686e0afef1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044412 Sep 02 09:53:36.574395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 584/1096] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:37.586087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e5a25147-3174-4710-951e-50d08edd5d53 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:37.588740 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e5a25147-3174-4710-951e-50d08edd5d53 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:37.595068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a25147-3174-4710-951e-50d08edd5d53 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:37.595579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a25147-3174-4710-951e-50d08edd5d53 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:37.596010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a25147-3174-4710-951e-50d08edd5d53 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:37.596689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a25147-3174-4710-951e-50d08edd5d53 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:37.597133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a25147-3174-4710-951e-50d08edd5d53 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:37.597550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a25147-3174-4710-951e-50d08edd5d53 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:37.626255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e5a25147-3174-4710-951e-50d08edd5d53 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Sep 02 09:53:37.626851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 513/1097] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:38.639565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fc141466-52b3-428e-86d6-f19935eed342 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:38.641866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fc141466-52b3-428e-86d6-f19935eed342 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:38.648193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fc141466-52b3-428e-86d6-f19935eed342 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:38.648669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fc141466-52b3-428e-86d6-f19935eed342 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:38.649099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fc141466-52b3-428e-86d6-f19935eed342 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:38.649796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fc141466-52b3-428e-86d6-f19935eed342 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:38.650246 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fc141466-52b3-428e-86d6-f19935eed342 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:38.650669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fc141466-52b3-428e-86d6-f19935eed342 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:38.678638 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fc141466-52b3-428e-86d6-f19935eed342 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043209 Sep 02 09:53:38.679200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 585/1098] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:39.691369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3738643a-b421-46df-8079-42f8a02d6704 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:39.693453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3738643a-b421-46df-8079-42f8a02d6704 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:39.700371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3738643a-b421-46df-8079-42f8a02d6704 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:39.700853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3738643a-b421-46df-8079-42f8a02d6704 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:39.701280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3738643a-b421-46df-8079-42f8a02d6704 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:39.701950 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3738643a-b421-46df-8079-42f8a02d6704 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:39.702394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3738643a-b421-46df-8079-42f8a02d6704 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:39.702848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3738643a-b421-46df-8079-42f8a02d6704 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:39.731486 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3738643a-b421-46df-8079-42f8a02d6704 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044068 Sep 02 09:53:39.732026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 514/1099] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:40.743655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3bf61167-6b72-4b02-9173-42c1c2fc788e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:40.745789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3bf61167-6b72-4b02-9173-42c1c2fc788e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:40.752130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bf61167-6b72-4b02-9173-42c1c2fc788e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:40.752605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bf61167-6b72-4b02-9173-42c1c2fc788e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:40.753038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bf61167-6b72-4b02-9173-42c1c2fc788e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:40.753713 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bf61167-6b72-4b02-9173-42c1c2fc788e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:40.754161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bf61167-6b72-4b02-9173-42c1c2fc788e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:40.754580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bf61167-6b72-4b02-9173-42c1c2fc788e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:40.783079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3bf61167-6b72-4b02-9173-42c1c2fc788e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Sep 02 09:53:40.783610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 586/1100] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:41.795132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0d1b72f8-3d6b-4ebf-b857-7453646683a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:41.797163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0d1b72f8-3d6b-4ebf-b857-7453646683a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:41.803514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1b72f8-3d6b-4ebf-b857-7453646683a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:41.803994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1b72f8-3d6b-4ebf-b857-7453646683a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:41.804425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1b72f8-3d6b-4ebf-b857-7453646683a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:41.805098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1b72f8-3d6b-4ebf-b857-7453646683a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:41.805540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1b72f8-3d6b-4ebf-b857-7453646683a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:41.805957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d1b72f8-3d6b-4ebf-b857-7453646683a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:41.834413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0d1b72f8-3d6b-4ebf-b857-7453646683a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Sep 02 09:53:41.834984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 515/1101] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:42.846478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e5365c33-6af0-45a0-824b-a33d08047a3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:42.848669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e5365c33-6af0-45a0-824b-a33d08047a3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:42.855652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5365c33-6af0-45a0-824b-a33d08047a3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:42.856136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5365c33-6af0-45a0-824b-a33d08047a3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:42.856577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5365c33-6af0-45a0-824b-a33d08047a3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:42.857268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5365c33-6af0-45a0-824b-a33d08047a3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:42.857718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5365c33-6af0-45a0-824b-a33d08047a3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:42.858150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e5365c33-6af0-45a0-824b-a33d08047a3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:42.887559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e5365c33-6af0-45a0-824b-a33d08047a3a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Sep 02 09:53:42.888112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 587/1102] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:43.899721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-05d4cde8-a868-43eb-945a-c06b4c5f2a26 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:43.902280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-05d4cde8-a868-43eb-945a-c06b4c5f2a26 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:43.904333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:53:43.904479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments (ip 10.222.0.57) !!! Sep 02 09:53:43.911237 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05d4cde8-a868-43eb-945a-c06b4c5f2a26 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:43.911716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05d4cde8-a868-43eb-945a-c06b4c5f2a26 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:43.912145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05d4cde8-a868-43eb-945a-c06b4c5f2a26 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:43.912836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05d4cde8-a868-43eb-945a-c06b4c5f2a26 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:43.913290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05d4cde8-a868-43eb-945a-c06b4c5f2a26 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:43.913708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05d4cde8-a868-43eb-945a-c06b4c5f2a26 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:43.943978 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-05d4cde8-a868-43eb-945a-c06b4c5f2a26 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048255 Sep 02 09:53:43.944530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 516/1103] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:44.956041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-89c3af2e-b35c-4746-856c-766709b31873 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:44.958133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-89c3af2e-b35c-4746-856c-766709b31873 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:44.964530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89c3af2e-b35c-4746-856c-766709b31873 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:44.965013 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89c3af2e-b35c-4746-856c-766709b31873 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:44.965451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89c3af2e-b35c-4746-856c-766709b31873 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:44.966135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89c3af2e-b35c-4746-856c-766709b31873 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:44.966587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89c3af2e-b35c-4746-856c-766709b31873 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:44.967052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89c3af2e-b35c-4746-856c-766709b31873 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:44.996584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-89c3af2e-b35c-4746-856c-766709b31873 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Sep 02 09:53:44.997128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 588/1104] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:46.125978 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9381366b-0b87-4210-aa68-905877e0679b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:46.128306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9381366b-0b87-4210-aa68-905877e0679b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:46.134255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9381366b-0b87-4210-aa68-905877e0679b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:46.134769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9381366b-0b87-4210-aa68-905877e0679b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:46.135259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9381366b-0b87-4210-aa68-905877e0679b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:46.136481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9381366b-0b87-4210-aa68-905877e0679b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:46.136939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9381366b-0b87-4210-aa68-905877e0679b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:46.137368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9381366b-0b87-4210-aa68-905877e0679b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:46.166543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9381366b-0b87-4210-aa68-905877e0679b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161247 Sep 02 09:53:46.167129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 517/1105] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:47.178782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dd5d6c7e-3154-464a-ada0-15b16a145548 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:47.180978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dd5d6c7e-3154-464a-ada0-15b16a145548 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:47.182959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:53:47.183108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 09:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments (ip 10.222.0.57) !!! Sep 02 09:53:47.184391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:53:47.184564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 09:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments (ip 10.222.0.57) !!! Sep 02 09:53:47.198148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd5d6c7e-3154-464a-ada0-15b16a145548 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:47.198641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd5d6c7e-3154-464a-ada0-15b16a145548 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:47.199115 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd5d6c7e-3154-464a-ada0-15b16a145548 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:47.199812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd5d6c7e-3154-464a-ada0-15b16a145548 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:47.200266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd5d6c7e-3154-464a-ada0-15b16a145548 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:47.200727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd5d6c7e-3154-464a-ada0-15b16a145548 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:47.231734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dd5d6c7e-3154-464a-ada0-15b16a145548 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056872 Sep 02 09:53:47.232300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 589/1106] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:48.244198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-852cedd3-381b-4757-9c46-95de1be26bb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:48.246241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-852cedd3-381b-4757-9c46-95de1be26bb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:48.252667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852cedd3-381b-4757-9c46-95de1be26bb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:48.253151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852cedd3-381b-4757-9c46-95de1be26bb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:48.253585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852cedd3-381b-4757-9c46-95de1be26bb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:48.254268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852cedd3-381b-4757-9c46-95de1be26bb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:48.254733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852cedd3-381b-4757-9c46-95de1be26bb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:48.255170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-852cedd3-381b-4757-9c46-95de1be26bb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:48.284665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-852cedd3-381b-4757-9c46-95de1be26bb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044504 Sep 02 09:53:48.285219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 518/1107] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:49.297748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c93f1443-26dd-4b37-b697-13dcb01c2157 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:49.299851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c93f1443-26dd-4b37-b697-13dcb01c2157 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:49.306093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c93f1443-26dd-4b37-b697-13dcb01c2157 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:49.306568 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c93f1443-26dd-4b37-b697-13dcb01c2157 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:49.307660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c93f1443-26dd-4b37-b697-13dcb01c2157 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:49.308339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c93f1443-26dd-4b37-b697-13dcb01c2157 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:49.308786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c93f1443-26dd-4b37-b697-13dcb01c2157 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:49.309205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c93f1443-26dd-4b37-b697-13dcb01c2157 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:49.337969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c93f1443-26dd-4b37-b697-13dcb01c2157 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Sep 02 09:53:49.338518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 590/1108] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:50.350334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-55289db3-206f-4d01-8120-b6239f45b34f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:50.352499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-55289db3-206f-4d01-8120-b6239f45b34f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:50.359443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55289db3-206f-4d01-8120-b6239f45b34f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:50.359908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55289db3-206f-4d01-8120-b6239f45b34f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:50.360342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55289db3-206f-4d01-8120-b6239f45b34f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:50.361014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55289db3-206f-4d01-8120-b6239f45b34f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:50.361457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55289db3-206f-4d01-8120-b6239f45b34f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:50.361873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-55289db3-206f-4d01-8120-b6239f45b34f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:50.392352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-55289db3-206f-4d01-8120-b6239f45b34f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046052 Sep 02 09:53:50.392920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 519/1109] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:51.403931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1b2d0b54-63ba-429d-af2c-5e2607fa872d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:51.406045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1b2d0b54-63ba-429d-af2c-5e2607fa872d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:51.412457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b2d0b54-63ba-429d-af2c-5e2607fa872d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:51.412934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b2d0b54-63ba-429d-af2c-5e2607fa872d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:51.413371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b2d0b54-63ba-429d-af2c-5e2607fa872d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:51.414052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b2d0b54-63ba-429d-af2c-5e2607fa872d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:51.414496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b2d0b54-63ba-429d-af2c-5e2607fa872d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:51.414944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b2d0b54-63ba-429d-af2c-5e2607fa872d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:51.443582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1b2d0b54-63ba-429d-af2c-5e2607fa872d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 Sep 02 09:53:51.444115 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 591/1110] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:52.455788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b283fcd-df77-40d0-ad11-809a011e3071 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:52.457913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8b283fcd-df77-40d0-ad11-809a011e3071 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:52.464903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b283fcd-df77-40d0-ad11-809a011e3071 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:52.465388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b283fcd-df77-40d0-ad11-809a011e3071 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:52.465822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b283fcd-df77-40d0-ad11-809a011e3071 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:52.466508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b283fcd-df77-40d0-ad11-809a011e3071 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:52.466985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b283fcd-df77-40d0-ad11-809a011e3071 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:52.467421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b283fcd-df77-40d0-ad11-809a011e3071 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:52.471078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=96 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:53:52.499213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8b283fcd-df77-40d0-ad11-809a011e3071 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047125 Sep 02 09:53:52.500505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 520/1111] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:53.511624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5c28226b-deff-474e-a55b-711017605a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:53.513638 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5c28226b-deff-474e-a55b-711017605a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:53.520402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c28226b-deff-474e-a55b-711017605a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:53.520881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c28226b-deff-474e-a55b-711017605a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:53.521316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c28226b-deff-474e-a55b-711017605a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:53.522007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c28226b-deff-474e-a55b-711017605a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:53.522454 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c28226b-deff-474e-a55b-711017605a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:53.523022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c28226b-deff-474e-a55b-711017605a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:53.552185 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5c28226b-deff-474e-a55b-711017605a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044670 Sep 02 09:53:53.552720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 592/1112] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:54.564424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c6fa06d6-9022-4d0f-a14f-bf1d66aa64c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:54.566460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c6fa06d6-9022-4d0f-a14f-bf1d66aa64c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:54.573378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fa06d6-9022-4d0f-a14f-bf1d66aa64c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:54.573851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fa06d6-9022-4d0f-a14f-bf1d66aa64c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:54.574282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fa06d6-9022-4d0f-a14f-bf1d66aa64c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:54.574983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fa06d6-9022-4d0f-a14f-bf1d66aa64c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:54.575432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fa06d6-9022-4d0f-a14f-bf1d66aa64c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:54.575850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c6fa06d6-9022-4d0f-a14f-bf1d66aa64c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:54.604812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c6fa06d6-9022-4d0f-a14f-bf1d66aa64c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Sep 02 09:53:54.605349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 521/1113] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:55.617071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-36b167a4-9e5a-4766-869b-c2d34fca4697 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:55.619823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-36b167a4-9e5a-4766-869b-c2d34fca4697 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:55.626179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36b167a4-9e5a-4766-869b-c2d34fca4697 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:55.626661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36b167a4-9e5a-4766-869b-c2d34fca4697 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:55.627127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36b167a4-9e5a-4766-869b-c2d34fca4697 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:55.627816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36b167a4-9e5a-4766-869b-c2d34fca4697 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:55.628271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36b167a4-9e5a-4766-869b-c2d34fca4697 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:55.628692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36b167a4-9e5a-4766-869b-c2d34fca4697 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:55.658958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-36b167a4-9e5a-4766-869b-c2d34fca4697 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Sep 02 09:53:55.659500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 593/1114] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:56.671772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e96cdda-36ef-4f7d-9fb5-8cf10282a61b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:56.673948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e96cdda-36ef-4f7d-9fb5-8cf10282a61b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:56.680247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e96cdda-36ef-4f7d-9fb5-8cf10282a61b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:56.680728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e96cdda-36ef-4f7d-9fb5-8cf10282a61b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:56.681162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e96cdda-36ef-4f7d-9fb5-8cf10282a61b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:56.681839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e96cdda-36ef-4f7d-9fb5-8cf10282a61b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:56.682291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e96cdda-36ef-4f7d-9fb5-8cf10282a61b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:56.682731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e96cdda-36ef-4f7d-9fb5-8cf10282a61b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:56.712536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e96cdda-36ef-4f7d-9fb5-8cf10282a61b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Sep 02 09:53:56.713601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 522/1115] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:57.725195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-08d19f10-8e59-4806-a698-88d57477011f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:57.727353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-08d19f10-8e59-4806-a698-88d57477011f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:57.734237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08d19f10-8e59-4806-a698-88d57477011f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:57.734745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08d19f10-8e59-4806-a698-88d57477011f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:57.735186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08d19f10-8e59-4806-a698-88d57477011f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:57.735877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08d19f10-8e59-4806-a698-88d57477011f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:57.736325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08d19f10-8e59-4806-a698-88d57477011f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:57.736748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08d19f10-8e59-4806-a698-88d57477011f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:57.765940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-08d19f10-8e59-4806-a698-88d57477011f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044741 Sep 02 09:53:57.766477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 594/1116] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:58.777642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-940e0d0b-efab-45bf-898d-b6c36d61244c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:58.779756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-940e0d0b-efab-45bf-898d-b6c36d61244c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:58.786188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940e0d0b-efab-45bf-898d-b6c36d61244c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:58.786673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940e0d0b-efab-45bf-898d-b6c36d61244c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:58.787143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940e0d0b-efab-45bf-898d-b6c36d61244c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:58.787822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940e0d0b-efab-45bf-898d-b6c36d61244c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:58.788277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940e0d0b-efab-45bf-898d-b6c36d61244c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:58.788705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-940e0d0b-efab-45bf-898d-b6c36d61244c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:58.817976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-940e0d0b-efab-45bf-898d-b6c36d61244c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044391 Sep 02 09:53:58.818541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 523/1117] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:53:59.830258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7c11702d-fd22-4117-be10-6c67d5bd4d43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:53:59.832364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7c11702d-fd22-4117-be10-6c67d5bd4d43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:53:59.834607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=30 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:53:59.839232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c11702d-fd22-4117-be10-6c67d5bd4d43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:59.839710 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c11702d-fd22-4117-be10-6c67d5bd4d43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:59.840151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c11702d-fd22-4117-be10-6c67d5bd4d43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:59.840840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c11702d-fd22-4117-be10-6c67d5bd4d43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:53:59.841286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c11702d-fd22-4117-be10-6c67d5bd4d43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:53:59.841704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c11702d-fd22-4117-be10-6c67d5bd4d43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:53:59.851021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=96 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:53:59.871592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7c11702d-fd22-4117-be10-6c67d5bd4d43 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045297 Sep 02 09:53:59.872349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 595/1118] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:53:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:00.883748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-260c0dc0-4291-43f2-bafe-50d415332552 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:00.886506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-260c0dc0-4291-43f2-bafe-50d415332552 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:00.893184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-260c0dc0-4291-43f2-bafe-50d415332552 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:00.893665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-260c0dc0-4291-43f2-bafe-50d415332552 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:00.894098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-260c0dc0-4291-43f2-bafe-50d415332552 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:00.894837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-260c0dc0-4291-43f2-bafe-50d415332552 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:00.895286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-260c0dc0-4291-43f2-bafe-50d415332552 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:00.895705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-260c0dc0-4291-43f2-bafe-50d415332552 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:00.923844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-260c0dc0-4291-43f2-bafe-50d415332552 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Sep 02 09:54:00.924384 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 524/1119] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:01.936556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f01343ae-d6e7-41ca-acbf-b0bd0a7cdcff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:01.938741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f01343ae-d6e7-41ca-acbf-b0bd0a7cdcff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:01.945556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f01343ae-d6e7-41ca-acbf-b0bd0a7cdcff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:01.946031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f01343ae-d6e7-41ca-acbf-b0bd0a7cdcff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:01.946462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f01343ae-d6e7-41ca-acbf-b0bd0a7cdcff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:01.947166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f01343ae-d6e7-41ca-acbf-b0bd0a7cdcff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:01.947616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f01343ae-d6e7-41ca-acbf-b0bd0a7cdcff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:01.948038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f01343ae-d6e7-41ca-acbf-b0bd0a7cdcff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:01.977221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f01343ae-d6e7-41ca-acbf-b0bd0a7cdcff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Sep 02 09:54:01.977761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 596/1120] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:02.989714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb2781ae-2e24-41e0-a094-aa1be7a1befa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:02.991869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb2781ae-2e24-41e0-a094-aa1be7a1befa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:02.993711 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=32 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:54:02.998956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb2781ae-2e24-41e0-a094-aa1be7a1befa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:02.999441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb2781ae-2e24-41e0-a094-aa1be7a1befa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:02.999883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb2781ae-2e24-41e0-a094-aa1be7a1befa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:03.000564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb2781ae-2e24-41e0-a094-aa1be7a1befa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:03.001018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb2781ae-2e24-41e0-a094-aa1be7a1befa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:03.001443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb2781ae-2e24-41e0-a094-aa1be7a1befa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:03.030696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb2781ae-2e24-41e0-a094-aa1be7a1befa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045137 Sep 02 09:54:03.031264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 525/1121] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:04.042891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-841d99e3-84a3-4e4a-9d9b-4c8dad29efe4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:04.044951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-841d99e3-84a3-4e4a-9d9b-4c8dad29efe4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:04.051378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-841d99e3-84a3-4e4a-9d9b-4c8dad29efe4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:04.051860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-841d99e3-84a3-4e4a-9d9b-4c8dad29efe4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:04.052291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-841d99e3-84a3-4e4a-9d9b-4c8dad29efe4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:04.052970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-841d99e3-84a3-4e4a-9d9b-4c8dad29efe4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:04.053417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-841d99e3-84a3-4e4a-9d9b-4c8dad29efe4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:04.053836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-841d99e3-84a3-4e4a-9d9b-4c8dad29efe4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:04.083366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-841d99e3-84a3-4e4a-9d9b-4c8dad29efe4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 Sep 02 09:54:04.084128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 597/1122] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:05.096133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-083931f3-fa7d-4139-95b5-356e59ff8838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:05.098228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-083931f3-fa7d-4139-95b5-356e59ff8838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:05.105131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-083931f3-fa7d-4139-95b5-356e59ff8838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:05.105609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-083931f3-fa7d-4139-95b5-356e59ff8838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:05.106038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-083931f3-fa7d-4139-95b5-356e59ff8838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:05.106734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-083931f3-fa7d-4139-95b5-356e59ff8838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:05.107178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-083931f3-fa7d-4139-95b5-356e59ff8838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:05.107594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-083931f3-fa7d-4139-95b5-356e59ff8838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:05.135838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-083931f3-fa7d-4139-95b5-356e59ff8838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Sep 02 09:54:05.136378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 526/1123] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:06.147737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ac71ac9d-eb57-4703-a31e-47ec1932cc48 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:06.149890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ac71ac9d-eb57-4703-a31e-47ec1932cc48 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:06.156186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac71ac9d-eb57-4703-a31e-47ec1932cc48 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:06.156667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac71ac9d-eb57-4703-a31e-47ec1932cc48 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:06.157100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac71ac9d-eb57-4703-a31e-47ec1932cc48 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:06.157780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac71ac9d-eb57-4703-a31e-47ec1932cc48 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:06.158226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac71ac9d-eb57-4703-a31e-47ec1932cc48 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:06.158655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac71ac9d-eb57-4703-a31e-47ec1932cc48 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:06.187839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ac71ac9d-eb57-4703-a31e-47ec1932cc48 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 Sep 02 09:54:06.188379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 598/1124] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:07.200132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-712d51ff-479b-430a-92ef-050d6db300c5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:07.202180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-712d51ff-479b-430a-92ef-050d6db300c5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:07.208703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712d51ff-479b-430a-92ef-050d6db300c5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:07.209187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712d51ff-479b-430a-92ef-050d6db300c5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:07.209627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712d51ff-479b-430a-92ef-050d6db300c5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:07.210314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712d51ff-479b-430a-92ef-050d6db300c5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:07.210803 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712d51ff-479b-430a-92ef-050d6db300c5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:07.211233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712d51ff-479b-430a-92ef-050d6db300c5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:07.240147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-712d51ff-479b-430a-92ef-050d6db300c5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044063 Sep 02 09:54:07.240680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 527/1125] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:08.253283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4d13ab9f-e3c1-4b69-bdff-8430779827a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:08.255390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4d13ab9f-e3c1-4b69-bdff-8430779827a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:08.261236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d13ab9f-e3c1-4b69-bdff-8430779827a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:08.261711 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d13ab9f-e3c1-4b69-bdff-8430779827a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:08.262141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d13ab9f-e3c1-4b69-bdff-8430779827a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:08.262847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d13ab9f-e3c1-4b69-bdff-8430779827a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:08.263296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d13ab9f-e3c1-4b69-bdff-8430779827a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:08.263716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d13ab9f-e3c1-4b69-bdff-8430779827a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:08.293053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4d13ab9f-e3c1-4b69-bdff-8430779827a4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Sep 02 09:54:08.293579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 599/1126] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:09.305318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ef901d5f-8883-44a9-bd6c-b5a9a456c272 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:09.307972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ef901d5f-8883-44a9-bd6c-b5a9a456c272 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:09.314558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef901d5f-8883-44a9-bd6c-b5a9a456c272 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:09.315072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef901d5f-8883-44a9-bd6c-b5a9a456c272 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:09.315499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef901d5f-8883-44a9-bd6c-b5a9a456c272 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:09.316186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef901d5f-8883-44a9-bd6c-b5a9a456c272 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:09.316618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef901d5f-8883-44a9-bd6c-b5a9a456c272 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:09.317035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef901d5f-8883-44a9-bd6c-b5a9a456c272 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:09.345358 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ef901d5f-8883-44a9-bd6c-b5a9a456c272 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Sep 02 09:54:09.345896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 528/1127] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:10.357492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bb41d449-a8be-4955-b61b-259039187551 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:10.359731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bb41d449-a8be-4955-b61b-259039187551 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:10.366058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb41d449-a8be-4955-b61b-259039187551 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:10.366542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb41d449-a8be-4955-b61b-259039187551 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:10.367025 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb41d449-a8be-4955-b61b-259039187551 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:10.367696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb41d449-a8be-4955-b61b-259039187551 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:10.368143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb41d449-a8be-4955-b61b-259039187551 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:10.368566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb41d449-a8be-4955-b61b-259039187551 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:10.398286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bb41d449-a8be-4955-b61b-259039187551 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Sep 02 09:54:10.398841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 600/1128] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:11.410511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-25e7f084-7003-4743-84ed-c06977900bd6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:11.412614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-25e7f084-7003-4743-84ed-c06977900bd6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:11.419026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e7f084-7003-4743-84ed-c06977900bd6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:11.419508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e7f084-7003-4743-84ed-c06977900bd6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:11.419941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e7f084-7003-4743-84ed-c06977900bd6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:11.420618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e7f084-7003-4743-84ed-c06977900bd6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:11.421067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e7f084-7003-4743-84ed-c06977900bd6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:11.421488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25e7f084-7003-4743-84ed-c06977900bd6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:11.450386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-25e7f084-7003-4743-84ed-c06977900bd6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Sep 02 09:54:11.450958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 529/1129] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:12.462652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bdd21e24-9722-4e6c-ad86-b7dadbf89023 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:12.464715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bdd21e24-9722-4e6c-ad86-b7dadbf89023 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:12.471281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdd21e24-9722-4e6c-ad86-b7dadbf89023 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:12.471770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdd21e24-9722-4e6c-ad86-b7dadbf89023 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:12.472208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdd21e24-9722-4e6c-ad86-b7dadbf89023 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:12.472903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdd21e24-9722-4e6c-ad86-b7dadbf89023 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:12.473366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdd21e24-9722-4e6c-ad86-b7dadbf89023 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:12.473810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bdd21e24-9722-4e6c-ad86-b7dadbf89023 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:12.503470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bdd21e24-9722-4e6c-ad86-b7dadbf89023 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Sep 02 09:54:12.504025 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 601/1130] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:13.516517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-52f814c4-c6af-4937-a78c-289b8ec9c015 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:13.518597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-52f814c4-c6af-4937-a78c-289b8ec9c015 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:13.525029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f814c4-c6af-4937-a78c-289b8ec9c015 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:13.525509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f814c4-c6af-4937-a78c-289b8ec9c015 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:13.525985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f814c4-c6af-4937-a78c-289b8ec9c015 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:13.526667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f814c4-c6af-4937-a78c-289b8ec9c015 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:13.527147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f814c4-c6af-4937-a78c-289b8ec9c015 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:13.527571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f814c4-c6af-4937-a78c-289b8ec9c015 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:13.556053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-52f814c4-c6af-4937-a78c-289b8ec9c015 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Sep 02 09:54:13.556600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 530/1131] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:14.569141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-472b3e90-0aa7-425b-8eec-2bc06c8f91d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:14.571224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-472b3e90-0aa7-425b-8eec-2bc06c8f91d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:14.578124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-472b3e90-0aa7-425b-8eec-2bc06c8f91d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:14.578602 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-472b3e90-0aa7-425b-8eec-2bc06c8f91d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:14.579067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-472b3e90-0aa7-425b-8eec-2bc06c8f91d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:14.579743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-472b3e90-0aa7-425b-8eec-2bc06c8f91d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:14.580214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-472b3e90-0aa7-425b-8eec-2bc06c8f91d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:14.580903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-472b3e90-0aa7-425b-8eec-2bc06c8f91d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:14.610033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-472b3e90-0aa7-425b-8eec-2bc06c8f91d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045296 Sep 02 09:54:14.610576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 602/1132] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:15.622733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a4048ae1-962f-4af6-8ee3-69cb796c6331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:15.624845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a4048ae1-962f-4af6-8ee3-69cb796c6331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:15.631184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4048ae1-962f-4af6-8ee3-69cb796c6331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:15.631660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4048ae1-962f-4af6-8ee3-69cb796c6331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:15.632091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4048ae1-962f-4af6-8ee3-69cb796c6331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:15.632760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4048ae1-962f-4af6-8ee3-69cb796c6331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:15.633206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4048ae1-962f-4af6-8ee3-69cb796c6331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:15.633623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4048ae1-962f-4af6-8ee3-69cb796c6331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:15.664722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a4048ae1-962f-4af6-8ee3-69cb796c6331 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046416 Sep 02 09:54:15.665272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 531/1133] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:16.677184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4b4ff762-b3de-42cb-b827-b297f2e39177 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:16.679294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4b4ff762-b3de-42cb-b827-b297f2e39177 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:16.685584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b4ff762-b3de-42cb-b827-b297f2e39177 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:16.686060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b4ff762-b3de-42cb-b827-b297f2e39177 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:16.686491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b4ff762-b3de-42cb-b827-b297f2e39177 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:16.687193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b4ff762-b3de-42cb-b827-b297f2e39177 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:16.687641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b4ff762-b3de-42cb-b827-b297f2e39177 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:16.688063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b4ff762-b3de-42cb-b827-b297f2e39177 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:16.717677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4b4ff762-b3de-42cb-b827-b297f2e39177 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Sep 02 09:54:16.718234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 603/1134] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:17.734971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d7a30337-5975-40ef-a77e-b74ba84e5408 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:17.737083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d7a30337-5975-40ef-a77e-b74ba84e5408 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:17.743450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7a30337-5975-40ef-a77e-b74ba84e5408 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:17.743927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7a30337-5975-40ef-a77e-b74ba84e5408 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:17.744353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7a30337-5975-40ef-a77e-b74ba84e5408 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:17.745805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7a30337-5975-40ef-a77e-b74ba84e5408 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:17.746280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7a30337-5975-40ef-a77e-b74ba84e5408 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:17.746724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7a30337-5975-40ef-a77e-b74ba84e5408 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:17.775214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d7a30337-5975-40ef-a77e-b74ba84e5408 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Sep 02 09:54:17.776241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 532/1135] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:18.788066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-01ac532e-87e7-4b7e-ae8b-95566c9704b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:18.790132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-01ac532e-87e7-4b7e-ae8b-95566c9704b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:18.797135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-01ac532e-87e7-4b7e-ae8b-95566c9704b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:18.797613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-01ac532e-87e7-4b7e-ae8b-95566c9704b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:18.798048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-01ac532e-87e7-4b7e-ae8b-95566c9704b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:18.798737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-01ac532e-87e7-4b7e-ae8b-95566c9704b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:18.799184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-01ac532e-87e7-4b7e-ae8b-95566c9704b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:18.799603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-01ac532e-87e7-4b7e-ae8b-95566c9704b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:18.827961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-01ac532e-87e7-4b7e-ae8b-95566c9704b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 Sep 02 09:54:18.828493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 604/1136] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:19.839867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-985ac28b-e379-4ac0-899d-ed4fd5f40f9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:19.842020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-985ac28b-e379-4ac0-899d-ed4fd5f40f9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:19.851316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-985ac28b-e379-4ac0-899d-ed4fd5f40f9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:19.851316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-985ac28b-e379-4ac0-899d-ed4fd5f40f9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:19.851316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-985ac28b-e379-4ac0-899d-ed4fd5f40f9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:19.851316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-985ac28b-e379-4ac0-899d-ed4fd5f40f9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:19.851768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-985ac28b-e379-4ac0-899d-ed4fd5f40f9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:19.851768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-985ac28b-e379-4ac0-899d-ed4fd5f40f9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:19.881250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-985ac28b-e379-4ac0-899d-ed4fd5f40f9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045356 Sep 02 09:54:19.881792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 533/1137] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:20.893548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-95832c8f-834d-4f7b-8b2f-939078843955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:20.895794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-95832c8f-834d-4f7b-8b2f-939078843955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:20.902559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95832c8f-834d-4f7b-8b2f-939078843955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:20.903065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95832c8f-834d-4f7b-8b2f-939078843955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:20.903498 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95832c8f-834d-4f7b-8b2f-939078843955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:20.904179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95832c8f-834d-4f7b-8b2f-939078843955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:20.904623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95832c8f-834d-4f7b-8b2f-939078843955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:20.905044 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95832c8f-834d-4f7b-8b2f-939078843955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:20.934646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-95832c8f-834d-4f7b-8b2f-939078843955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 Sep 02 09:54:20.935211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 605/1138] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:21.946538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3cb7825-06b4-4e8d-adc1-35cdbb136ff4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:21.948684 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3cb7825-06b4-4e8d-adc1-35cdbb136ff4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:21.955149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cb7825-06b4-4e8d-adc1-35cdbb136ff4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:21.959100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cb7825-06b4-4e8d-adc1-35cdbb136ff4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:21.959100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cb7825-06b4-4e8d-adc1-35cdbb136ff4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:21.959100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cb7825-06b4-4e8d-adc1-35cdbb136ff4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:21.959100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cb7825-06b4-4e8d-adc1-35cdbb136ff4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:21.959508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3cb7825-06b4-4e8d-adc1-35cdbb136ff4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:21.987303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3cb7825-06b4-4e8d-adc1-35cdbb136ff4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Sep 02 09:54:21.987863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 534/1139] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:23.000025 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0933edbf-873d-4aa9-abfb-2ac983edf6e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:23.002107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0933edbf-873d-4aa9-abfb-2ac983edf6e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:23.008688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0933edbf-873d-4aa9-abfb-2ac983edf6e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:23.009173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0933edbf-873d-4aa9-abfb-2ac983edf6e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:23.009612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0933edbf-873d-4aa9-abfb-2ac983edf6e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:23.010298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0933edbf-873d-4aa9-abfb-2ac983edf6e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:23.010810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0933edbf-873d-4aa9-abfb-2ac983edf6e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:23.011236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0933edbf-873d-4aa9-abfb-2ac983edf6e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:23.040422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0933edbf-873d-4aa9-abfb-2ac983edf6e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 Sep 02 09:54:23.040981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 606/1140] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:24.053442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-08b65453-0cc1-4767-a435-585c4c4af8fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:24.055571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-08b65453-0cc1-4767-a435-585c4c4af8fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:24.062458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b65453-0cc1-4767-a435-585c4c4af8fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:24.062973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b65453-0cc1-4767-a435-585c4c4af8fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:24.063409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b65453-0cc1-4767-a435-585c4c4af8fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:24.064090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b65453-0cc1-4767-a435-585c4c4af8fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:24.064539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b65453-0cc1-4767-a435-585c4c4af8fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:24.064962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b65453-0cc1-4767-a435-585c4c4af8fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:24.067315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=90 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:54:24.094699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-08b65453-0cc1-4767-a435-585c4c4af8fa tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045337 Sep 02 09:54:24.095446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 535/1141] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:25.107544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ff2c8e28-812b-4d1a-9583-2a753add8ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:25.109687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ff2c8e28-812b-4d1a-9583-2a753add8ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:25.116125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff2c8e28-812b-4d1a-9583-2a753add8ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:25.116607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff2c8e28-812b-4d1a-9583-2a753add8ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:25.117042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff2c8e28-812b-4d1a-9583-2a753add8ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:25.117723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff2c8e28-812b-4d1a-9583-2a753add8ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:25.118180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff2c8e28-812b-4d1a-9583-2a753add8ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:25.118606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ff2c8e28-812b-4d1a-9583-2a753add8ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:25.147680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ff2c8e28-812b-4d1a-9583-2a753add8ed1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Sep 02 09:54:25.148219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 607/1142] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:25 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:26.159742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c5845b56-b47a-4a36-a16c-2cc4655e1abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:26.161850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c5845b56-b47a-4a36-a16c-2cc4655e1abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:26.168187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5845b56-b47a-4a36-a16c-2cc4655e1abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:26.168664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5845b56-b47a-4a36-a16c-2cc4655e1abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:26.169095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5845b56-b47a-4a36-a16c-2cc4655e1abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:26.169767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5845b56-b47a-4a36-a16c-2cc4655e1abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:26.170210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5845b56-b47a-4a36-a16c-2cc4655e1abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:26.170627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5845b56-b47a-4a36-a16c-2cc4655e1abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:26.199946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c5845b56-b47a-4a36-a16c-2cc4655e1abc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Sep 02 09:54:26.200491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 536/1143] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:26 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:27.212056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2b85068b-d568-466d-be6d-0f528b88c5f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:27.214823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2b85068b-d568-466d-be6d-0f528b88c5f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:27.221165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b85068b-d568-466d-be6d-0f528b88c5f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:27.221644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b85068b-d568-466d-be6d-0f528b88c5f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:27.222081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b85068b-d568-466d-be6d-0f528b88c5f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:27.222789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b85068b-d568-466d-be6d-0f528b88c5f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:27.223241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b85068b-d568-466d-be6d-0f528b88c5f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:27.223665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b85068b-d568-466d-be6d-0f528b88c5f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:27.251945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2b85068b-d568-466d-be6d-0f528b88c5f4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Sep 02 09:54:27.252476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 608/1144] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:28.263975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3546cda0-c283-4bbc-b136-b3745ae00f50 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:28.266304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3546cda0-c283-4bbc-b136-b3745ae00f50 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:28.272683 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3546cda0-c283-4bbc-b136-b3745ae00f50 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:28.273155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3546cda0-c283-4bbc-b136-b3745ae00f50 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:28.273582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3546cda0-c283-4bbc-b136-b3745ae00f50 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:28.274251 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3546cda0-c283-4bbc-b136-b3745ae00f50 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:28.274695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3546cda0-c283-4bbc-b136-b3745ae00f50 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:28.275133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3546cda0-c283-4bbc-b136-b3745ae00f50 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:28.304258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3546cda0-c283-4bbc-b136-b3745ae00f50 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Sep 02 09:54:28.304787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 537/1145] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:29.315834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c55b2fb8-621e-42b7-b8fe-52e28f057ce1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:29.317884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c55b2fb8-621e-42b7-b8fe-52e28f057ce1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:29.324273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c55b2fb8-621e-42b7-b8fe-52e28f057ce1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:29.324747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c55b2fb8-621e-42b7-b8fe-52e28f057ce1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:29.325184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c55b2fb8-621e-42b7-b8fe-52e28f057ce1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:29.325856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c55b2fb8-621e-42b7-b8fe-52e28f057ce1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:29.326301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c55b2fb8-621e-42b7-b8fe-52e28f057ce1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:29.326741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c55b2fb8-621e-42b7-b8fe-52e28f057ce1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:29.356472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c55b2fb8-621e-42b7-b8fe-52e28f057ce1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Sep 02 09:54:29.357026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 609/1146] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:30.368107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5bd2c08a-ad7c-4a26-8430-468cb63f3d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:30.370807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5bd2c08a-ad7c-4a26-8430-468cb63f3d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:30.377174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bd2c08a-ad7c-4a26-8430-468cb63f3d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:30.377652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bd2c08a-ad7c-4a26-8430-468cb63f3d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:30.378083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bd2c08a-ad7c-4a26-8430-468cb63f3d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:30.378782 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bd2c08a-ad7c-4a26-8430-468cb63f3d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:30.379232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bd2c08a-ad7c-4a26-8430-468cb63f3d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:30.379648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bd2c08a-ad7c-4a26-8430-468cb63f3d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:30.407863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5bd2c08a-ad7c-4a26-8430-468cb63f3d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Sep 02 09:54:30.408398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 538/1147] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:31.420081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0e9a23a2-6b3b-4cf2-81bd-c5c85cf0ed5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:31.422127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0e9a23a2-6b3b-4cf2-81bd-c5c85cf0ed5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:31.428425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e9a23a2-6b3b-4cf2-81bd-c5c85cf0ed5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:31.428896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e9a23a2-6b3b-4cf2-81bd-c5c85cf0ed5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:31.429325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e9a23a2-6b3b-4cf2-81bd-c5c85cf0ed5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:31.430003 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e9a23a2-6b3b-4cf2-81bd-c5c85cf0ed5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:31.430446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e9a23a2-6b3b-4cf2-81bd-c5c85cf0ed5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:31.430896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e9a23a2-6b3b-4cf2-81bd-c5c85cf0ed5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:31.460108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0e9a23a2-6b3b-4cf2-81bd-c5c85cf0ed5b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044073 Sep 02 09:54:31.460650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 610/1148] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:32.471952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7aebd929-e003-41d8-9ce0-d921aff30a17 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:32.474016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7aebd929-e003-41d8-9ce0-d921aff30a17 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:32.480093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aebd929-e003-41d8-9ce0-d921aff30a17 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:32.482850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aebd929-e003-41d8-9ce0-d921aff30a17 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:32.482850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aebd929-e003-41d8-9ce0-d921aff30a17 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:32.482850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aebd929-e003-41d8-9ce0-d921aff30a17 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:32.482850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aebd929-e003-41d8-9ce0-d921aff30a17 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:32.483245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7aebd929-e003-41d8-9ce0-d921aff30a17 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:32.511139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7aebd929-e003-41d8-9ce0-d921aff30a17 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043228 Sep 02 09:54:32.511682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 539/1149] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:33.523510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1a9c9883-d88d-4426-906e-2452cea22d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:33.526102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1a9c9883-d88d-4426-906e-2452cea22d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:33.528405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=32 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:54:33.533113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a9c9883-d88d-4426-906e-2452cea22d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:33.533595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a9c9883-d88d-4426-906e-2452cea22d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:33.534023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a9c9883-d88d-4426-906e-2452cea22d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:33.534700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a9c9883-d88d-4426-906e-2452cea22d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:33.535166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a9c9883-d88d-4426-906e-2452cea22d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:33.535584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1a9c9883-d88d-4426-906e-2452cea22d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:33.537887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=96 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:54:33.566518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1a9c9883-d88d-4426-906e-2452cea22d73 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047033 Sep 02 09:54:33.567078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 611/1150] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:34.578903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9fdf72dd-5440-4b86-91b5-9df9aba7c17f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:34.580963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9fdf72dd-5440-4b86-91b5-9df9aba7c17f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:34.587353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fdf72dd-5440-4b86-91b5-9df9aba7c17f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:34.588352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fdf72dd-5440-4b86-91b5-9df9aba7c17f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:34.588786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fdf72dd-5440-4b86-91b5-9df9aba7c17f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:34.589462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fdf72dd-5440-4b86-91b5-9df9aba7c17f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:34.589909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fdf72dd-5440-4b86-91b5-9df9aba7c17f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:34.590330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9fdf72dd-5440-4b86-91b5-9df9aba7c17f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:34.619152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9fdf72dd-5440-4b86-91b5-9df9aba7c17f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Sep 02 09:54:34.619693 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 540/1151] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:35.631074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-965b6037-2a42-44bf-b5d1-f81505435d0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:35.633193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-965b6037-2a42-44bf-b5d1-f81505435d0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:35.640389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-965b6037-2a42-44bf-b5d1-f81505435d0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:35.640865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-965b6037-2a42-44bf-b5d1-f81505435d0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:35.641298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-965b6037-2a42-44bf-b5d1-f81505435d0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:35.641973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-965b6037-2a42-44bf-b5d1-f81505435d0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:35.642422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-965b6037-2a42-44bf-b5d1-f81505435d0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:35.642863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-965b6037-2a42-44bf-b5d1-f81505435d0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:35.671347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-965b6037-2a42-44bf-b5d1-f81505435d0f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Sep 02 09:54:35.671881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 612/1152] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:36.684058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-712ff5ec-72e3-4c80-9a34-54f667343d4a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:36.686098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-712ff5ec-72e3-4c80-9a34-54f667343d4a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:36.688437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=32 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:54:36.693051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712ff5ec-72e3-4c80-9a34-54f667343d4a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:36.693534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712ff5ec-72e3-4c80-9a34-54f667343d4a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:36.693970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712ff5ec-72e3-4c80-9a34-54f667343d4a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:36.694652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712ff5ec-72e3-4c80-9a34-54f667343d4a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:36.695129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712ff5ec-72e3-4c80-9a34-54f667343d4a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:36.695551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712ff5ec-72e3-4c80-9a34-54f667343d4a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:36.725615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-712ff5ec-72e3-4c80-9a34-54f667343d4a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046028 Sep 02 09:54:36.726329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 541/1153] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:37.738570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c92fafe4-5966-42c6-8026-90a52ce82130 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:37.739691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c92fafe4-5966-42c6-8026-90a52ce82130 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:37.745629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92fafe4-5966-42c6-8026-90a52ce82130 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:37.746105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92fafe4-5966-42c6-8026-90a52ce82130 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:37.746534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92fafe4-5966-42c6-8026-90a52ce82130 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:37.747241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92fafe4-5966-42c6-8026-90a52ce82130 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:37.747685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92fafe4-5966-42c6-8026-90a52ce82130 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:37.748102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c92fafe4-5966-42c6-8026-90a52ce82130 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:37.777727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c92fafe4-5966-42c6-8026-90a52ce82130 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Sep 02 09:54:37.778261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 613/1154] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:38.790050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c924863c-e523-4efb-95a0-79888033f24b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:38.792156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c924863c-e523-4efb-95a0-79888033f24b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:38.798651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c924863c-e523-4efb-95a0-79888033f24b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:38.799173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c924863c-e523-4efb-95a0-79888033f24b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:38.799608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c924863c-e523-4efb-95a0-79888033f24b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:38.800300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c924863c-e523-4efb-95a0-79888033f24b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:38.800754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c924863c-e523-4efb-95a0-79888033f24b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:38.801177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c924863c-e523-4efb-95a0-79888033f24b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:38.830557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c924863c-e523-4efb-95a0-79888033f24b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Sep 02 09:54:38.831122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 542/1155] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:39.842720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d2ae30c9-2c18-4446-b5b9-a85f1289fcc2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:39.844794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d2ae30c9-2c18-4446-b5b9-a85f1289fcc2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:39.851188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d2ae30c9-2c18-4446-b5b9-a85f1289fcc2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:39.851671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d2ae30c9-2c18-4446-b5b9-a85f1289fcc2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:39.852107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d2ae30c9-2c18-4446-b5b9-a85f1289fcc2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:39.852795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d2ae30c9-2c18-4446-b5b9-a85f1289fcc2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:39.853244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d2ae30c9-2c18-4446-b5b9-a85f1289fcc2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:39.853667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d2ae30c9-2c18-4446-b5b9-a85f1289fcc2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:39.883592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d2ae30c9-2c18-4446-b5b9-a85f1289fcc2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Sep 02 09:54:39.884144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 614/1156] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:40.895325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ac1057e1-4aeb-4664-bc54-035e444781b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:40.897379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ac1057e1-4aeb-4664-bc54-035e444781b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:40.904452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac1057e1-4aeb-4664-bc54-035e444781b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:40.904927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac1057e1-4aeb-4664-bc54-035e444781b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:40.905355 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac1057e1-4aeb-4664-bc54-035e444781b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:40.906031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac1057e1-4aeb-4664-bc54-035e444781b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:40.906484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac1057e1-4aeb-4664-bc54-035e444781b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:40.906932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac1057e1-4aeb-4664-bc54-035e444781b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:40.935218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ac1057e1-4aeb-4664-bc54-035e444781b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043862 Sep 02 09:54:40.935754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 543/1157] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:41.947617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b86ccccb-3450-42bb-bb99-bb467280af45 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:41.950339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b86ccccb-3450-42bb-bb99-bb467280af45 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:41.956791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b86ccccb-3450-42bb-bb99-bb467280af45 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:41.957273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b86ccccb-3450-42bb-bb99-bb467280af45 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:41.957705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b86ccccb-3450-42bb-bb99-bb467280af45 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:41.958393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b86ccccb-3450-42bb-bb99-bb467280af45 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:41.958880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b86ccccb-3450-42bb-bb99-bb467280af45 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:41.959307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b86ccccb-3450-42bb-bb99-bb467280af45 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:41.987859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b86ccccb-3450-42bb-bb99-bb467280af45 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Sep 02 09:54:41.988412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 615/1158] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:43.000617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5b58a6d8-2b17-4606-837f-9d662916e5f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:43.002678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5b58a6d8-2b17-4606-837f-9d662916e5f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:43.009058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b58a6d8-2b17-4606-837f-9d662916e5f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:43.009533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b58a6d8-2b17-4606-837f-9d662916e5f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:43.009964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b58a6d8-2b17-4606-837f-9d662916e5f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:43.010639 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b58a6d8-2b17-4606-837f-9d662916e5f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:43.011110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b58a6d8-2b17-4606-837f-9d662916e5f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:43.011526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b58a6d8-2b17-4606-837f-9d662916e5f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:43.041036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5b58a6d8-2b17-4606-837f-9d662916e5f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Sep 02 09:54:43.041578 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 544/1159] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:44.053355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f9c9b42a-625d-4dff-8ebd-6ac5a48cdbf4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:44.055475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f9c9b42a-625d-4dff-8ebd-6ac5a48cdbf4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:44.061881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9c9b42a-625d-4dff-8ebd-6ac5a48cdbf4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:44.062369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9c9b42a-625d-4dff-8ebd-6ac5a48cdbf4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:44.062845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9c9b42a-625d-4dff-8ebd-6ac5a48cdbf4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:44.063534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9c9b42a-625d-4dff-8ebd-6ac5a48cdbf4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:44.063989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9c9b42a-625d-4dff-8ebd-6ac5a48cdbf4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:44.064416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9c9b42a-625d-4dff-8ebd-6ac5a48cdbf4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:44.094301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f9c9b42a-625d-4dff-8ebd-6ac5a48cdbf4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Sep 02 09:54:44.094891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 616/1160] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:45.108898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-87c1d10b-0117-4d79-a1d5-0c9e56ceb576 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:45.110970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-87c1d10b-0117-4d79-a1d5-0c9e56ceb576 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:45.117321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87c1d10b-0117-4d79-a1d5-0c9e56ceb576 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:45.117795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87c1d10b-0117-4d79-a1d5-0c9e56ceb576 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:45.118223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87c1d10b-0117-4d79-a1d5-0c9e56ceb576 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:45.118934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87c1d10b-0117-4d79-a1d5-0c9e56ceb576 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:45.119382 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87c1d10b-0117-4d79-a1d5-0c9e56ceb576 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:45.119798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87c1d10b-0117-4d79-a1d5-0c9e56ceb576 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:45.149064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-87c1d10b-0117-4d79-a1d5-0c9e56ceb576 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046478 Sep 02 09:54:45.149657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 545/1161] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:46.161294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fed6eb98-f428-4291-b29a-84bbc9209ec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:46.163433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fed6eb98-f428-4291-b29a-84bbc9209ec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:46.169913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fed6eb98-f428-4291-b29a-84bbc9209ec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:46.170397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fed6eb98-f428-4291-b29a-84bbc9209ec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:46.170862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fed6eb98-f428-4291-b29a-84bbc9209ec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:46.171546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fed6eb98-f428-4291-b29a-84bbc9209ec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:46.171993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fed6eb98-f428-4291-b29a-84bbc9209ec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:46.172412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fed6eb98-f428-4291-b29a-84bbc9209ec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:46.202382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fed6eb98-f428-4291-b29a-84bbc9209ec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045034 Sep 02 09:54:46.202963 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 617/1162] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:47.214561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-65914b05-682e-429b-ab32-c50993a201d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:47.217171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-65914b05-682e-429b-ab32-c50993a201d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:47.223481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65914b05-682e-429b-ab32-c50993a201d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:47.223957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65914b05-682e-429b-ab32-c50993a201d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:47.224387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65914b05-682e-429b-ab32-c50993a201d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:47.225057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65914b05-682e-429b-ab32-c50993a201d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:47.225509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65914b05-682e-429b-ab32-c50993a201d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:47.225928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65914b05-682e-429b-ab32-c50993a201d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:47.255076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-65914b05-682e-429b-ab32-c50993a201d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Sep 02 09:54:47.255618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 546/1163] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 09:54:48.267482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3553e1f4-f57b-4467-8079-a49b27764b78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:48.269632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3553e1f4-f57b-4467-8079-a49b27764b78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:48.275903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3553e1f4-f57b-4467-8079-a49b27764b78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:48.276374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3553e1f4-f57b-4467-8079-a49b27764b78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:48.276802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3553e1f4-f57b-4467-8079-a49b27764b78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:48.277474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3553e1f4-f57b-4467-8079-a49b27764b78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:48.277953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3553e1f4-f57b-4467-8079-a49b27764b78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:48.278367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3553e1f4-f57b-4467-8079-a49b27764b78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:48.306806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3553e1f4-f57b-4467-8079-a49b27764b78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043467 Sep 02 09:54:48.307338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 618/1164] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:49.318942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fbf45827-3471-49e0-8239-54d3876cd230 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:49.321076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fbf45827-3471-49e0-8239-54d3876cd230 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:49.328079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fbf45827-3471-49e0-8239-54d3876cd230 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:49.328557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fbf45827-3471-49e0-8239-54d3876cd230 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:49.328992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fbf45827-3471-49e0-8239-54d3876cd230 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:49.329670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fbf45827-3471-49e0-8239-54d3876cd230 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:49.330121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fbf45827-3471-49e0-8239-54d3876cd230 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:49.330547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fbf45827-3471-49e0-8239-54d3876cd230 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:49.359030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fbf45827-3471-49e0-8239-54d3876cd230 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Sep 02 09:54:49.359571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 547/1165] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:50.370619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8b8c37e4-73f8-49c4-a4ee-93002142dfa1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:50.372753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8b8c37e4-73f8-49c4-a4ee-93002142dfa1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:50.379012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b8c37e4-73f8-49c4-a4ee-93002142dfa1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:50.379488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b8c37e4-73f8-49c4-a4ee-93002142dfa1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:50.379920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b8c37e4-73f8-49c4-a4ee-93002142dfa1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:50.380592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b8c37e4-73f8-49c4-a4ee-93002142dfa1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:50.381035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b8c37e4-73f8-49c4-a4ee-93002142dfa1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:50.381452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b8c37e4-73f8-49c4-a4ee-93002142dfa1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:50.410891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8b8c37e4-73f8-49c4-a4ee-93002142dfa1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 Sep 02 09:54:50.411427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 619/1166] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:51.423666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e1314b05-ec87-4d12-ba4f-e51e3c69330b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:51.425824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e1314b05-ec87-4d12-ba4f-e51e3c69330b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:51.432245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1314b05-ec87-4d12-ba4f-e51e3c69330b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:51.432724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1314b05-ec87-4d12-ba4f-e51e3c69330b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:51.433160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1314b05-ec87-4d12-ba4f-e51e3c69330b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:51.433838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1314b05-ec87-4d12-ba4f-e51e3c69330b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:51.434286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1314b05-ec87-4d12-ba4f-e51e3c69330b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:51.434726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e1314b05-ec87-4d12-ba4f-e51e3c69330b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:51.463788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e1314b05-ec87-4d12-ba4f-e51e3c69330b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Sep 02 09:54:51.464327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 548/1167] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:52.476528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-12321014-2496-4855-b5a2-3835a0b73840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:52.478695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-12321014-2496-4855-b5a2-3835a0b73840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:52.485677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12321014-2496-4855-b5a2-3835a0b73840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:52.486162 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12321014-2496-4855-b5a2-3835a0b73840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:52.486602 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12321014-2496-4855-b5a2-3835a0b73840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:52.487329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12321014-2496-4855-b5a2-3835a0b73840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:52.487773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12321014-2496-4855-b5a2-3835a0b73840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:52.488202 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12321014-2496-4855-b5a2-3835a0b73840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:52.517693 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-12321014-2496-4855-b5a2-3835a0b73840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045328 Sep 02 09:54:52.518230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 620/1168] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:53.529736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-52f7ee85-ec3c-4343-a0c5-8c5f2a269729 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:53.532462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-52f7ee85-ec3c-4343-a0c5-8c5f2a269729 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:53.538945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f7ee85-ec3c-4343-a0c5-8c5f2a269729 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:53.539424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f7ee85-ec3c-4343-a0c5-8c5f2a269729 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:53.539855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f7ee85-ec3c-4343-a0c5-8c5f2a269729 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:53.540534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f7ee85-ec3c-4343-a0c5-8c5f2a269729 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:53.540983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f7ee85-ec3c-4343-a0c5-8c5f2a269729 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:53.541405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52f7ee85-ec3c-4343-a0c5-8c5f2a269729 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:53.570332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-52f7ee85-ec3c-4343-a0c5-8c5f2a269729 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Sep 02 09:54:53.570904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 549/1169] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:54.582378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6b06f456-bd59-493a-9e44-e5011c731598 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:54.584548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6b06f456-bd59-493a-9e44-e5011c731598 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:54.590921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6b06f456-bd59-493a-9e44-e5011c731598 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:54.591409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6b06f456-bd59-493a-9e44-e5011c731598 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:54.591851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6b06f456-bd59-493a-9e44-e5011c731598 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:54.592544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6b06f456-bd59-493a-9e44-e5011c731598 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:54.593487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6b06f456-bd59-493a-9e44-e5011c731598 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:54.593913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6b06f456-bd59-493a-9e44-e5011c731598 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:54.624253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6b06f456-bd59-493a-9e44-e5011c731598 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045700 Sep 02 09:54:54.624828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 621/1170] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:55.638625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6f20bcbf-9c6f-4a35-948c-0b49cd2fee61 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:55.641147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6f20bcbf-9c6f-4a35-948c-0b49cd2fee61 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:55.647496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f20bcbf-9c6f-4a35-948c-0b49cd2fee61 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:55.647975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f20bcbf-9c6f-4a35-948c-0b49cd2fee61 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:55.648402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f20bcbf-9c6f-4a35-948c-0b49cd2fee61 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:55.649072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f20bcbf-9c6f-4a35-948c-0b49cd2fee61 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:55.649515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f20bcbf-9c6f-4a35-948c-0b49cd2fee61 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:55.649925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f20bcbf-9c6f-4a35-948c-0b49cd2fee61 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:55.678833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6f20bcbf-9c6f-4a35-948c-0b49cd2fee61 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044232 Sep 02 09:54:55.679387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 550/1171] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:56.691510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7850b79f-c92f-419a-9022-c0d5c22e1491 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:56.693673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7850b79f-c92f-419a-9022-c0d5c22e1491 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:56.700145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7850b79f-c92f-419a-9022-c0d5c22e1491 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:56.700634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7850b79f-c92f-419a-9022-c0d5c22e1491 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:56.701068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7850b79f-c92f-419a-9022-c0d5c22e1491 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:56.701763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7850b79f-c92f-419a-9022-c0d5c22e1491 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:56.702214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7850b79f-c92f-419a-9022-c0d5c22e1491 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:56.703266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7850b79f-c92f-419a-9022-c0d5c22e1491 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:56.732623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7850b79f-c92f-419a-9022-c0d5c22e1491 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045556 Sep 02 09:54:56.733172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 622/1172] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:57.744663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-84977613-c03f-415b-92fe-aae6894d62b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:57.746812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-84977613-c03f-415b-92fe-aae6894d62b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:57.753157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84977613-c03f-415b-92fe-aae6894d62b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:57.753633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84977613-c03f-415b-92fe-aae6894d62b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:57.754068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84977613-c03f-415b-92fe-aae6894d62b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:57.754771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84977613-c03f-415b-92fe-aae6894d62b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:57.755255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84977613-c03f-415b-92fe-aae6894d62b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:57.755675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84977613-c03f-415b-92fe-aae6894d62b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:57.758004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=96 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:54:57.786036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-84977613-c03f-415b-92fe-aae6894d62b5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Sep 02 09:54:57.786591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 551/1173] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:58.798533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-630ea184-9cd4-48c6-a563-446f1e38ba59 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:58.800711 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-630ea184-9cd4-48c6-a563-446f1e38ba59 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:58.807054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-630ea184-9cd4-48c6-a563-446f1e38ba59 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:58.807542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-630ea184-9cd4-48c6-a563-446f1e38ba59 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:58.807984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-630ea184-9cd4-48c6-a563-446f1e38ba59 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:58.808669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-630ea184-9cd4-48c6-a563-446f1e38ba59 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:58.809124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-630ea184-9cd4-48c6-a563-446f1e38ba59 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:58.809547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-630ea184-9cd4-48c6-a563-446f1e38ba59 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:58.839787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-630ea184-9cd4-48c6-a563-446f1e38ba59 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Sep 02 09:54:58.839787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 623/1174] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:54:59.852138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-23041933-0189-4052-9344-ebbf22f285da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:54:59.854264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-23041933-0189-4052-9344-ebbf22f285da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:54:59.861209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23041933-0189-4052-9344-ebbf22f285da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:59.861695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23041933-0189-4052-9344-ebbf22f285da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:59.862130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23041933-0189-4052-9344-ebbf22f285da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:59.862859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23041933-0189-4052-9344-ebbf22f285da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:54:59.863312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23041933-0189-4052-9344-ebbf22f285da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:54:59.863735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-23041933-0189-4052-9344-ebbf22f285da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:54:59.894130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-23041933-0189-4052-9344-ebbf22f285da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045921 Sep 02 09:54:59.894715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 552/1175] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:54:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:00.906753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7849367d-1dc9-43a6-a341-faf9a355421e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:00.908883 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7849367d-1dc9-43a6-a341-faf9a355421e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:00.915324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7849367d-1dc9-43a6-a341-faf9a355421e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:00.915804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7849367d-1dc9-43a6-a341-faf9a355421e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:00.916240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7849367d-1dc9-43a6-a341-faf9a355421e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:00.916922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7849367d-1dc9-43a6-a341-faf9a355421e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:00.917371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7849367d-1dc9-43a6-a341-faf9a355421e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:00.917794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7849367d-1dc9-43a6-a341-faf9a355421e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:00.946146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7849367d-1dc9-43a6-a341-faf9a355421e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Sep 02 09:55:00.946689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 624/1176] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:01.958209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-de72d019-c7d3-48bc-8b7f-f9a2f5203be7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:01.960335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-de72d019-c7d3-48bc-8b7f-f9a2f5203be7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:01.966402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de72d019-c7d3-48bc-8b7f-f9a2f5203be7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:01.966911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de72d019-c7d3-48bc-8b7f-f9a2f5203be7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:01.967395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de72d019-c7d3-48bc-8b7f-f9a2f5203be7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:01.968037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de72d019-c7d3-48bc-8b7f-f9a2f5203be7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:01.968480 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de72d019-c7d3-48bc-8b7f-f9a2f5203be7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:01.968894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de72d019-c7d3-48bc-8b7f-f9a2f5203be7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:01.997485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-de72d019-c7d3-48bc-8b7f-f9a2f5203be7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Sep 02 09:55:01.998032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 553/1177] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:03.009438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5aaaa330-fa84-424c-8f66-d5132d49ad2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:03.011595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5aaaa330-fa84-424c-8f66-d5132d49ad2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:03.018348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5aaaa330-fa84-424c-8f66-d5132d49ad2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:03.018856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5aaaa330-fa84-424c-8f66-d5132d49ad2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:03.019293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5aaaa330-fa84-424c-8f66-d5132d49ad2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:03.019974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5aaaa330-fa84-424c-8f66-d5132d49ad2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:03.020424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5aaaa330-fa84-424c-8f66-d5132d49ad2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:03.020845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5aaaa330-fa84-424c-8f66-d5132d49ad2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:03.049719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5aaaa330-fa84-424c-8f66-d5132d49ad2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Sep 02 09:55:03.050259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 625/1178] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:04.062524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-703a15c5-ff45-45ea-b67a-3cb9451b73a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:04.064597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-703a15c5-ff45-45ea-b67a-3cb9451b73a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:04.071025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-703a15c5-ff45-45ea-b67a-3cb9451b73a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:04.071508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-703a15c5-ff45-45ea-b67a-3cb9451b73a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:04.071947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-703a15c5-ff45-45ea-b67a-3cb9451b73a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:04.072629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-703a15c5-ff45-45ea-b67a-3cb9451b73a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:04.073079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-703a15c5-ff45-45ea-b67a-3cb9451b73a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:04.073502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-703a15c5-ff45-45ea-b67a-3cb9451b73a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:04.102434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-703a15c5-ff45-45ea-b67a-3cb9451b73a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044650 Sep 02 09:55:04.103005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 554/1179] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:05.114475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-342de1c1-c1cf-42be-bb68-dea587b59918 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:05.116651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-342de1c1-c1cf-42be-bb68-dea587b59918 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:05.118986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=30 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:55:05.123626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-342de1c1-c1cf-42be-bb68-dea587b59918 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:05.124583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-342de1c1-c1cf-42be-bb68-dea587b59918 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:05.125013 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-342de1c1-c1cf-42be-bb68-dea587b59918 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:05.125697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-342de1c1-c1cf-42be-bb68-dea587b59918 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:05.126142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-342de1c1-c1cf-42be-bb68-dea587b59918 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:05.126557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-342de1c1-c1cf-42be-bb68-dea587b59918 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:05.157213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-342de1c1-c1cf-42be-bb68-dea587b59918 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 Sep 02 09:55:05.157754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 626/1180] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:06.168574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c302be55-0819-461a-a803-10ba390e5fcc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:06.171174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c302be55-0819-461a-a803-10ba390e5fcc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:06.177536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c302be55-0819-461a-a803-10ba390e5fcc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:06.178017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c302be55-0819-461a-a803-10ba390e5fcc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:06.178446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c302be55-0819-461a-a803-10ba390e5fcc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:06.179149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c302be55-0819-461a-a803-10ba390e5fcc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:06.179597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c302be55-0819-461a-a803-10ba390e5fcc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:06.180016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c302be55-0819-461a-a803-10ba390e5fcc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:06.208499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c302be55-0819-461a-a803-10ba390e5fcc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Sep 02 09:55:06.209033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 555/1181] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:07.220766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3e86062c-cac2-4427-af69-7f1ebdf4d0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:07.222927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3e86062c-cac2-4427-af69-7f1ebdf4d0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:07.229327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3e86062c-cac2-4427-af69-7f1ebdf4d0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:07.229812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3e86062c-cac2-4427-af69-7f1ebdf4d0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:07.234262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3e86062c-cac2-4427-af69-7f1ebdf4d0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:07.234262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3e86062c-cac2-4427-af69-7f1ebdf4d0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:07.234262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3e86062c-cac2-4427-af69-7f1ebdf4d0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:07.234262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3e86062c-cac2-4427-af69-7f1ebdf4d0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:07.235521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=96 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:55:07.261799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3e86062c-cac2-4427-af69-7f1ebdf4d0fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045097 Sep 02 09:55:07.262353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 627/1182] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:08.273937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a3e14fa4-bc88-4e59-b52d-49027005e505 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:08.276211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a3e14fa4-bc88-4e59-b52d-49027005e505 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:08.282545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a3e14fa4-bc88-4e59-b52d-49027005e505 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:08.283065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a3e14fa4-bc88-4e59-b52d-49027005e505 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:08.283537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a3e14fa4-bc88-4e59-b52d-49027005e505 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:08.284223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a3e14fa4-bc88-4e59-b52d-49027005e505 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:08.284679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a3e14fa4-bc88-4e59-b52d-49027005e505 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:08.285106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a3e14fa4-bc88-4e59-b52d-49027005e505 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:08.314671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a3e14fa4-bc88-4e59-b52d-49027005e505 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 Sep 02 09:55:08.315234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 556/1183] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:09.327629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6e16dff2-c0c9-4a7e-acbc-a11a57923205 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:09.329712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6e16dff2-c0c9-4a7e-acbc-a11a57923205 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:09.336157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e16dff2-c0c9-4a7e-acbc-a11a57923205 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:09.336637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e16dff2-c0c9-4a7e-acbc-a11a57923205 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:09.337065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e16dff2-c0c9-4a7e-acbc-a11a57923205 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:09.337751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e16dff2-c0c9-4a7e-acbc-a11a57923205 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:09.338195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e16dff2-c0c9-4a7e-acbc-a11a57923205 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:09.338615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e16dff2-c0c9-4a7e-acbc-a11a57923205 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:09.369483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6e16dff2-c0c9-4a7e-acbc-a11a57923205 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046408 Sep 02 09:55:09.370040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 628/1184] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:10.387512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cf149b12-8a3c-41bb-80b3-48220f166aea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:10.389906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cf149b12-8a3c-41bb-80b3-48220f166aea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:10.392222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=32 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:55:10.396960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf149b12-8a3c-41bb-80b3-48220f166aea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:10.397440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf149b12-8a3c-41bb-80b3-48220f166aea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:10.397877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf149b12-8a3c-41bb-80b3-48220f166aea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:10.398559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf149b12-8a3c-41bb-80b3-48220f166aea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:10.399043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf149b12-8a3c-41bb-80b3-48220f166aea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:10.399468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf149b12-8a3c-41bb-80b3-48220f166aea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:10.430130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cf149b12-8a3c-41bb-80b3-48220f166aea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046606 Sep 02 09:55:10.433146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 557/1185] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:11.442043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a3f09140-111d-4db4-858e-e12a488ae893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:11.444241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a3f09140-111d-4db4-858e-e12a488ae893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:11.450631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3f09140-111d-4db4-858e-e12a488ae893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:11.451161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3f09140-111d-4db4-858e-e12a488ae893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:11.451603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3f09140-111d-4db4-858e-e12a488ae893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:11.452290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3f09140-111d-4db4-858e-e12a488ae893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:11.452742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3f09140-111d-4db4-858e-e12a488ae893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:11.453166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3f09140-111d-4db4-858e-e12a488ae893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:11.481398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a3f09140-111d-4db4-858e-e12a488ae893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043369 Sep 02 09:55:11.481939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 629/1186] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:12.493872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-72dde8fc-ba9f-40df-980d-08be66c4a03d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:12.496033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-72dde8fc-ba9f-40df-980d-08be66c4a03d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:12.503348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72dde8fc-ba9f-40df-980d-08be66c4a03d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:12.503828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72dde8fc-ba9f-40df-980d-08be66c4a03d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:12.504291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72dde8fc-ba9f-40df-980d-08be66c4a03d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:12.504976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72dde8fc-ba9f-40df-980d-08be66c4a03d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:12.505428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72dde8fc-ba9f-40df-980d-08be66c4a03d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:12.505851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72dde8fc-ba9f-40df-980d-08be66c4a03d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:12.535001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-72dde8fc-ba9f-40df-980d-08be66c4a03d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Sep 02 09:55:12.535564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 558/1187] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:13.547641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c3abb09d-b72d-4df8-938e-17aad7b9ba1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:13.549851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c3abb09d-b72d-4df8-938e-17aad7b9ba1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:13.556326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3abb09d-b72d-4df8-938e-17aad7b9ba1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:13.556807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3abb09d-b72d-4df8-938e-17aad7b9ba1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:13.557240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3abb09d-b72d-4df8-938e-17aad7b9ba1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:13.557928 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3abb09d-b72d-4df8-938e-17aad7b9ba1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:13.558376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3abb09d-b72d-4df8-938e-17aad7b9ba1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:13.558824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3abb09d-b72d-4df8-938e-17aad7b9ba1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:13.587777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c3abb09d-b72d-4df8-938e-17aad7b9ba1a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Sep 02 09:55:13.588321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 630/1188] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:14.599778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6c36e5f6-13f8-418b-a414-f285569654dd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:14.601909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6c36e5f6-13f8-418b-a414-f285569654dd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:14.609152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c36e5f6-13f8-418b-a414-f285569654dd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:14.609642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c36e5f6-13f8-418b-a414-f285569654dd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:14.610109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c36e5f6-13f8-418b-a414-f285569654dd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:14.610844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c36e5f6-13f8-418b-a414-f285569654dd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:14.611331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c36e5f6-13f8-418b-a414-f285569654dd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:14.611756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c36e5f6-13f8-418b-a414-f285569654dd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:14.640708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6c36e5f6-13f8-418b-a414-f285569654dd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044835 Sep 02 09:55:14.641263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 559/1189] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:15.652778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ca82b8ff-c869-4f19-bde9-b0c663faf2dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:15.654944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ca82b8ff-c869-4f19-bde9-b0c663faf2dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:15.661305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca82b8ff-c869-4f19-bde9-b0c663faf2dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:15.661785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca82b8ff-c869-4f19-bde9-b0c663faf2dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:15.662226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca82b8ff-c869-4f19-bde9-b0c663faf2dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:15.662934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca82b8ff-c869-4f19-bde9-b0c663faf2dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:15.663388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca82b8ff-c869-4f19-bde9-b0c663faf2dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:15.663813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca82b8ff-c869-4f19-bde9-b0c663faf2dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:15.692410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ca82b8ff-c869-4f19-bde9-b0c663faf2dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043566 Sep 02 09:55:15.692943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 631/1190] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 09:55:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:55:16.050894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:16.051398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:16.057701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:16.058183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:16.058619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:16.059330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:16.059788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:16.060213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:16.085229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:55:16.285446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [cbd594e0-924f-4e7a-936b-b12f86fd11e1] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 09:55:16.705230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-061c7542-e06c-4903-90ad-b8df1a5b503a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:55:16.707420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-061c7542-e06c-4903-90ad-b8df1a5b503a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:16.713916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-061c7542-e06c-4903-90ad-b8df1a5b503a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:16.714394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-061c7542-e06c-4903-90ad-b8df1a5b503a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:16.714857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-061c7542-e06c-4903-90ad-b8df1a5b503a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:16.715563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-061c7542-e06c-4903-90ad-b8df1a5b503a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:16.716008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-061c7542-e06c-4903-90ad-b8df1a5b503a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:16.716426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-061c7542-e06c-4903-90ad-b8df1a5b503a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:16.849216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-061c7542-e06c-4903-90ad-b8df1a5b503a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "POST /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/action" status: 200 len: 75917 microversion: 2.1 time: 0.147953 Sep 02 09:55:16.853565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 632/1191] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 09:55:16 2022] POST /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5/action => generated 75917 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 09:55:17.293571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [cbd594e0-924f-4e7a-936b-b12f86fd11e1] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54548. Sep 02 09:55:17.428110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fc3b6b4c-d25e-4f3b-8a83-68aa70361d48 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 204 len: 0 microversion: 2.1 time: 1.380841 Sep 02 09:55:17.428626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 560/1192] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:55:16 2022] DELETE /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 0 bytes in 1382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 09:55:17.443016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fdc3e520-03a2-4ea7-9950-f7e573e7b46d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:17.443713 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fdc3e520-03a2-4ea7-9950-f7e573e7b46d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:17.455495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc3e520-03a2-4ea7-9950-f7e573e7b46d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:17.455495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc3e520-03a2-4ea7-9950-f7e573e7b46d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:17.455495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc3e520-03a2-4ea7-9950-f7e573e7b46d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:17.455495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc3e520-03a2-4ea7-9950-f7e573e7b46d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:17.455808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc3e520-03a2-4ea7-9950-f7e573e7b46d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:17.455808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc3e520-03a2-4ea7-9950-f7e573e7b46d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:17.462563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b6b7304a-35c4-4228-b10a-59df863b15fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] Calling method '.version_select at 0x7f4e5c3141f0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:17.467056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b6b7304a-35c4-4228-b10a-59df863b15fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [dede0a10-a400-48bd-afd6-1a277670a3a1] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 09:55:17.630147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fdc3e520-03a2-4ea7-9950-f7e573e7b46d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:17.638988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fdc3e520-03a2-4ea7-9950-f7e573e7b46d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.200020 Sep 02 09:55:17.639562 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 633/1193] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:17 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:18.474044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [None req-b6b7304a-35c4-4228-b10a-59df863b15fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] [dede0a10-a400-48bd-afd6-1a277670a3a1] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 54560. Sep 02 09:55:18.574245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b6b7304a-35c4-4228-b10a-59df863b15fa tempest-TestVolumeBootPattern-1229258799 tempest-TestVolumeBootPattern-1229258799-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-199031911" status: 202 len: 0 microversion: 2.1 time: 1.115844 Sep 02 09:55:18.575253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 561/1194] 10.222.0.57 () {58 vars in 1260 bytes} [Fri Sep 2 09:55:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-199031911 => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 09:55:18.660933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-689c86cc-bb8c-4d42-aed9-41e0509a0bd5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:18.661650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-689c86cc-bb8c-4d42-aed9-41e0509a0bd5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:18.668144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-689c86cc-bb8c-4d42-aed9-41e0509a0bd5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:18.668636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-689c86cc-bb8c-4d42-aed9-41e0509a0bd5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:18.669075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-689c86cc-bb8c-4d42-aed9-41e0509a0bd5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:18.669761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-689c86cc-bb8c-4d42-aed9-41e0509a0bd5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:18.670215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-689c86cc-bb8c-4d42-aed9-41e0509a0bd5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:18.671305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-689c86cc-bb8c-4d42-aed9-41e0509a0bd5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:18.805032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-689c86cc-bb8c-4d42-aed9-41e0509a0bd5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:18.813255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-689c86cc-bb8c-4d42-aed9-41e0509a0bd5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.156220 Sep 02 09:55:18.813821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 634/1195] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:18 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:19.850584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a0671b18-cc07-4e97-86c1-1b5064cdcfee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:19.850584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a0671b18-cc07-4e97-86c1-1b5064cdcfee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:19.850584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0671b18-cc07-4e97-86c1-1b5064cdcfee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:19.850584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0671b18-cc07-4e97-86c1-1b5064cdcfee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:19.851916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0671b18-cc07-4e97-86c1-1b5064cdcfee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:19.851916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0671b18-cc07-4e97-86c1-1b5064cdcfee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:19.851916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0671b18-cc07-4e97-86c1-1b5064cdcfee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:19.851916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0671b18-cc07-4e97-86c1-1b5064cdcfee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:20.094164 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a0671b18-cc07-4e97-86c1-1b5064cdcfee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:20.102346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a0671b18-cc07-4e97-86c1-1b5064cdcfee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.272265 Sep 02 09:55:20.102944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 562/1196] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:19 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:21.124777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-09fec05b-463a-4bc1-95a3-6be74c5c8a20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:21.125387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-09fec05b-463a-4bc1-95a3-6be74c5c8a20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:21.135686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09fec05b-463a-4bc1-95a3-6be74c5c8a20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:21.136530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09fec05b-463a-4bc1-95a3-6be74c5c8a20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:21.137181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09fec05b-463a-4bc1-95a3-6be74c5c8a20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:21.137894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09fec05b-463a-4bc1-95a3-6be74c5c8a20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:21.138598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09fec05b-463a-4bc1-95a3-6be74c5c8a20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:21.139414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09fec05b-463a-4bc1-95a3-6be74c5c8a20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:21.278041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-09fec05b-463a-4bc1-95a3-6be74c5c8a20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:21.287718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-09fec05b-463a-4bc1-95a3-6be74c5c8a20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.167296 Sep 02 09:55:21.288324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 635/1197] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:21 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:55:22.308826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4d1024e4-92c2-418d-b93f-7af63a71df58 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:22.309547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4d1024e4-92c2-418d-b93f-7af63a71df58 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:22.316708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4d1024e4-92c2-418d-b93f-7af63a71df58 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:22.317266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4d1024e4-92c2-418d-b93f-7af63a71df58 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:22.317805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4d1024e4-92c2-418d-b93f-7af63a71df58 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:22.318560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4d1024e4-92c2-418d-b93f-7af63a71df58 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:22.319114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4d1024e4-92c2-418d-b93f-7af63a71df58 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:22.319607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4d1024e4-92c2-418d-b93f-7af63a71df58 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:22.535503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4d1024e4-92c2-418d-b93f-7af63a71df58 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:22.543876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4d1024e4-92c2-418d-b93f-7af63a71df58 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.238980 Sep 02 09:55:22.544439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 563/1198] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:22 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:23.565549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5a7a8558-209e-455a-af95-6348b1f93078 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:23.566150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5a7a8558-209e-455a-af95-6348b1f93078 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:23.572654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a7a8558-209e-455a-af95-6348b1f93078 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:23.573141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a7a8558-209e-455a-af95-6348b1f93078 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:23.573840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a7a8558-209e-455a-af95-6348b1f93078 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:23.574846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a7a8558-209e-455a-af95-6348b1f93078 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:23.575301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a7a8558-209e-455a-af95-6348b1f93078 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:23.575751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a7a8558-209e-455a-af95-6348b1f93078 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:23.717585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5a7a8558-209e-455a-af95-6348b1f93078 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:23.726080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5a7a8558-209e-455a-af95-6348b1f93078 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.164396 Sep 02 09:55:23.726653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 636/1199] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:23 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:24.747969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e140ccb4-ef49-4e80-bd17-87ead2bd240b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:24.748614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e140ccb4-ef49-4e80-bd17-87ead2bd240b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:24.756398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e140ccb4-ef49-4e80-bd17-87ead2bd240b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:24.761319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e140ccb4-ef49-4e80-bd17-87ead2bd240b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:24.761319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e140ccb4-ef49-4e80-bd17-87ead2bd240b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:24.761319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e140ccb4-ef49-4e80-bd17-87ead2bd240b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:24.761319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e140ccb4-ef49-4e80-bd17-87ead2bd240b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:24.761722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e140ccb4-ef49-4e80-bd17-87ead2bd240b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:24.908244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e140ccb4-ef49-4e80-bd17-87ead2bd240b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:24.916813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e140ccb4-ef49-4e80-bd17-87ead2bd240b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.172696 Sep 02 09:55:24.917627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 564/1200] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:24 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:25.938178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0e29d763-1e9f-4a2f-a4be-81d493c7cd5b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:25.938844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0e29d763-1e9f-4a2f-a4be-81d493c7cd5b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:25.945879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e29d763-1e9f-4a2f-a4be-81d493c7cd5b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:25.949110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e29d763-1e9f-4a2f-a4be-81d493c7cd5b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:25.949110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e29d763-1e9f-4a2f-a4be-81d493c7cd5b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:25.949110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e29d763-1e9f-4a2f-a4be-81d493c7cd5b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:25.949110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e29d763-1e9f-4a2f-a4be-81d493c7cd5b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:25.949479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e29d763-1e9f-4a2f-a4be-81d493c7cd5b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:26.207740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0e29d763-1e9f-4a2f-a4be-81d493c7cd5b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:26.216647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0e29d763-1e9f-4a2f-a4be-81d493c7cd5b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.282834 Sep 02 09:55:26.217315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 637/1201] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:25 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:27.238195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1aec1bb7-bbd2-470d-addf-125664d6c5d5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:27.238928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1aec1bb7-bbd2-470d-addf-125664d6c5d5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:27.245298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1aec1bb7-bbd2-470d-addf-125664d6c5d5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:27.251145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1aec1bb7-bbd2-470d-addf-125664d6c5d5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:27.251145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1aec1bb7-bbd2-470d-addf-125664d6c5d5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:27.251145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1aec1bb7-bbd2-470d-addf-125664d6c5d5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:27.251145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1aec1bb7-bbd2-470d-addf-125664d6c5d5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:27.251723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1aec1bb7-bbd2-470d-addf-125664d6c5d5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:27.527505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1aec1bb7-bbd2-470d-addf-125664d6c5d5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:27.536109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1aec1bb7-bbd2-470d-addf-125664d6c5d5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.302169 Sep 02 09:55:27.536726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 565/1202] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:27 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:28.557215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-72b92ce3-b3f7-4da2-b0f9-b3a2d9611cd8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:28.557830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-72b92ce3-b3f7-4da2-b0f9-b3a2d9611cd8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:28.564863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72b92ce3-b3f7-4da2-b0f9-b3a2d9611cd8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:28.565346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72b92ce3-b3f7-4da2-b0f9-b3a2d9611cd8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:28.565781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72b92ce3-b3f7-4da2-b0f9-b3a2d9611cd8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:28.566463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72b92ce3-b3f7-4da2-b0f9-b3a2d9611cd8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:28.566941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72b92ce3-b3f7-4da2-b0f9-b3a2d9611cd8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:28.567363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72b92ce3-b3f7-4da2-b0f9-b3a2d9611cd8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:28.697973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-72b92ce3-b3f7-4da2-b0f9-b3a2d9611cd8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:28.706622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-72b92ce3-b3f7-4da2-b0f9-b3a2d9611cd8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153207 Sep 02 09:55:28.707205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 638/1203] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:28 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:29.727786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a913bfc3-ce51-4c2f-ba0f-ded6488aa9b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:29.728410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a913bfc3-ce51-4c2f-ba0f-ded6488aa9b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:29.735821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a913bfc3-ce51-4c2f-ba0f-ded6488aa9b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:29.736307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a913bfc3-ce51-4c2f-ba0f-ded6488aa9b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:29.736737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a913bfc3-ce51-4c2f-ba0f-ded6488aa9b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:29.737743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a913bfc3-ce51-4c2f-ba0f-ded6488aa9b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:29.738194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a913bfc3-ce51-4c2f-ba0f-ded6488aa9b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:29.738615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a913bfc3-ce51-4c2f-ba0f-ded6488aa9b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:29.883388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a913bfc3-ce51-4c2f-ba0f-ded6488aa9b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:29.885696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:55:29.893167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a913bfc3-ce51-4c2f-ba0f-ded6488aa9b3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.169470 Sep 02 09:55:29.899490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 566/1204] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:29 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:30.918889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d39aca66-d990-4681-ba44-9d2b3f27eef0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:30.919437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d39aca66-d990-4681-ba44-9d2b3f27eef0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:30.925816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d39aca66-d990-4681-ba44-9d2b3f27eef0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:30.926297 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d39aca66-d990-4681-ba44-9d2b3f27eef0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:30.926756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d39aca66-d990-4681-ba44-9d2b3f27eef0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:30.927443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d39aca66-d990-4681-ba44-9d2b3f27eef0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:30.927904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d39aca66-d990-4681-ba44-9d2b3f27eef0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:30.928327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d39aca66-d990-4681-ba44-9d2b3f27eef0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:31.053106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d39aca66-d990-4681-ba44-9d2b3f27eef0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:31.061323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d39aca66-d990-4681-ba44-9d2b3f27eef0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146408 Sep 02 09:55:31.061887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 639/1205] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:30 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:55:32.082931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2a477619-bb77-42c2-9583-b4d2486cf494 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:32.083459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2a477619-bb77-42c2-9583-b4d2486cf494 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:32.089810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a477619-bb77-42c2-9583-b4d2486cf494 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:32.090287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a477619-bb77-42c2-9583-b4d2486cf494 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:32.090731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a477619-bb77-42c2-9583-b4d2486cf494 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:32.091414 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a477619-bb77-42c2-9583-b4d2486cf494 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:32.092356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a477619-bb77-42c2-9583-b4d2486cf494 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:32.092774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2a477619-bb77-42c2-9583-b4d2486cf494 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:32.217388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2a477619-bb77-42c2-9583-b4d2486cf494 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:32.225635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2a477619-bb77-42c2-9583-b4d2486cf494 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147015 Sep 02 09:55:32.226187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 567/1206] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:32 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:33.247207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-85e3e271-6f35-480a-b485-72e8c3a65218 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:33.247807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-85e3e271-6f35-480a-b485-72e8c3a65218 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:33.254893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85e3e271-6f35-480a-b485-72e8c3a65218 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:33.255376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85e3e271-6f35-480a-b485-72e8c3a65218 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:33.255811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85e3e271-6f35-480a-b485-72e8c3a65218 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:33.256494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85e3e271-6f35-480a-b485-72e8c3a65218 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:33.256943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85e3e271-6f35-480a-b485-72e8c3a65218 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:33.257364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85e3e271-6f35-480a-b485-72e8c3a65218 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:33.385801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-85e3e271-6f35-480a-b485-72e8c3a65218 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:33.394159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-85e3e271-6f35-480a-b485-72e8c3a65218 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150819 Sep 02 09:55:33.394739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 640/1207] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:33 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:34.415622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-33e017f8-88ac-4bb2-8632-9f6819ee720c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:34.416234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-33e017f8-88ac-4bb2-8632-9f6819ee720c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:34.422900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33e017f8-88ac-4bb2-8632-9f6819ee720c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:34.423385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33e017f8-88ac-4bb2-8632-9f6819ee720c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:34.423819 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33e017f8-88ac-4bb2-8632-9f6819ee720c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:34.424541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33e017f8-88ac-4bb2-8632-9f6819ee720c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:34.425013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33e017f8-88ac-4bb2-8632-9f6819ee720c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:34.425435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-33e017f8-88ac-4bb2-8632-9f6819ee720c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:34.555779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-33e017f8-88ac-4bb2-8632-9f6819ee720c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:34.564475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-33e017f8-88ac-4bb2-8632-9f6819ee720c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152688 Sep 02 09:55:34.565037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 568/1208] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:34 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:35.585022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8dcb4354-3672-4e8e-b50d-35663dd0f0b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:35.585573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8dcb4354-3672-4e8e-b50d-35663dd0f0b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:35.588039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=30 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:55:35.592731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8dcb4354-3672-4e8e-b50d-35663dd0f0b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:35.593212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8dcb4354-3672-4e8e-b50d-35663dd0f0b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:35.593652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8dcb4354-3672-4e8e-b50d-35663dd0f0b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:35.594340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8dcb4354-3672-4e8e-b50d-35663dd0f0b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:35.594825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8dcb4354-3672-4e8e-b50d-35663dd0f0b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:35.595282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8dcb4354-3672-4e8e-b50d-35663dd0f0b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:35.728641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8dcb4354-3672-4e8e-b50d-35663dd0f0b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:35.736871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8dcb4354-3672-4e8e-b50d-35663dd0f0b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.155834 Sep 02 09:55:35.737428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 641/1209] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:35 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:36.757273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a87aaf2a-c60e-4049-9c6b-c1e7ef23d029 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:36.757892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a87aaf2a-c60e-4049-9c6b-c1e7ef23d029 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:36.764474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a87aaf2a-c60e-4049-9c6b-c1e7ef23d029 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:36.765449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a87aaf2a-c60e-4049-9c6b-c1e7ef23d029 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:36.765882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a87aaf2a-c60e-4049-9c6b-c1e7ef23d029 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:36.766569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a87aaf2a-c60e-4049-9c6b-c1e7ef23d029 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:36.767051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a87aaf2a-c60e-4049-9c6b-c1e7ef23d029 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:36.773994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a87aaf2a-c60e-4049-9c6b-c1e7ef23d029 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:36.896393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a87aaf2a-c60e-4049-9c6b-c1e7ef23d029 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:36.904600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a87aaf2a-c60e-4049-9c6b-c1e7ef23d029 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151129 Sep 02 09:55:36.905157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 569/1210] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:36 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:37.928325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-14609ba8-08f1-4446-bc04-9de2fe86e802 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:37.928943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-14609ba8-08f1-4446-bc04-9de2fe86e802 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:37.935429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14609ba8-08f1-4446-bc04-9de2fe86e802 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:37.935916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14609ba8-08f1-4446-bc04-9de2fe86e802 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:37.936357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14609ba8-08f1-4446-bc04-9de2fe86e802 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:37.937045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14609ba8-08f1-4446-bc04-9de2fe86e802 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:37.937506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14609ba8-08f1-4446-bc04-9de2fe86e802 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:37.937934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-14609ba8-08f1-4446-bc04-9de2fe86e802 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:38.079073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-14609ba8-08f1-4446-bc04-9de2fe86e802 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:38.087241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-14609ba8-08f1-4446-bc04-9de2fe86e802 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.162844 Sep 02 09:55:38.087814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 642/1211] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:37 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:39.109715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0283852f-66ed-4a03-bc23-1e9b2217da65 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:39.110327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0283852f-66ed-4a03-bc23-1e9b2217da65 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:39.116685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0283852f-66ed-4a03-bc23-1e9b2217da65 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:39.117169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0283852f-66ed-4a03-bc23-1e9b2217da65 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:39.117600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0283852f-66ed-4a03-bc23-1e9b2217da65 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:39.118280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0283852f-66ed-4a03-bc23-1e9b2217da65 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:39.118756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0283852f-66ed-4a03-bc23-1e9b2217da65 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:39.119184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0283852f-66ed-4a03-bc23-1e9b2217da65 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:39.248622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0283852f-66ed-4a03-bc23-1e9b2217da65 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:39.257286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0283852f-66ed-4a03-bc23-1e9b2217da65 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151965 Sep 02 09:55:39.257838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 570/1212] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:39 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:40.278415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-084b3914-7405-44bf-b987-fbe9846af622 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:40.279079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-084b3914-7405-44bf-b987-fbe9846af622 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:40.285666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084b3914-7405-44bf-b987-fbe9846af622 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:40.286144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084b3914-7405-44bf-b987-fbe9846af622 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:40.286581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084b3914-7405-44bf-b987-fbe9846af622 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:40.287302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084b3914-7405-44bf-b987-fbe9846af622 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:40.287759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084b3914-7405-44bf-b987-fbe9846af622 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:40.288186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084b3914-7405-44bf-b987-fbe9846af622 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:40.292202 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=94 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:55:40.414465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-084b3914-7405-44bf-b987-fbe9846af622 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:40.422742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-084b3914-7405-44bf-b987-fbe9846af622 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148233 Sep 02 09:55:40.423310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 643/1213] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:40 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:41.443762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e9a0c3c4-763e-4072-beb6-5745a4afcf50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:41.444293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e9a0c3c4-763e-4072-beb6-5745a4afcf50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:41.450667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9a0c3c4-763e-4072-beb6-5745a4afcf50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:41.451180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9a0c3c4-763e-4072-beb6-5745a4afcf50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:41.451618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9a0c3c4-763e-4072-beb6-5745a4afcf50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:41.452821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9a0c3c4-763e-4072-beb6-5745a4afcf50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:41.453278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9a0c3c4-763e-4072-beb6-5745a4afcf50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:41.453707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9a0c3c4-763e-4072-beb6-5745a4afcf50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:41.579099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e9a0c3c4-763e-4072-beb6-5745a4afcf50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:41.587188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e9a0c3c4-763e-4072-beb6-5745a4afcf50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147444 Sep 02 09:55:41.587761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 571/1214] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:41 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:42.608752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-565849c3-ac5b-4840-b124-fce6cb8bd845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:42.609372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-565849c3-ac5b-4840-b124-fce6cb8bd845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:42.616109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565849c3-ac5b-4840-b124-fce6cb8bd845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:42.616589 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565849c3-ac5b-4840-b124-fce6cb8bd845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:42.617048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565849c3-ac5b-4840-b124-fce6cb8bd845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:42.617731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565849c3-ac5b-4840-b124-fce6cb8bd845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:42.618179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565849c3-ac5b-4840-b124-fce6cb8bd845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:42.618601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565849c3-ac5b-4840-b124-fce6cb8bd845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:42.747455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-565849c3-ac5b-4840-b124-fce6cb8bd845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:42.755613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-565849c3-ac5b-4840-b124-fce6cb8bd845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151346 Sep 02 09:55:42.756171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 644/1215] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:42 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:43.777253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d59f2998-c530-46f8-9447-e175b8bfef78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:43.777878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d59f2998-c530-46f8-9447-e175b8bfef78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:43.780206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:55:43.784817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d59f2998-c530-46f8-9447-e175b8bfef78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:43.785296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d59f2998-c530-46f8-9447-e175b8bfef78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:43.785728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d59f2998-c530-46f8-9447-e175b8bfef78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:43.786410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d59f2998-c530-46f8-9447-e175b8bfef78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:43.786896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d59f2998-c530-46f8-9447-e175b8bfef78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:43.787324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d59f2998-c530-46f8-9447-e175b8bfef78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:43.918020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d59f2998-c530-46f8-9447-e175b8bfef78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:43.926822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d59f2998-c530-46f8-9447-e175b8bfef78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153395 Sep 02 09:55:43.927396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 572/1216] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:43 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:44.947804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-06487efe-f5e4-44be-84d4-79145243f033 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:44.948421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-06487efe-f5e4-44be-84d4-79145243f033 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:44.955310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06487efe-f5e4-44be-84d4-79145243f033 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:44.955796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06487efe-f5e4-44be-84d4-79145243f033 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:44.956234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06487efe-f5e4-44be-84d4-79145243f033 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:44.956919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06487efe-f5e4-44be-84d4-79145243f033 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:44.957368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06487efe-f5e4-44be-84d4-79145243f033 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:44.957794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06487efe-f5e4-44be-84d4-79145243f033 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:45.087192 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-06487efe-f5e4-44be-84d4-79145243f033 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:45.096607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-06487efe-f5e4-44be-84d4-79145243f033 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152569 Sep 02 09:55:45.097114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 645/1217] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:44 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:55:46.117679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b5d7e14b-41e1-441b-9276-a4bd54efb671 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:46.118291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b5d7e14b-41e1-441b-9276-a4bd54efb671 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:46.124741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5d7e14b-41e1-441b-9276-a4bd54efb671 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:46.125226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5d7e14b-41e1-441b-9276-a4bd54efb671 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:46.125658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5d7e14b-41e1-441b-9276-a4bd54efb671 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:46.126341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5d7e14b-41e1-441b-9276-a4bd54efb671 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:46.126816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5d7e14b-41e1-441b-9276-a4bd54efb671 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:46.127241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5d7e14b-41e1-441b-9276-a4bd54efb671 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:46.266971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5d7e14b-41e1-441b-9276-a4bd54efb671 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:46.275647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b5d7e14b-41e1-441b-9276-a4bd54efb671 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.161846 Sep 02 09:55:46.278281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 573/1218] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:46 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:47.301853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-540c420d-bc81-4509-a859-b9bb856cf740 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:47.302468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-540c420d-bc81-4509-a859-b9bb856cf740 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:47.310378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-540c420d-bc81-4509-a859-b9bb856cf740 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:47.310378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-540c420d-bc81-4509-a859-b9bb856cf740 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:47.310603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-540c420d-bc81-4509-a859-b9bb856cf740 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:47.311907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-540c420d-bc81-4509-a859-b9bb856cf740 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:47.312362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-540c420d-bc81-4509-a859-b9bb856cf740 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:47.312780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-540c420d-bc81-4509-a859-b9bb856cf740 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:47.438924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-540c420d-bc81-4509-a859-b9bb856cf740 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:47.446966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-540c420d-bc81-4509-a859-b9bb856cf740 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148937 Sep 02 09:55:47.447524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 646/1219] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:47 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:48.467710 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9318a9fc-1970-4159-9e00-ef56170bd6c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:48.468326 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9318a9fc-1970-4159-9e00-ef56170bd6c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:48.474773 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9318a9fc-1970-4159-9e00-ef56170bd6c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:48.475263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9318a9fc-1970-4159-9e00-ef56170bd6c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:48.475705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9318a9fc-1970-4159-9e00-ef56170bd6c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:48.476394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9318a9fc-1970-4159-9e00-ef56170bd6c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:48.476881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9318a9fc-1970-4159-9e00-ef56170bd6c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:48.477308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9318a9fc-1970-4159-9e00-ef56170bd6c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:48.611021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9318a9fc-1970-4159-9e00-ef56170bd6c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:48.612604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9318a9fc-1970-4159-9e00-ef56170bd6c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148691 Sep 02 09:55:48.613165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 574/1220] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:48 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:49.633172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-874c49e8-5dc8-4ead-b8af-193e71a74959 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:49.633815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-874c49e8-5dc8-4ead-b8af-193e71a74959 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:49.641090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-874c49e8-5dc8-4ead-b8af-193e71a74959 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:49.641624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-874c49e8-5dc8-4ead-b8af-193e71a74959 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:49.642017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-874c49e8-5dc8-4ead-b8af-193e71a74959 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:49.642735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-874c49e8-5dc8-4ead-b8af-193e71a74959 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:49.643195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-874c49e8-5dc8-4ead-b8af-193e71a74959 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:49.643721 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-874c49e8-5dc8-4ead-b8af-193e71a74959 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:49.776544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-874c49e8-5dc8-4ead-b8af-193e71a74959 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:49.784188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-874c49e8-5dc8-4ead-b8af-193e71a74959 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154889 Sep 02 09:55:49.784798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 647/1221] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:49 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:50.805945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-80960229-b619-4264-a6ba-d9b0a99d33d3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:50.806561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-80960229-b619-4264-a6ba-d9b0a99d33d3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:50.812986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80960229-b619-4264-a6ba-d9b0a99d33d3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:50.813471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80960229-b619-4264-a6ba-d9b0a99d33d3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:50.813910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80960229-b619-4264-a6ba-d9b0a99d33d3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:50.814600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80960229-b619-4264-a6ba-d9b0a99d33d3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:50.815087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80960229-b619-4264-a6ba-d9b0a99d33d3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:50.815515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80960229-b619-4264-a6ba-d9b0a99d33d3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:50.945993 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-80960229-b619-4264-a6ba-d9b0a99d33d3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:50.954321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-80960229-b619-4264-a6ba-d9b0a99d33d3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152100 Sep 02 09:55:50.954848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 575/1222] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:50 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:51.976538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cfdc2ea2-061d-423b-8427-ca68869e313d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:51.977171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cfdc2ea2-061d-423b-8427-ca68869e313d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:51.983983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfdc2ea2-061d-423b-8427-ca68869e313d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:51.984460 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfdc2ea2-061d-423b-8427-ca68869e313d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:51.984888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfdc2ea2-061d-423b-8427-ca68869e313d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:51.985563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfdc2ea2-061d-423b-8427-ca68869e313d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:51.986015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfdc2ea2-061d-423b-8427-ca68869e313d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:51.986433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfdc2ea2-061d-423b-8427-ca68869e313d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:52.114273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cfdc2ea2-061d-423b-8427-ca68869e313d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:52.122398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cfdc2ea2-061d-423b-8427-ca68869e313d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149731 Sep 02 09:55:52.122984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 648/1223] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:51 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:53.143631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2e37eab7-8d23-4e7e-a861-289dc92fd8f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:53.144235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2e37eab7-8d23-4e7e-a861-289dc92fd8f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:53.150679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e37eab7-8d23-4e7e-a861-289dc92fd8f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:53.151192 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e37eab7-8d23-4e7e-a861-289dc92fd8f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:53.151619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e37eab7-8d23-4e7e-a861-289dc92fd8f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:53.152299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e37eab7-8d23-4e7e-a861-289dc92fd8f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:53.152745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e37eab7-8d23-4e7e-a861-289dc92fd8f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:53.153164 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e37eab7-8d23-4e7e-a861-289dc92fd8f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:53.283549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2e37eab7-8d23-4e7e-a861-289dc92fd8f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:53.291676 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2e37eab7-8d23-4e7e-a861-289dc92fd8f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152198 Sep 02 09:55:53.292238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 576/1224] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:53 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:54.313449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5d244304-3b01-47e6-a1a0-7ae611aba1d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:54.314020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5d244304-3b01-47e6-a1a0-7ae611aba1d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:54.320390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5d244304-3b01-47e6-a1a0-7ae611aba1d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:54.320868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5d244304-3b01-47e6-a1a0-7ae611aba1d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:54.321301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5d244304-3b01-47e6-a1a0-7ae611aba1d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:54.321981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5d244304-3b01-47e6-a1a0-7ae611aba1d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:54.322432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5d244304-3b01-47e6-a1a0-7ae611aba1d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:54.322884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5d244304-3b01-47e6-a1a0-7ae611aba1d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:54.450894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5d244304-3b01-47e6-a1a0-7ae611aba1d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:54.459401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5d244304-3b01-47e6-a1a0-7ae611aba1d4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149988 Sep 02 09:55:54.459968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 649/1225] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:54 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:55.480907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-35c12fc6-53b6-4162-a35d-898cda445b04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:55.481553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-35c12fc6-53b6-4162-a35d-898cda445b04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:55.488816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35c12fc6-53b6-4162-a35d-898cda445b04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:55.489143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35c12fc6-53b6-4162-a35d-898cda445b04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:55.489564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35c12fc6-53b6-4162-a35d-898cda445b04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:55.490251 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35c12fc6-53b6-4162-a35d-898cda445b04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:55.490713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35c12fc6-53b6-4162-a35d-898cda445b04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:55.491148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35c12fc6-53b6-4162-a35d-898cda445b04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:55.616923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-35c12fc6-53b6-4162-a35d-898cda445b04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:55.625067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-35c12fc6-53b6-4162-a35d-898cda445b04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148000 Sep 02 09:55:55.625637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 577/1226] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:55 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:56.646520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-65cdabe0-c688-4159-bb5f-bfe72b8b7f29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:56.647165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-65cdabe0-c688-4159-bb5f-bfe72b8b7f29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:56.653532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65cdabe0-c688-4159-bb5f-bfe72b8b7f29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:56.654009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65cdabe0-c688-4159-bb5f-bfe72b8b7f29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:56.654438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65cdabe0-c688-4159-bb5f-bfe72b8b7f29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:56.655146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65cdabe0-c688-4159-bb5f-bfe72b8b7f29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:56.655669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65cdabe0-c688-4159-bb5f-bfe72b8b7f29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:56.656088 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65cdabe0-c688-4159-bb5f-bfe72b8b7f29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:56.784742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-65cdabe0-c688-4159-bb5f-bfe72b8b7f29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:56.793084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-65cdabe0-c688-4159-bb5f-bfe72b8b7f29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150708 Sep 02 09:55:56.793649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 650/1227] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:56 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:57.814739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8897b54a-78de-4a86-a1e3-2c960b210354 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:57.815348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8897b54a-78de-4a86-a1e3-2c960b210354 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:57.821763 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8897b54a-78de-4a86-a1e3-2c960b210354 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:57.822240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8897b54a-78de-4a86-a1e3-2c960b210354 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:57.822667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8897b54a-78de-4a86-a1e3-2c960b210354 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:57.823374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8897b54a-78de-4a86-a1e3-2c960b210354 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:57.823830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8897b54a-78de-4a86-a1e3-2c960b210354 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:57.824248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8897b54a-78de-4a86-a1e3-2c960b210354 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:57.957494 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8897b54a-78de-4a86-a1e3-2c960b210354 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:57.965583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8897b54a-78de-4a86-a1e3-2c960b210354 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154723 Sep 02 09:55:57.966140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 578/1228] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:57 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:55:58.986810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0333e3cd-514a-4288-811c-818e0026687c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:55:58.987414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0333e3cd-514a-4288-811c-818e0026687c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:55:58.993659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0333e3cd-514a-4288-811c-818e0026687c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:58.994136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0333e3cd-514a-4288-811c-818e0026687c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:58.994565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0333e3cd-514a-4288-811c-818e0026687c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:58.995271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0333e3cd-514a-4288-811c-818e0026687c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:55:58.995720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0333e3cd-514a-4288-811c-818e0026687c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:55:58.996139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0333e3cd-514a-4288-811c-818e0026687c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:55:59.127309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0333e3cd-514a-4288-811c-818e0026687c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:55:59.135752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0333e3cd-514a-4288-811c-818e0026687c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152804 Sep 02 09:55:59.136321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 651/1229] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:55:58 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:00.157237 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-acaa4ab8-2593-4d3a-92ef-496807c3627d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:00.157848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-acaa4ab8-2593-4d3a-92ef-496807c3627d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:00.164438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-acaa4ab8-2593-4d3a-92ef-496807c3627d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:00.164923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-acaa4ab8-2593-4d3a-92ef-496807c3627d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:00.165361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-acaa4ab8-2593-4d3a-92ef-496807c3627d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:00.166044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-acaa4ab8-2593-4d3a-92ef-496807c3627d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:00.166497 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-acaa4ab8-2593-4d3a-92ef-496807c3627d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:00.166954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-acaa4ab8-2593-4d3a-92ef-496807c3627d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:00.294458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-acaa4ab8-2593-4d3a-92ef-496807c3627d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:00.303209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-acaa4ab8-2593-4d3a-92ef-496807c3627d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150333 Sep 02 09:56:00.303770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 579/1230] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:00 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:01.324087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-760598d9-668f-4fd8-b0b9-2c450d777c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:01.324688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-760598d9-668f-4fd8-b0b9-2c450d777c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:01.331679 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-760598d9-668f-4fd8-b0b9-2c450d777c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:01.332156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-760598d9-668f-4fd8-b0b9-2c450d777c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:01.332587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-760598d9-668f-4fd8-b0b9-2c450d777c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:01.333262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-760598d9-668f-4fd8-b0b9-2c450d777c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:01.333703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-760598d9-668f-4fd8-b0b9-2c450d777c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:01.334140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-760598d9-668f-4fd8-b0b9-2c450d777c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:01.458683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-760598d9-668f-4fd8-b0b9-2c450d777c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:01.466817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-760598d9-668f-4fd8-b0b9-2c450d777c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146518 Sep 02 09:56:01.467387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 652/1231] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:01 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:02.487805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-be5b62cc-706a-4a16-83c5-c36cf4591b09 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:02.488463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-be5b62cc-706a-4a16-83c5-c36cf4591b09 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:02.494678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5b62cc-706a-4a16-83c5-c36cf4591b09 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:02.495189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5b62cc-706a-4a16-83c5-c36cf4591b09 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:02.495628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5b62cc-706a-4a16-83c5-c36cf4591b09 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:02.496315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5b62cc-706a-4a16-83c5-c36cf4591b09 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:02.496769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5b62cc-706a-4a16-83c5-c36cf4591b09 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:02.497206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be5b62cc-706a-4a16-83c5-c36cf4591b09 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:02.499759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=80 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:56:02.627650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be5b62cc-706a-4a16-83c5-c36cf4591b09 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:02.635783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-be5b62cc-706a-4a16-83c5-c36cf4591b09 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152057 Sep 02 09:56:02.636348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 580/1232] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:02 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:03.657716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0a3f73ed-e3cf-48ce-8890-e5e752fc3c07 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:03.658319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0a3f73ed-e3cf-48ce-8890-e5e752fc3c07 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:03.664846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a3f73ed-e3cf-48ce-8890-e5e752fc3c07 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:03.665327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a3f73ed-e3cf-48ce-8890-e5e752fc3c07 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:03.665756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a3f73ed-e3cf-48ce-8890-e5e752fc3c07 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:03.666452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a3f73ed-e3cf-48ce-8890-e5e752fc3c07 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:03.666911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a3f73ed-e3cf-48ce-8890-e5e752fc3c07 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:03.667333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a3f73ed-e3cf-48ce-8890-e5e752fc3c07 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:03.792360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0a3f73ed-e3cf-48ce-8890-e5e752fc3c07 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:03.800509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0a3f73ed-e3cf-48ce-8890-e5e752fc3c07 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147085 Sep 02 09:56:03.801078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 653/1233] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:03 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:04.821304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-673dcd07-33d7-4549-ad11-1686b1137a6c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:04.821928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-673dcd07-33d7-4549-ad11-1686b1137a6c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:04.828574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-673dcd07-33d7-4549-ad11-1686b1137a6c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:04.832380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-673dcd07-33d7-4549-ad11-1686b1137a6c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:04.832380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-673dcd07-33d7-4549-ad11-1686b1137a6c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:04.832380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-673dcd07-33d7-4549-ad11-1686b1137a6c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:04.832380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-673dcd07-33d7-4549-ad11-1686b1137a6c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:04.832966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-673dcd07-33d7-4549-ad11-1686b1137a6c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:04.960625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-673dcd07-33d7-4549-ad11-1686b1137a6c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:04.968679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-673dcd07-33d7-4549-ad11-1686b1137a6c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151300 Sep 02 09:56:04.969382 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 581/1234] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:04 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:05.989827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5eae75ff-f94a-43b4-a8fc-64c7b33f5bab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:05.990433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5eae75ff-f94a-43b4-a8fc-64c7b33f5bab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:05.992757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=26 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:56:05.997367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5eae75ff-f94a-43b4-a8fc-64c7b33f5bab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:05.997838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5eae75ff-f94a-43b4-a8fc-64c7b33f5bab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:05.998267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5eae75ff-f94a-43b4-a8fc-64c7b33f5bab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:05.998977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5eae75ff-f94a-43b4-a8fc-64c7b33f5bab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:05.999471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5eae75ff-f94a-43b4-a8fc-64c7b33f5bab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:05.999842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5eae75ff-f94a-43b4-a8fc-64c7b33f5bab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:06.132448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5eae75ff-f94a-43b4-a8fc-64c7b33f5bab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:06.140705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5eae75ff-f94a-43b4-a8fc-64c7b33f5bab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.155259 Sep 02 09:56:06.141267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 654/1235] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:05 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:07.162031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e909dfc4-6083-4d42-ac42-1cd3af55f8bb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:07.162571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e909dfc4-6083-4d42-ac42-1cd3af55f8bb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:07.168882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e909dfc4-6083-4d42-ac42-1cd3af55f8bb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:07.169356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e909dfc4-6083-4d42-ac42-1cd3af55f8bb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:07.169783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e909dfc4-6083-4d42-ac42-1cd3af55f8bb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:07.170472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e909dfc4-6083-4d42-ac42-1cd3af55f8bb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:07.170946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e909dfc4-6083-4d42-ac42-1cd3af55f8bb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:07.171366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e909dfc4-6083-4d42-ac42-1cd3af55f8bb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:07.300033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e909dfc4-6083-4d42-ac42-1cd3af55f8bb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:07.308216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e909dfc4-6083-4d42-ac42-1cd3af55f8bb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150112 Sep 02 09:56:07.308786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 582/1236] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:07 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:56:08.328468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f9747353-e622-4c9f-9536-9b05c911f9b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:08.329035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f9747353-e622-4c9f-9536-9b05c911f9b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:08.335315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9747353-e622-4c9f-9536-9b05c911f9b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:08.336084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9747353-e622-4c9f-9536-9b05c911f9b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:08.336520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9747353-e622-4c9f-9536-9b05c911f9b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:08.337233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9747353-e622-4c9f-9536-9b05c911f9b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:08.337681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9747353-e622-4c9f-9536-9b05c911f9b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:08.338101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9747353-e622-4c9f-9536-9b05c911f9b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:08.478489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f9747353-e622-4c9f-9536-9b05c911f9b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:08.487234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f9747353-e622-4c9f-9536-9b05c911f9b2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.162788 Sep 02 09:56:08.487791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 655/1237] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:08 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:09.507572 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d33e1737-6be7-4cd6-9f76-a9bcfaecb4c3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:09.508187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d33e1737-6be7-4cd6-9f76-a9bcfaecb4c3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:09.514918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d33e1737-6be7-4cd6-9f76-a9bcfaecb4c3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:09.515411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d33e1737-6be7-4cd6-9f76-a9bcfaecb4c3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:09.515848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d33e1737-6be7-4cd6-9f76-a9bcfaecb4c3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:09.516612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d33e1737-6be7-4cd6-9f76-a9bcfaecb4c3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:09.517068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d33e1737-6be7-4cd6-9f76-a9bcfaecb4c3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:09.517495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d33e1737-6be7-4cd6-9f76-a9bcfaecb4c3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:09.644603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d33e1737-6be7-4cd6-9f76-a9bcfaecb4c3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:09.652716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d33e1737-6be7-4cd6-9f76-a9bcfaecb4c3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149046 Sep 02 09:56:09.653276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 583/1238] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:09 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:10.674344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0a5dcda8-94ee-400a-ba2f-474da515f591 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:10.674993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0a5dcda8-94ee-400a-ba2f-474da515f591 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:10.681340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a5dcda8-94ee-400a-ba2f-474da515f591 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:10.681817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a5dcda8-94ee-400a-ba2f-474da515f591 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:10.682253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a5dcda8-94ee-400a-ba2f-474da515f591 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:10.682959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a5dcda8-94ee-400a-ba2f-474da515f591 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:10.683411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a5dcda8-94ee-400a-ba2f-474da515f591 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:10.683834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a5dcda8-94ee-400a-ba2f-474da515f591 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:10.811929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0a5dcda8-94ee-400a-ba2f-474da515f591 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:10.820130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0a5dcda8-94ee-400a-ba2f-474da515f591 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149780 Sep 02 09:56:10.820688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 656/1239] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:10 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:11.841385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7fb61e1d-c271-48ad-8fcf-d86d77820aa2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:11.841927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7fb61e1d-c271-48ad-8fcf-d86d77820aa2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:11.848946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb61e1d-c271-48ad-8fcf-d86d77820aa2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:11.849425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb61e1d-c271-48ad-8fcf-d86d77820aa2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:11.849856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb61e1d-c271-48ad-8fcf-d86d77820aa2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:11.850536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb61e1d-c271-48ad-8fcf-d86d77820aa2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:11.851012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb61e1d-c271-48ad-8fcf-d86d77820aa2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:11.851431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7fb61e1d-c271-48ad-8fcf-d86d77820aa2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:11.979501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7fb61e1d-c271-48ad-8fcf-d86d77820aa2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:11.987929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7fb61e1d-c271-48ad-8fcf-d86d77820aa2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150437 Sep 02 09:56:11.988594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 584/1240] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:11 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:13.008873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-914ba5d0-2182-4e61-b98e-2f537da8ca93 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:13.009416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-914ba5d0-2182-4e61-b98e-2f537da8ca93 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:13.016190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-914ba5d0-2182-4e61-b98e-2f537da8ca93 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:13.016685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-914ba5d0-2182-4e61-b98e-2f537da8ca93 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:13.017130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-914ba5d0-2182-4e61-b98e-2f537da8ca93 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:13.017829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-914ba5d0-2182-4e61-b98e-2f537da8ca93 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:13.018290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-914ba5d0-2182-4e61-b98e-2f537da8ca93 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:13.018729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-914ba5d0-2182-4e61-b98e-2f537da8ca93 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:13.021285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=84 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:56:13.146321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-914ba5d0-2182-4e61-b98e-2f537da8ca93 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:13.154483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-914ba5d0-2182-4e61-b98e-2f537da8ca93 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149575 Sep 02 09:56:13.155295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 657/1241] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:13 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:14.176139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-af681ab6-e255-445c-a9e6-50340f097c35 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:14.176755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-af681ab6-e255-445c-a9e6-50340f097c35 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:14.179087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=26 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:56:14.183794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af681ab6-e255-445c-a9e6-50340f097c35 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:14.184281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af681ab6-e255-445c-a9e6-50340f097c35 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:14.193706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af681ab6-e255-445c-a9e6-50340f097c35 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:14.193706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af681ab6-e255-445c-a9e6-50340f097c35 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:14.193706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af681ab6-e255-445c-a9e6-50340f097c35 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:14.193706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af681ab6-e255-445c-a9e6-50340f097c35 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:14.316182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-af681ab6-e255-445c-a9e6-50340f097c35 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:14.324218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-af681ab6-e255-445c-a9e6-50340f097c35 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152019 Sep 02 09:56:14.324778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 585/1242] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:14 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:15.345859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bcedcd3b-103e-4907-9a37-5e20d5eaa676 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:15.346496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bcedcd3b-103e-4907-9a37-5e20d5eaa676 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:15.352982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcedcd3b-103e-4907-9a37-5e20d5eaa676 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:15.353464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcedcd3b-103e-4907-9a37-5e20d5eaa676 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:15.353898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcedcd3b-103e-4907-9a37-5e20d5eaa676 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:15.354581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcedcd3b-103e-4907-9a37-5e20d5eaa676 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:15.355135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcedcd3b-103e-4907-9a37-5e20d5eaa676 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:15.355569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcedcd3b-103e-4907-9a37-5e20d5eaa676 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:15.483852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bcedcd3b-103e-4907-9a37-5e20d5eaa676 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:15.491975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bcedcd3b-103e-4907-9a37-5e20d5eaa676 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150590 Sep 02 09:56:15.492541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 658/1243] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:15 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:16.513779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ddf997df-fd38-4777-b3f1-eca7569a78e8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:16.514293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ddf997df-fd38-4777-b3f1-eca7569a78e8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:16.521156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddf997df-fd38-4777-b3f1-eca7569a78e8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:16.521813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddf997df-fd38-4777-b3f1-eca7569a78e8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:16.522255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddf997df-fd38-4777-b3f1-eca7569a78e8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:16.522973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddf997df-fd38-4777-b3f1-eca7569a78e8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:16.523426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddf997df-fd38-4777-b3f1-eca7569a78e8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:16.523849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddf997df-fd38-4777-b3f1-eca7569a78e8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:16.649496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ddf997df-fd38-4777-b3f1-eca7569a78e8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:16.657656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ddf997df-fd38-4777-b3f1-eca7569a78e8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148159 Sep 02 09:56:16.658217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 586/1244] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:16 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:17.678774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5c9085c3-fce4-42ae-b5f0-1769a5b590a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:17.679569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5c9085c3-fce4-42ae-b5f0-1769a5b590a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:17.685933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c9085c3-fce4-42ae-b5f0-1769a5b590a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:17.686419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c9085c3-fce4-42ae-b5f0-1769a5b590a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:17.686886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c9085c3-fce4-42ae-b5f0-1769a5b590a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:17.687577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c9085c3-fce4-42ae-b5f0-1769a5b590a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:17.688551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c9085c3-fce4-42ae-b5f0-1769a5b590a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:17.688980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c9085c3-fce4-42ae-b5f0-1769a5b590a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:17.814530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5c9085c3-fce4-42ae-b5f0-1769a5b590a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:17.822542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5c9085c3-fce4-42ae-b5f0-1769a5b590a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147758 Sep 02 09:56:17.823128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 659/1245] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:17 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:18.843942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9c6e59e5-00d9-4290-8655-3017e2e453a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:18.844548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9c6e59e5-00d9-4290-8655-3017e2e453a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:18.850996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c6e59e5-00d9-4290-8655-3017e2e453a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:18.851474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c6e59e5-00d9-4290-8655-3017e2e453a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:18.851903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c6e59e5-00d9-4290-8655-3017e2e453a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:18.852584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c6e59e5-00d9-4290-8655-3017e2e453a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:18.853032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c6e59e5-00d9-4290-8655-3017e2e453a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:18.853543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c6e59e5-00d9-4290-8655-3017e2e453a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:18.983362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9c6e59e5-00d9-4290-8655-3017e2e453a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:18.992024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9c6e59e5-00d9-4290-8655-3017e2e453a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151958 Sep 02 09:56:18.992584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 587/1246] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:18 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:20.013418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9318d42c-3511-40ae-9cc9-fd2d60bc7271 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:20.014037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9318d42c-3511-40ae-9cc9-fd2d60bc7271 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:20.020608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9318d42c-3511-40ae-9cc9-fd2d60bc7271 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:20.021090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9318d42c-3511-40ae-9cc9-fd2d60bc7271 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:20.021540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9318d42c-3511-40ae-9cc9-fd2d60bc7271 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:20.022232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9318d42c-3511-40ae-9cc9-fd2d60bc7271 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:20.022690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9318d42c-3511-40ae-9cc9-fd2d60bc7271 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:20.023141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9318d42c-3511-40ae-9cc9-fd2d60bc7271 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:20.148811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9318d42c-3511-40ae-9cc9-fd2d60bc7271 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:20.157358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9318d42c-3511-40ae-9cc9-fd2d60bc7271 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147600 Sep 02 09:56:20.157918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 660/1247] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:20 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:21.177776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aa50893f-1465-4b82-8c67-0135e4a2104b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:21.178370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aa50893f-1465-4b82-8c67-0135e4a2104b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:21.184838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa50893f-1465-4b82-8c67-0135e4a2104b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:21.185322 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa50893f-1465-4b82-8c67-0135e4a2104b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:21.185756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa50893f-1465-4b82-8c67-0135e4a2104b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:21.186441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa50893f-1465-4b82-8c67-0135e4a2104b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:21.186924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa50893f-1465-4b82-8c67-0135e4a2104b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:21.187353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa50893f-1465-4b82-8c67-0135e4a2104b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:21.311435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-aa50893f-1465-4b82-8c67-0135e4a2104b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:21.320145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aa50893f-1465-4b82-8c67-0135e4a2104b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146229 Sep 02 09:56:21.320704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 588/1248] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:21 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:22.340194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0a369a5a-e4ab-46bd-9826-1314c78ee5fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:22.340800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0a369a5a-e4ab-46bd-9826-1314c78ee5fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:22.347730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a369a5a-e4ab-46bd-9826-1314c78ee5fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:22.348213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a369a5a-e4ab-46bd-9826-1314c78ee5fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:22.348642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a369a5a-e4ab-46bd-9826-1314c78ee5fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:22.349324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a369a5a-e4ab-46bd-9826-1314c78ee5fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:22.349800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a369a5a-e4ab-46bd-9826-1314c78ee5fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:22.350219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0a369a5a-e4ab-46bd-9826-1314c78ee5fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:22.483464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0a369a5a-e4ab-46bd-9826-1314c78ee5fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:22.491482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0a369a5a-e4ab-46bd-9826-1314c78ee5fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.155287 Sep 02 09:56:22.492036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 661/1249] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:22 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:23.512034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d3b8ffa3-834d-4b34-9cc2-4d655f3082fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:23.512573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d3b8ffa3-834d-4b34-9cc2-4d655f3082fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:23.519038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3b8ffa3-834d-4b34-9cc2-4d655f3082fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:23.519521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3b8ffa3-834d-4b34-9cc2-4d655f3082fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:23.519956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3b8ffa3-834d-4b34-9cc2-4d655f3082fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:23.520640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3b8ffa3-834d-4b34-9cc2-4d655f3082fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:23.521090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3b8ffa3-834d-4b34-9cc2-4d655f3082fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:23.521513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3b8ffa3-834d-4b34-9cc2-4d655f3082fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:23.651759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d3b8ffa3-834d-4b34-9cc2-4d655f3082fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:23.660649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d3b8ffa3-834d-4b34-9cc2-4d655f3082fb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152822 Sep 02 09:56:23.661212 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 589/1250] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:23 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:24.682275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-74fed6c7-7016-4246-8368-182dd40a14ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:24.682923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-74fed6c7-7016-4246-8368-182dd40a14ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:24.689808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74fed6c7-7016-4246-8368-182dd40a14ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:24.690287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74fed6c7-7016-4246-8368-182dd40a14ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:24.690732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74fed6c7-7016-4246-8368-182dd40a14ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:24.691420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74fed6c7-7016-4246-8368-182dd40a14ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:24.691865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74fed6c7-7016-4246-8368-182dd40a14ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:24.692283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74fed6c7-7016-4246-8368-182dd40a14ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:24.823121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-74fed6c7-7016-4246-8368-182dd40a14ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:24.831348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-74fed6c7-7016-4246-8368-182dd40a14ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152808 Sep 02 09:56:24.831906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 662/1251] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:24 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:25.852369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-036f16b7-f339-4ef8-a18f-ef7737832fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:25.853014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-036f16b7-f339-4ef8-a18f-ef7737832fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:25.859493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-036f16b7-f339-4ef8-a18f-ef7737832fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:25.859980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-036f16b7-f339-4ef8-a18f-ef7737832fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:25.860423 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-036f16b7-f339-4ef8-a18f-ef7737832fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:25.861113 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-036f16b7-f339-4ef8-a18f-ef7737832fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:25.861570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-036f16b7-f339-4ef8-a18f-ef7737832fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:25.862001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-036f16b7-f339-4ef8-a18f-ef7737832fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:25.991851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-036f16b7-f339-4ef8-a18f-ef7737832fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:25.999978 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-036f16b7-f339-4ef8-a18f-ef7737832fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151508 Sep 02 09:56:26.001024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 590/1252] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:25 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:27.021226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cd8e1457-5b70-47ec-85c1-9db32e65bda5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:27.021762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cd8e1457-5b70-47ec-85c1-9db32e65bda5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:27.028268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd8e1457-5b70-47ec-85c1-9db32e65bda5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:27.028753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd8e1457-5b70-47ec-85c1-9db32e65bda5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:27.029190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd8e1457-5b70-47ec-85c1-9db32e65bda5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:27.029874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd8e1457-5b70-47ec-85c1-9db32e65bda5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:27.030327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd8e1457-5b70-47ec-85c1-9db32e65bda5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:27.030773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cd8e1457-5b70-47ec-85c1-9db32e65bda5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:27.159274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cd8e1457-5b70-47ec-85c1-9db32e65bda5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:27.167333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cd8e1457-5b70-47ec-85c1-9db32e65bda5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150092 Sep 02 09:56:27.167894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 663/1253] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:27 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:28.187806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-45a1849b-5167-4f0c-bd48-3c55ee5b97e5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:28.188410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-45a1849b-5167-4f0c-bd48-3c55ee5b97e5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:28.194723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a1849b-5167-4f0c-bd48-3c55ee5b97e5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:28.195215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a1849b-5167-4f0c-bd48-3c55ee5b97e5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:28.195645 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a1849b-5167-4f0c-bd48-3c55ee5b97e5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:28.196324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a1849b-5167-4f0c-bd48-3c55ee5b97e5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:28.196767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a1849b-5167-4f0c-bd48-3c55ee5b97e5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:28.197185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a1849b-5167-4f0c-bd48-3c55ee5b97e5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:28.325271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-45a1849b-5167-4f0c-bd48-3c55ee5b97e5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:28.333364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-45a1849b-5167-4f0c-bd48-3c55ee5b97e5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149485 Sep 02 09:56:28.333922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 591/1254] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:28 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:56:29.354901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ea966842-fbe9-406d-b988-1600b3841a77 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:29.355553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ea966842-fbe9-406d-b988-1600b3841a77 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:29.362611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea966842-fbe9-406d-b988-1600b3841a77 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:29.363142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea966842-fbe9-406d-b988-1600b3841a77 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:29.363583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea966842-fbe9-406d-b988-1600b3841a77 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:29.364306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea966842-fbe9-406d-b988-1600b3841a77 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:29.364763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea966842-fbe9-406d-b988-1600b3841a77 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:29.365195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea966842-fbe9-406d-b988-1600b3841a77 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:29.490358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ea966842-fbe9-406d-b988-1600b3841a77 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:29.498494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ea966842-fbe9-406d-b988-1600b3841a77 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147516 Sep 02 09:56:29.499165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 664/1255] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:29 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:30.520798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d5320d33-fc3b-44ed-a598-68633fb7f4f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:30.521435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d5320d33-fc3b-44ed-a598-68633fb7f4f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:30.527797 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5320d33-fc3b-44ed-a598-68633fb7f4f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:30.528274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5320d33-fc3b-44ed-a598-68633fb7f4f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:30.528705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5320d33-fc3b-44ed-a598-68633fb7f4f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:30.529381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5320d33-fc3b-44ed-a598-68633fb7f4f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:30.529829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5320d33-fc3b-44ed-a598-68633fb7f4f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:30.530253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5320d33-fc3b-44ed-a598-68633fb7f4f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:30.660769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d5320d33-fc3b-44ed-a598-68633fb7f4f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:30.668873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d5320d33-fc3b-44ed-a598-68633fb7f4f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152577 Sep 02 09:56:30.669436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 592/1256] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:30 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:31.689273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d60fe69d-cd11-4879-a088-c556271eb81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:31.689882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d60fe69d-cd11-4879-a088-c556271eb81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:31.696127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d60fe69d-cd11-4879-a088-c556271eb81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:31.696604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d60fe69d-cd11-4879-a088-c556271eb81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:31.697038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d60fe69d-cd11-4879-a088-c556271eb81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:31.697720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d60fe69d-cd11-4879-a088-c556271eb81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:31.698163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d60fe69d-cd11-4879-a088-c556271eb81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:31.698583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d60fe69d-cd11-4879-a088-c556271eb81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:31.823442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d60fe69d-cd11-4879-a088-c556271eb81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:31.832107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d60fe69d-cd11-4879-a088-c556271eb81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146676 Sep 02 09:56:31.832674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 665/1257] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:31 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:32.853326 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ddb4d2ae-9b7e-432f-94f9-cfadb131b5ab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:32.853933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ddb4d2ae-9b7e-432f-94f9-cfadb131b5ab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:32.860918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddb4d2ae-9b7e-432f-94f9-cfadb131b5ab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:32.861395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddb4d2ae-9b7e-432f-94f9-cfadb131b5ab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:32.861826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddb4d2ae-9b7e-432f-94f9-cfadb131b5ab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:32.862501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddb4d2ae-9b7e-432f-94f9-cfadb131b5ab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:32.862973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddb4d2ae-9b7e-432f-94f9-cfadb131b5ab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:32.863393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddb4d2ae-9b7e-432f-94f9-cfadb131b5ab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:32.865885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=78 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:56:32.993367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ddb4d2ae-9b7e-432f-94f9-cfadb131b5ab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:33.001548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ddb4d2ae-9b7e-432f-94f9-cfadb131b5ab tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152075 Sep 02 09:56:33.002109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 593/1258] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:32 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:34.022745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c9a91934-5732-4890-956a-2843404cd3ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:34.023305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c9a91934-5732-4890-956a-2843404cd3ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:34.029862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9a91934-5732-4890-956a-2843404cd3ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:34.030344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9a91934-5732-4890-956a-2843404cd3ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:34.030799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9a91934-5732-4890-956a-2843404cd3ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:34.031487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9a91934-5732-4890-956a-2843404cd3ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:34.031932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9a91934-5732-4890-956a-2843404cd3ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:34.032351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c9a91934-5732-4890-956a-2843404cd3ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:34.162733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c9a91934-5732-4890-956a-2843404cd3ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:34.170983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c9a91934-5732-4890-956a-2843404cd3ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152192 Sep 02 09:56:34.171541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 666/1259] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:34 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:35.193203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8fe7a87b-5f61-47b0-a190-d7dd12d65c69 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:35.193820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8fe7a87b-5f61-47b0-a190-d7dd12d65c69 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:35.200489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fe7a87b-5f61-47b0-a190-d7dd12d65c69 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:35.200977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fe7a87b-5f61-47b0-a190-d7dd12d65c69 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:35.201418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fe7a87b-5f61-47b0-a190-d7dd12d65c69 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:35.202109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fe7a87b-5f61-47b0-a190-d7dd12d65c69 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:35.202562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fe7a87b-5f61-47b0-a190-d7dd12d65c69 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:35.203021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fe7a87b-5f61-47b0-a190-d7dd12d65c69 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:35.338831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8fe7a87b-5f61-47b0-a190-d7dd12d65c69 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:35.346953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8fe7a87b-5f61-47b0-a190-d7dd12d65c69 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.157613 Sep 02 09:56:35.347514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 594/1260] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:35 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:36.368075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a238a72d-46b8-4dc1-8cb6-fb04856bd1bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:36.368681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a238a72d-46b8-4dc1-8cb6-fb04856bd1bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:36.370976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=26 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:56:36.376067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a238a72d-46b8-4dc1-8cb6-fb04856bd1bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:36.376635 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a238a72d-46b8-4dc1-8cb6-fb04856bd1bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:36.376972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a238a72d-46b8-4dc1-8cb6-fb04856bd1bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:36.377652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a238a72d-46b8-4dc1-8cb6-fb04856bd1bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:36.378099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a238a72d-46b8-4dc1-8cb6-fb04856bd1bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:36.378515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a238a72d-46b8-4dc1-8cb6-fb04856bd1bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:36.504533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a238a72d-46b8-4dc1-8cb6-fb04856bd1bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:36.512981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a238a72d-46b8-4dc1-8cb6-fb04856bd1bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148762 Sep 02 09:56:36.513551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 667/1261] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:36 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:37.533895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5117197e-00af-4a5a-bc9b-b02a0f0440ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:37.534558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5117197e-00af-4a5a-bc9b-b02a0f0440ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:37.540938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5117197e-00af-4a5a-bc9b-b02a0f0440ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:37.541411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5117197e-00af-4a5a-bc9b-b02a0f0440ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:37.542099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5117197e-00af-4a5a-bc9b-b02a0f0440ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:37.542804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5117197e-00af-4a5a-bc9b-b02a0f0440ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:37.543249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5117197e-00af-4a5a-bc9b-b02a0f0440ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:37.543670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5117197e-00af-4a5a-bc9b-b02a0f0440ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:37.671969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5117197e-00af-4a5a-bc9b-b02a0f0440ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:37.680187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5117197e-00af-4a5a-bc9b-b02a0f0440ad tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150708 Sep 02 09:56:37.682601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 595/1262] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:37 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:38.700967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cbe7499d-aaf1-43c1-9091-5b34891cc084 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:38.701538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cbe7499d-aaf1-43c1-9091-5b34891cc084 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:38.707580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cbe7499d-aaf1-43c1-9091-5b34891cc084 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:38.708054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cbe7499d-aaf1-43c1-9091-5b34891cc084 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:38.708490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cbe7499d-aaf1-43c1-9091-5b34891cc084 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:38.709182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cbe7499d-aaf1-43c1-9091-5b34891cc084 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:38.709646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cbe7499d-aaf1-43c1-9091-5b34891cc084 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:38.710055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cbe7499d-aaf1-43c1-9091-5b34891cc084 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:39.077487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cbe7499d-aaf1-43c1-9091-5b34891cc084 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:39.085514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cbe7499d-aaf1-43c1-9091-5b34891cc084 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.388670 Sep 02 09:56:39.086081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 668/1263] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:38 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:40.105818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2bc0b15d-23a6-4066-95e0-167438cb4cfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:40.106423 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2bc0b15d-23a6-4066-95e0-167438cb4cfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:40.112947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bc0b15d-23a6-4066-95e0-167438cb4cfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:40.113425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bc0b15d-23a6-4066-95e0-167438cb4cfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:40.113854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bc0b15d-23a6-4066-95e0-167438cb4cfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:40.114560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bc0b15d-23a6-4066-95e0-167438cb4cfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:40.115036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bc0b15d-23a6-4066-95e0-167438cb4cfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:40.115456 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bc0b15d-23a6-4066-95e0-167438cb4cfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:40.241309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2bc0b15d-23a6-4066-95e0-167438cb4cfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:40.249300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2bc0b15d-23a6-4066-95e0-167438cb4cfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147310 Sep 02 09:56:40.249861 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 596/1264] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:40 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:41.270838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-950c2769-f27d-4cf5-ac74-4a35da206623 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:41.271529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-950c2769-f27d-4cf5-ac74-4a35da206623 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:41.277868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-950c2769-f27d-4cf5-ac74-4a35da206623 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:41.278355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-950c2769-f27d-4cf5-ac74-4a35da206623 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:41.278819 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-950c2769-f27d-4cf5-ac74-4a35da206623 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:41.279507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-950c2769-f27d-4cf5-ac74-4a35da206623 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:41.279953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-950c2769-f27d-4cf5-ac74-4a35da206623 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:41.280372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-950c2769-f27d-4cf5-ac74-4a35da206623 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:41.405227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-950c2769-f27d-4cf5-ac74-4a35da206623 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:41.413274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-950c2769-f27d-4cf5-ac74-4a35da206623 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146260 Sep 02 09:56:41.413833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 669/1265] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:41 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:56:42.434629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-11f90eef-2af5-432b-a732-1805cfd4ca7d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:42.435214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-11f90eef-2af5-432b-a732-1805cfd4ca7d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:42.442106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f90eef-2af5-432b-a732-1805cfd4ca7d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:42.442583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f90eef-2af5-432b-a732-1805cfd4ca7d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:42.443046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f90eef-2af5-432b-a732-1805cfd4ca7d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:42.443725 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f90eef-2af5-432b-a732-1805cfd4ca7d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:42.444179 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f90eef-2af5-432b-a732-1805cfd4ca7d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:42.444597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f90eef-2af5-432b-a732-1805cfd4ca7d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:42.575920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-11f90eef-2af5-432b-a732-1805cfd4ca7d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:42.584910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-11f90eef-2af5-432b-a732-1805cfd4ca7d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154258 Sep 02 09:56:42.585503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 597/1266] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:42 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:43.605848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a63676dc-21da-4c1c-9604-a07823ae9b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:43.606486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a63676dc-21da-4c1c-9604-a07823ae9b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:43.612873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a63676dc-21da-4c1c-9604-a07823ae9b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:43.613346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a63676dc-21da-4c1c-9604-a07823ae9b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:43.613806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a63676dc-21da-4c1c-9604-a07823ae9b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:43.614481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a63676dc-21da-4c1c-9604-a07823ae9b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:43.614949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a63676dc-21da-4c1c-9604-a07823ae9b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:43.615376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a63676dc-21da-4c1c-9604-a07823ae9b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:43.617860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=78 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:56:43.750543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a63676dc-21da-4c1c-9604-a07823ae9b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:43.758647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a63676dc-21da-4c1c-9604-a07823ae9b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.156635 Sep 02 09:56:43.759230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 670/1267] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:43 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:44.779859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-83cd5433-6c7f-4d76-921d-4af2dfdf90ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:44.780471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-83cd5433-6c7f-4d76-921d-4af2dfdf90ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:44.782815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=26 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:56:44.787898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83cd5433-6c7f-4d76-921d-4af2dfdf90ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:44.793607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83cd5433-6c7f-4d76-921d-4af2dfdf90ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:44.793607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83cd5433-6c7f-4d76-921d-4af2dfdf90ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:44.793607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83cd5433-6c7f-4d76-921d-4af2dfdf90ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:44.793607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83cd5433-6c7f-4d76-921d-4af2dfdf90ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:44.793988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83cd5433-6c7f-4d76-921d-4af2dfdf90ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:44.916430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-83cd5433-6c7f-4d76-921d-4af2dfdf90ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:44.924820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-83cd5433-6c7f-4d76-921d-4af2dfdf90ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148780 Sep 02 09:56:44.925376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 598/1268] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:44 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:45.945831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-58508e96-21ca-4253-b55a-63014c00aceb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:45.946441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-58508e96-21ca-4253-b55a-63014c00aceb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:45.953444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58508e96-21ca-4253-b55a-63014c00aceb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:45.953932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58508e96-21ca-4253-b55a-63014c00aceb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:45.954369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58508e96-21ca-4253-b55a-63014c00aceb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:45.955109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58508e96-21ca-4253-b55a-63014c00aceb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:45.955564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58508e96-21ca-4253-b55a-63014c00aceb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:45.955988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58508e96-21ca-4253-b55a-63014c00aceb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:46.081871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-58508e96-21ca-4253-b55a-63014c00aceb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:46.089985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-58508e96-21ca-4253-b55a-63014c00aceb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147965 Sep 02 09:56:46.090552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 671/1269] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:45 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:47.111300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-81c18b16-e87f-4cb3-be31-4a34c4183a52 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:47.111948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-81c18b16-e87f-4cb3-be31-4a34c4183a52 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:47.118850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c18b16-e87f-4cb3-be31-4a34c4183a52 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:47.119330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c18b16-e87f-4cb3-be31-4a34c4183a52 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:47.119764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c18b16-e87f-4cb3-be31-4a34c4183a52 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:47.120447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c18b16-e87f-4cb3-be31-4a34c4183a52 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:47.120898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c18b16-e87f-4cb3-be31-4a34c4183a52 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:47.121325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c18b16-e87f-4cb3-be31-4a34c4183a52 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:47.250504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-81c18b16-e87f-4cb3-be31-4a34c4183a52 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:47.259236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-81c18b16-e87f-4cb3-be31-4a34c4183a52 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151860 Sep 02 09:56:47.259802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 599/1270] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:47 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:48.280422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1c5c6e4a-1cc3-42e5-8089-413dfd99235d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:48.281013 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1c5c6e4a-1cc3-42e5-8089-413dfd99235d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:48.287779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c5c6e4a-1cc3-42e5-8089-413dfd99235d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:48.288288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c5c6e4a-1cc3-42e5-8089-413dfd99235d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:48.288724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c5c6e4a-1cc3-42e5-8089-413dfd99235d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:48.289401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c5c6e4a-1cc3-42e5-8089-413dfd99235d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:48.289846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c5c6e4a-1cc3-42e5-8089-413dfd99235d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:48.290266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c5c6e4a-1cc3-42e5-8089-413dfd99235d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:48.421699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1c5c6e4a-1cc3-42e5-8089-413dfd99235d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:48.429856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1c5c6e4a-1cc3-42e5-8089-413dfd99235d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153316 Sep 02 09:56:48.430413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 672/1271] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:48 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:49.451118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c0c0596a-00e6-46fa-8684-de45932403ba tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:49.451730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c0c0596a-00e6-46fa-8684-de45932403ba tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:49.458575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0c0596a-00e6-46fa-8684-de45932403ba tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:49.459087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0c0596a-00e6-46fa-8684-de45932403ba tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:49.459524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0c0596a-00e6-46fa-8684-de45932403ba tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:49.460222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0c0596a-00e6-46fa-8684-de45932403ba tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:49.460667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0c0596a-00e6-46fa-8684-de45932403ba tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:49.461092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0c0596a-00e6-46fa-8684-de45932403ba tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:49.586570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c0c0596a-00e6-46fa-8684-de45932403ba tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:49.594958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c0c0596a-00e6-46fa-8684-de45932403ba tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147806 Sep 02 09:56:49.595532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 600/1272] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:49 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:50.617263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5153ca05-f989-400f-9e90-a11ff8e06e64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:50.617858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5153ca05-f989-400f-9e90-a11ff8e06e64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:50.624491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5153ca05-f989-400f-9e90-a11ff8e06e64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:50.624974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5153ca05-f989-400f-9e90-a11ff8e06e64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:50.625504 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5153ca05-f989-400f-9e90-a11ff8e06e64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:50.626074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5153ca05-f989-400f-9e90-a11ff8e06e64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:50.626529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5153ca05-f989-400f-9e90-a11ff8e06e64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:50.626955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5153ca05-f989-400f-9e90-a11ff8e06e64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:50.754272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5153ca05-f989-400f-9e90-a11ff8e06e64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:50.761860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5153ca05-f989-400f-9e90-a11ff8e06e64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148878 Sep 02 09:56:50.762426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 673/1273] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:50 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:51.782846 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-748bf193-676c-4a5b-b7b7-ed79f03d7043 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:51.783493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-748bf193-676c-4a5b-b7b7-ed79f03d7043 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:51.789925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-748bf193-676c-4a5b-b7b7-ed79f03d7043 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:51.790408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-748bf193-676c-4a5b-b7b7-ed79f03d7043 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:51.790875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-748bf193-676c-4a5b-b7b7-ed79f03d7043 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:51.791561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-748bf193-676c-4a5b-b7b7-ed79f03d7043 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:51.792014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-748bf193-676c-4a5b-b7b7-ed79f03d7043 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:51.792441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-748bf193-676c-4a5b-b7b7-ed79f03d7043 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:51.921519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-748bf193-676c-4a5b-b7b7-ed79f03d7043 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:51.930243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-748bf193-676c-4a5b-b7b7-ed79f03d7043 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151215 Sep 02 09:56:51.930826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 601/1274] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:51 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:52.951817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e723d509-efbc-41a5-b811-be57f0626be1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:52.952428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e723d509-efbc-41a5-b811-be57f0626be1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:52.958844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e723d509-efbc-41a5-b811-be57f0626be1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:52.959326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e723d509-efbc-41a5-b811-be57f0626be1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:52.959759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e723d509-efbc-41a5-b811-be57f0626be1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:52.960452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e723d509-efbc-41a5-b811-be57f0626be1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:52.960904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e723d509-efbc-41a5-b811-be57f0626be1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:52.961331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e723d509-efbc-41a5-b811-be57f0626be1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:53.090343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e723d509-efbc-41a5-b811-be57f0626be1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:53.099220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e723d509-efbc-41a5-b811-be57f0626be1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150670 Sep 02 09:56:53.099808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 674/1275] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:52 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:54.120198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-065d7d5a-892a-48ad-9377-1c3f5ee08df0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:54.120816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-065d7d5a-892a-48ad-9377-1c3f5ee08df0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:54.127234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-065d7d5a-892a-48ad-9377-1c3f5ee08df0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:54.127716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-065d7d5a-892a-48ad-9377-1c3f5ee08df0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:54.128151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-065d7d5a-892a-48ad-9377-1c3f5ee08df0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:54.128839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-065d7d5a-892a-48ad-9377-1c3f5ee08df0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:54.129293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-065d7d5a-892a-48ad-9377-1c3f5ee08df0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:54.129719 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-065d7d5a-892a-48ad-9377-1c3f5ee08df0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:54.261939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-065d7d5a-892a-48ad-9377-1c3f5ee08df0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:54.270072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-065d7d5a-892a-48ad-9377-1c3f5ee08df0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153752 Sep 02 09:56:54.270651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 602/1276] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:54 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:55.290273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c71e4f36-f3f9-4da4-bb62-4e768c55e214 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:55.291141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c71e4f36-f3f9-4da4-bb62-4e768c55e214 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:55.297482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71e4f36-f3f9-4da4-bb62-4e768c55e214 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:55.298075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71e4f36-f3f9-4da4-bb62-4e768c55e214 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:55.298515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71e4f36-f3f9-4da4-bb62-4e768c55e214 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:55.299239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71e4f36-f3f9-4da4-bb62-4e768c55e214 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:55.299694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71e4f36-f3f9-4da4-bb62-4e768c55e214 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:55.300137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71e4f36-f3f9-4da4-bb62-4e768c55e214 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:55.430332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c71e4f36-f3f9-4da4-bb62-4e768c55e214 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:55.438410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c71e4f36-f3f9-4da4-bb62-4e768c55e214 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152217 Sep 02 09:56:55.438994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 675/1277] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:55 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:56.460509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-34493570-0ba9-491e-9f32-abb690c77d80 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:56.461116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-34493570-0ba9-491e-9f32-abb690c77d80 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:56.467517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34493570-0ba9-491e-9f32-abb690c77d80 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:56.467994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34493570-0ba9-491e-9f32-abb690c77d80 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:56.468421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34493570-0ba9-491e-9f32-abb690c77d80 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:56.469094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34493570-0ba9-491e-9f32-abb690c77d80 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:56.469541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34493570-0ba9-491e-9f32-abb690c77d80 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:56.469957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34493570-0ba9-491e-9f32-abb690c77d80 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:56.596620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-34493570-0ba9-491e-9f32-abb690c77d80 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:56.604740 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-34493570-0ba9-491e-9f32-abb690c77d80 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148594 Sep 02 09:56:56.605301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 603/1278] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:56 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:57.625660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-46682d88-81e0-49db-850c-824c856d51b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:57.626197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-46682d88-81e0-49db-850c-824c856d51b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:57.632567 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46682d88-81e0-49db-850c-824c856d51b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:57.633048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46682d88-81e0-49db-850c-824c856d51b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:57.633491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46682d88-81e0-49db-850c-824c856d51b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:57.634181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46682d88-81e0-49db-850c-824c856d51b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:57.634632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46682d88-81e0-49db-850c-824c856d51b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:57.635085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46682d88-81e0-49db-850c-824c856d51b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:57.765684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-46682d88-81e0-49db-850c-824c856d51b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:57.774848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-46682d88-81e0-49db-850c-824c856d51b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153374 Sep 02 09:56:57.775408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 676/1279] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:57 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:58.796656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-15454091-ba0c-4771-8713-313f34199e14 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:58.797224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-15454091-ba0c-4771-8713-313f34199e14 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:58.804275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15454091-ba0c-4771-8713-313f34199e14 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:58.804751 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15454091-ba0c-4771-8713-313f34199e14 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:58.805187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15454091-ba0c-4771-8713-313f34199e14 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:58.805873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15454091-ba0c-4771-8713-313f34199e14 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:58.806321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15454091-ba0c-4771-8713-313f34199e14 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:58.806769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-15454091-ba0c-4771-8713-313f34199e14 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:58.936660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-15454091-ba0c-4771-8713-313f34199e14 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:56:58.944812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-15454091-ba0c-4771-8713-313f34199e14 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152180 Sep 02 09:56:58.945381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 604/1280] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:58 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:56:59.965757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ea8f4bf7-b689-431e-9288-1abfde3abd66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:56:59.966375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ea8f4bf7-b689-431e-9288-1abfde3abd66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:56:59.972802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea8f4bf7-b689-431e-9288-1abfde3abd66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:59.973284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea8f4bf7-b689-431e-9288-1abfde3abd66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:59.973797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea8f4bf7-b689-431e-9288-1abfde3abd66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:56:59.974483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea8f4bf7-b689-431e-9288-1abfde3abd66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:56:59.974966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea8f4bf7-b689-431e-9288-1abfde3abd66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:56:59.975394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ea8f4bf7-b689-431e-9288-1abfde3abd66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:00.104689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ea8f4bf7-b689-431e-9288-1abfde3abd66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:00.112780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ea8f4bf7-b689-431e-9288-1abfde3abd66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151253 Sep 02 09:57:00.113346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 677/1281] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:56:59 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:01.134831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d9e14e52-9477-4e26-b77d-c1904708b178 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:01.135381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d9e14e52-9477-4e26-b77d-c1904708b178 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:01.141995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9e14e52-9477-4e26-b77d-c1904708b178 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:01.142473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9e14e52-9477-4e26-b77d-c1904708b178 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:01.142937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9e14e52-9477-4e26-b77d-c1904708b178 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:01.143612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9e14e52-9477-4e26-b77d-c1904708b178 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:01.144055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9e14e52-9477-4e26-b77d-c1904708b178 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:01.144516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9e14e52-9477-4e26-b77d-c1904708b178 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:01.271907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d9e14e52-9477-4e26-b77d-c1904708b178 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:01.280320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d9e14e52-9477-4e26-b77d-c1904708b178 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149658 Sep 02 09:57:01.280879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 605/1282] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:01 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:02.301481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9a59bc83-b783-4e85-98e2-27a8c41dabfe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:02.302095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9a59bc83-b783-4e85-98e2-27a8c41dabfe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:02.308502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a59bc83-b783-4e85-98e2-27a8c41dabfe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:02.308979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a59bc83-b783-4e85-98e2-27a8c41dabfe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:02.309411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a59bc83-b783-4e85-98e2-27a8c41dabfe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:02.310093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a59bc83-b783-4e85-98e2-27a8c41dabfe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:02.310538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a59bc83-b783-4e85-98e2-27a8c41dabfe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:02.310984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a59bc83-b783-4e85-98e2-27a8c41dabfe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:02.438368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9a59bc83-b783-4e85-98e2-27a8c41dabfe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:02.447222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9a59bc83-b783-4e85-98e2-27a8c41dabfe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149713 Sep 02 09:57:02.447827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 678/1283] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:02 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:03.469612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f872754e-1061-45b1-8df0-ba6f3dd7b73a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:03.470220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f872754e-1061-45b1-8df0-ba6f3dd7b73a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:03.476661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f872754e-1061-45b1-8df0-ba6f3dd7b73a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:03.477137 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f872754e-1061-45b1-8df0-ba6f3dd7b73a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:03.477570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f872754e-1061-45b1-8df0-ba6f3dd7b73a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:03.478250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f872754e-1061-45b1-8df0-ba6f3dd7b73a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:03.478697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f872754e-1061-45b1-8df0-ba6f3dd7b73a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:03.479143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f872754e-1061-45b1-8df0-ba6f3dd7b73a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:03.483040 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=78 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:57:03.608997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f872754e-1061-45b1-8df0-ba6f3dd7b73a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:03.617563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f872754e-1061-45b1-8df0-ba6f3dd7b73a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152021 Sep 02 09:57:03.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 606/1284] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:03 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:04.639537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3de33e16-95b7-41e4-9cde-74bef971d4d1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:04.640158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3de33e16-95b7-41e4-9cde-74bef971d4d1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:04.646595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de33e16-95b7-41e4-9cde-74bef971d4d1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:04.647111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de33e16-95b7-41e4-9cde-74bef971d4d1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:04.647554 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de33e16-95b7-41e4-9cde-74bef971d4d1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:04.648239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de33e16-95b7-41e4-9cde-74bef971d4d1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:04.648695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de33e16-95b7-41e4-9cde-74bef971d4d1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:04.649121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de33e16-95b7-41e4-9cde-74bef971d4d1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:04.775970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3de33e16-95b7-41e4-9cde-74bef971d4d1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:04.784427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3de33e16-95b7-41e4-9cde-74bef971d4d1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149096 Sep 02 09:57:04.785009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 679/1285] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:04 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:05.805362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bb56dcc3-d6a1-4f8e-9170-ca95a638da12 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:05.805974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bb56dcc3-d6a1-4f8e-9170-ca95a638da12 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:05.809154 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:57:05.809323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 09:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b (ip 10.222.0.57) !!! Sep 02 09:57:05.815379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb56dcc3-d6a1-4f8e-9170-ca95a638da12 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:05.815860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb56dcc3-d6a1-4f8e-9170-ca95a638da12 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:05.816300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb56dcc3-d6a1-4f8e-9170-ca95a638da12 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:05.817478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb56dcc3-d6a1-4f8e-9170-ca95a638da12 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:05.817931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb56dcc3-d6a1-4f8e-9170-ca95a638da12 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:05.818388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb56dcc3-d6a1-4f8e-9170-ca95a638da12 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:05.947699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb56dcc3-d6a1-4f8e-9170-ca95a638da12 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:05.955797 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bb56dcc3-d6a1-4f8e-9170-ca95a638da12 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154370 Sep 02 09:57:05.956360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 607/1286] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:05 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:06.976796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2fd6a17e-5fd8-4dc6-8f60-06a329828112 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:06.977410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2fd6a17e-5fd8-4dc6-8f60-06a329828112 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:06.979722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=26 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:57:06.984313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2fd6a17e-5fd8-4dc6-8f60-06a329828112 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:06.984792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2fd6a17e-5fd8-4dc6-8f60-06a329828112 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:06.985234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2fd6a17e-5fd8-4dc6-8f60-06a329828112 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:06.985907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2fd6a17e-5fd8-4dc6-8f60-06a329828112 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:06.986354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2fd6a17e-5fd8-4dc6-8f60-06a329828112 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:06.986804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2fd6a17e-5fd8-4dc6-8f60-06a329828112 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:07.117519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2fd6a17e-5fd8-4dc6-8f60-06a329828112 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:07.125536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2fd6a17e-5fd8-4dc6-8f60-06a329828112 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152583 Sep 02 09:57:07.126106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 680/1287] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:06 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:08.148069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-146ca400-cec0-4ae8-9063-a61ea0b9b1e6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:08.148676 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-146ca400-cec0-4ae8-9063-a61ea0b9b1e6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:08.155066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-146ca400-cec0-4ae8-9063-a61ea0b9b1e6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:08.155541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-146ca400-cec0-4ae8-9063-a61ea0b9b1e6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:08.156009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-146ca400-cec0-4ae8-9063-a61ea0b9b1e6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:08.156682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-146ca400-cec0-4ae8-9063-a61ea0b9b1e6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:08.157127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-146ca400-cec0-4ae8-9063-a61ea0b9b1e6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:08.157541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-146ca400-cec0-4ae8-9063-a61ea0b9b1e6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:08.282733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-146ca400-cec0-4ae8-9063-a61ea0b9b1e6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:08.291527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-146ca400-cec0-4ae8-9063-a61ea0b9b1e6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148242 Sep 02 09:57:08.292093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 608/1288] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:08 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:09.312591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-64d168c8-f746-4153-b32d-cb15a7d37e66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:09.313140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-64d168c8-f746-4153-b32d-cb15a7d37e66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:09.315574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 09:57:09.315722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 09:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b (ip 10.222.0.57) !!! Sep 02 09:57:09.321840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64d168c8-f746-4153-b32d-cb15a7d37e66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:09.322331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64d168c8-f746-4153-b32d-cb15a7d37e66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:09.322790 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64d168c8-f746-4153-b32d-cb15a7d37e66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:09.323492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64d168c8-f746-4153-b32d-cb15a7d37e66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:09.323948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64d168c8-f746-4153-b32d-cb15a7d37e66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:09.324378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-64d168c8-f746-4153-b32d-cb15a7d37e66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:09.453512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-64d168c8-f746-4153-b32d-cb15a7d37e66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:09.461653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-64d168c8-f746-4153-b32d-cb15a7d37e66 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153170 Sep 02 09:57:09.462225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 681/1289] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:09 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:10.483102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d71d59bc-08be-498c-9c5a-c10cf47a0d54 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:10.483707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d71d59bc-08be-498c-9c5a-c10cf47a0d54 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:10.490174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d71d59bc-08be-498c-9c5a-c10cf47a0d54 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:10.490651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d71d59bc-08be-498c-9c5a-c10cf47a0d54 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:10.491177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d71d59bc-08be-498c-9c5a-c10cf47a0d54 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:10.491851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d71d59bc-08be-498c-9c5a-c10cf47a0d54 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:10.492296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d71d59bc-08be-498c-9c5a-c10cf47a0d54 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:10.492713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d71d59bc-08be-498c-9c5a-c10cf47a0d54 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:10.624706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d71d59bc-08be-498c-9c5a-c10cf47a0d54 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:10.632744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d71d59bc-08be-498c-9c5a-c10cf47a0d54 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153497 Sep 02 09:57:10.633302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 609/1290] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:10 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:11.654532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f568d8fe-8136-48c3-ac3b-6f03e68da5ea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:11.655186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f568d8fe-8136-48c3-ac3b-6f03e68da5ea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:11.661643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f568d8fe-8136-48c3-ac3b-6f03e68da5ea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:11.662123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f568d8fe-8136-48c3-ac3b-6f03e68da5ea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:11.662587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f568d8fe-8136-48c3-ac3b-6f03e68da5ea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:11.663307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f568d8fe-8136-48c3-ac3b-6f03e68da5ea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:11.663763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f568d8fe-8136-48c3-ac3b-6f03e68da5ea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:11.664219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f568d8fe-8136-48c3-ac3b-6f03e68da5ea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:11.795706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f568d8fe-8136-48c3-ac3b-6f03e68da5ea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:11.803919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f568d8fe-8136-48c3-ac3b-6f03e68da5ea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153289 Sep 02 09:57:11.804476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 682/1291] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:11 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:12.825293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-44aa1756-12dd-4b64-ae12-42eeedeb298d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:12.825904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-44aa1756-12dd-4b64-ae12-42eeedeb298d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:12.832337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44aa1756-12dd-4b64-ae12-42eeedeb298d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:12.832820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44aa1756-12dd-4b64-ae12-42eeedeb298d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:12.833745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44aa1756-12dd-4b64-ae12-42eeedeb298d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:12.834434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44aa1756-12dd-4b64-ae12-42eeedeb298d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:12.834915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44aa1756-12dd-4b64-ae12-42eeedeb298d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:12.835341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44aa1756-12dd-4b64-ae12-42eeedeb298d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:12.963147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-44aa1756-12dd-4b64-ae12-42eeedeb298d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:12.971206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-44aa1756-12dd-4b64-ae12-42eeedeb298d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149805 Sep 02 09:57:12.971774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 610/1292] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:12 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:13.992539 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7a6efb43-1490-4771-82c1-ac7160950571 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:13.993152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7a6efb43-1490-4771-82c1-ac7160950571 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:13.999738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a6efb43-1490-4771-82c1-ac7160950571 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:14.000218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a6efb43-1490-4771-82c1-ac7160950571 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:14.000654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a6efb43-1490-4771-82c1-ac7160950571 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:14.001363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a6efb43-1490-4771-82c1-ac7160950571 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:14.001817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a6efb43-1490-4771-82c1-ac7160950571 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:14.002237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a6efb43-1490-4771-82c1-ac7160950571 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:14.006225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=78 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:57:14.127909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7a6efb43-1490-4771-82c1-ac7160950571 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:14.136268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7a6efb43-1490-4771-82c1-ac7160950571 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148241 Sep 02 09:57:14.136835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 683/1293] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:13 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:15.157470 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2e5a7e8e-f7a0-4c6a-a3ac-9bbc075b9020 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:15.158026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2e5a7e8e-f7a0-4c6a-a3ac-9bbc075b9020 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:15.160383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=26 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:57:15.164986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e8e-f7a0-4c6a-a3ac-9bbc075b9020 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:15.165468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e8e-f7a0-4c6a-a3ac-9bbc075b9020 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:15.165907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e8e-f7a0-4c6a-a3ac-9bbc075b9020 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:15.166593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e8e-f7a0-4c6a-a3ac-9bbc075b9020 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:15.167087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e8e-f7a0-4c6a-a3ac-9bbc075b9020 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:15.167505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e8e-f7a0-4c6a-a3ac-9bbc075b9020 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:15.296222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2e5a7e8e-f7a0-4c6a-a3ac-9bbc075b9020 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:15.304991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2e5a7e8e-f7a0-4c6a-a3ac-9bbc075b9020 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151517 Sep 02 09:57:15.305772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 611/1294] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:15 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:16.014075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bc3dfc32-afa6-4504-b5b0-5c18063437a1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:16.014603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bc3dfc32-afa6-4504-b5b0-5c18063437a1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:16.020997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc32-afa6-4504-b5b0-5c18063437a1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:16.021488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc32-afa6-4504-b5b0-5c18063437a1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:16.021929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc32-afa6-4504-b5b0-5c18063437a1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:16.022619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc32-afa6-4504-b5b0-5c18063437a1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:16.023097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc32-afa6-4504-b5b0-5c18063437a1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:16.023525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc3dfc32-afa6-4504-b5b0-5c18063437a1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:16.048613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bc3dfc32-afa6-4504-b5b0-5c18063437a1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Going to try to terminate instance {{(pid=127533) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 09:57:16.289503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bc3dfc32-afa6-4504-b5b0-5c18063437a1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 204 len: 0 microversion: 2.1 time: 0.279249 Sep 02 09:57:16.290093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 684/1295] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 09:57:16 2022] DELETE /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 09:57:16.298274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ad2c3d99-1f8f-479c-8817-18a3fbac3196 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:16.298976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ad2c3d99-1f8f-479c-8817-18a3fbac3196 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:16.306175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad2c3d99-1f8f-479c-8817-18a3fbac3196 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:16.306655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad2c3d99-1f8f-479c-8817-18a3fbac3196 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:16.307152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad2c3d99-1f8f-479c-8817-18a3fbac3196 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:16.307840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad2c3d99-1f8f-479c-8817-18a3fbac3196 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:16.308288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad2c3d99-1f8f-479c-8817-18a3fbac3196 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:16.308709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad2c3d99-1f8f-479c-8817-18a3fbac3196 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:16.325880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dcf7fbbd-eda1-45e6-ab04-0abf35e10b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:16.326734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dcf7fbbd-eda1-45e6-ab04-0abf35e10b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:16.333360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dcf7fbbd-eda1-45e6-ab04-0abf35e10b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:16.333859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dcf7fbbd-eda1-45e6-ab04-0abf35e10b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:16.334298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dcf7fbbd-eda1-45e6-ab04-0abf35e10b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:16.335021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dcf7fbbd-eda1-45e6-ab04-0abf35e10b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:16.335471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dcf7fbbd-eda1-45e6-ab04-0abf35e10b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:16.335894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dcf7fbbd-eda1-45e6-ab04-0abf35e10b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:16.441083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ad2c3d99-1f8f-479c-8817-18a3fbac3196 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:16.449518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ad2c3d99-1f8f-479c-8817-18a3fbac3196 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1717 microversion: 2.1 time: 0.155142 Sep 02 09:57:16.450213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 612/1296] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:16 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:16.475438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dcf7fbbd-eda1-45e6-ab04-0abf35e10b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:16.482132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dcf7fbbd-eda1-45e6-ab04-0abf35e10b51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.160500 Sep 02 09:57:16.482691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 685/1297] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:16 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:57:17.470814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-761324eb-0ff2-4d1c-9a52-5c47ed44433f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:17.471473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-761324eb-0ff2-4d1c-9a52-5c47ed44433f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:17.478380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-761324eb-0ff2-4d1c-9a52-5c47ed44433f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:17.478902 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-761324eb-0ff2-4d1c-9a52-5c47ed44433f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:17.479378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-761324eb-0ff2-4d1c-9a52-5c47ed44433f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:17.480071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-761324eb-0ff2-4d1c-9a52-5c47ed44433f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:17.480529 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-761324eb-0ff2-4d1c-9a52-5c47ed44433f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:17.480956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-761324eb-0ff2-4d1c-9a52-5c47ed44433f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:17.515867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dd0949aa-3c86-4497-a6af-123b712759f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:17.516515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dd0949aa-3c86-4497-a6af-123b712759f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:17.523057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd0949aa-3c86-4497-a6af-123b712759f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:17.523551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd0949aa-3c86-4497-a6af-123b712759f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:17.523991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd0949aa-3c86-4497-a6af-123b712759f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:17.524687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd0949aa-3c86-4497-a6af-123b712759f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:17.525141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd0949aa-3c86-4497-a6af-123b712759f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:17.525566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd0949aa-3c86-4497-a6af-123b712759f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:17.608870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-761324eb-0ff2-4d1c-9a52-5c47ed44433f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:17.617929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-761324eb-0ff2-4d1c-9a52-5c47ed44433f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1717 microversion: 2.1 time: 0.151059 Sep 02 09:57:17.618592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 613/1298] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:17 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:17.730679 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dd0949aa-3c86-4497-a6af-123b712759f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:17.738756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dd0949aa-3c86-4497-a6af-123b712759f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.226719 Sep 02 09:57:17.740014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 686/1299] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:17 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:57:18.639512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-352f81b4-343b-4f4d-9003-509abaf5dfc9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:18.640871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-352f81b4-343b-4f4d-9003-509abaf5dfc9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:18.648671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-352f81b4-343b-4f4d-9003-509abaf5dfc9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:18.650915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-352f81b4-343b-4f4d-9003-509abaf5dfc9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:18.650915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-352f81b4-343b-4f4d-9003-509abaf5dfc9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:18.650915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-352f81b4-343b-4f4d-9003-509abaf5dfc9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:18.650915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-352f81b4-343b-4f4d-9003-509abaf5dfc9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:18.651807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-352f81b4-343b-4f4d-9003-509abaf5dfc9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:18.673829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-0e1a9baa-5831-4a32-ae04-3f59c63a5914 req-bf987f8a-cc35-457a-b264-118fb57c826b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae283fdc-e807-415c-a156-8ec24163c45f", "name": "network-vif-deleted", "tag": "0277f0c4-2ab4-4648-b7be-e37876a5929e"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 09:57:18.687731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-0e1a9baa-5831-4a32-ae04-3f59c63a5914 req-bf987f8a-cc35-457a-b264-118fb57c826b service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:18.688324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-0e1a9baa-5831-4a32-ae04-3f59c63a5914 req-bf987f8a-cc35-457a-b264-118fb57c826b service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:18.688753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-0e1a9baa-5831-4a32-ae04-3f59c63a5914 req-bf987f8a-cc35-457a-b264-118fb57c826b service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:18.708706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-0e1a9baa-5831-4a32-ae04-3f59c63a5914 req-bf987f8a-cc35-457a-b264-118fb57c826b service nova] Creating event network-vif-deleted:0277f0c4-2ab4-4648-b7be-e37876a5929e for instance ae283fdc-e807-415c-a156-8ec24163c45f on hv-cinder-85083 Sep 02 09:57:18.731729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-0e1a9baa-5831-4a32-ae04-3f59c63a5914 req-bf987f8a-cc35-457a-b264-118fb57c826b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212649 Sep 02 09:57:18.733437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 614/1300] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 09:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 09:57:18.746341 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-352f81b4-343b-4f4d-9003-509abaf5dfc9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:18.753133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-352f81b4-343b-4f4d-9003-509abaf5dfc9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1649 microversion: 2.1 time: 0.117740 Sep 02 09:57:18.764689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dab2c1b3-4f15-47f3-ad51-bb471e7f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:18.765689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dab2c1b3-4f15-47f3-ad51-bb471e7f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:18.767240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 687/1301] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:18 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1649 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:57:18.773616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab2c1b3-4f15-47f3-ad51-bb471e7f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:18.774236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab2c1b3-4f15-47f3-ad51-bb471e7f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:18.774665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab2c1b3-4f15-47f3-ad51-bb471e7f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:18.775462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab2c1b3-4f15-47f3-ad51-bb471e7f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:18.775915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab2c1b3-4f15-47f3-ad51-bb471e7f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:18.776357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab2c1b3-4f15-47f3-ad51-bb471e7f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:18.916021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dab2c1b3-4f15-47f3-ad51-bb471e7f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:18.924575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dab2c1b3-4f15-47f3-ad51-bb471e7f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.166398 Sep 02 09:57:18.925261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 615/1302] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:18 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:19.776084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f544a865-f32f-4493-a729-c3fdf1ad8843 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:19.776692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f544a865-f32f-4493-a729-c3fdf1ad8843 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:19.783269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f544a865-f32f-4493-a729-c3fdf1ad8843 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:19.783749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f544a865-f32f-4493-a729-c3fdf1ad8843 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:19.784180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f544a865-f32f-4493-a729-c3fdf1ad8843 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:19.784863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f544a865-f32f-4493-a729-c3fdf1ad8843 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:19.785306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f544a865-f32f-4493-a729-c3fdf1ad8843 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:19.785723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f544a865-f32f-4493-a729-c3fdf1ad8843 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:19.847365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f544a865-f32f-4493-a729-c3fdf1ad8843 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:19.856019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f544a865-f32f-4493-a729-c3fdf1ad8843 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083898 Sep 02 09:57:19.856516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 688/1303] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:19 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:19.945599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a02bf020-e6b0-4f91-8456-aa39d92dec51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:19.946207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a02bf020-e6b0-4f91-8456-aa39d92dec51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:19.953282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a02bf020-e6b0-4f91-8456-aa39d92dec51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:19.953758 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a02bf020-e6b0-4f91-8456-aa39d92dec51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:19.954183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a02bf020-e6b0-4f91-8456-aa39d92dec51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:19.954895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a02bf020-e6b0-4f91-8456-aa39d92dec51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:19.955373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a02bf020-e6b0-4f91-8456-aa39d92dec51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:19.955792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a02bf020-e6b0-4f91-8456-aa39d92dec51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:20.086793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a02bf020-e6b0-4f91-8456-aa39d92dec51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:20.094907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a02bf020-e6b0-4f91-8456-aa39d92dec51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153414 Sep 02 09:57:20.095472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 616/1304] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:19 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:20.877316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-60ed8fe8-b594-42ef-b49e-c55163c122ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:20.877924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-60ed8fe8-b594-42ef-b49e-c55163c122ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:20.884489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60ed8fe8-b594-42ef-b49e-c55163c122ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:20.884972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60ed8fe8-b594-42ef-b49e-c55163c122ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:20.885656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60ed8fe8-b594-42ef-b49e-c55163c122ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:20.886340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60ed8fe8-b594-42ef-b49e-c55163c122ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:20.886824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60ed8fe8-b594-42ef-b49e-c55163c122ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:20.887250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60ed8fe8-b594-42ef-b49e-c55163c122ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:20.947644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-60ed8fe8-b594-42ef-b49e-c55163c122ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:20.955698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-60ed8fe8-b594-42ef-b49e-c55163c122ca tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082233 Sep 02 09:57:20.956258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 689/1305] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:20 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:21.117240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cbcbc52e-05ed-4d8e-afdc-7589ab4484ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:21.117761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cbcbc52e-05ed-4d8e-afdc-7589ab4484ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:21.124217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbcbc52e-05ed-4d8e-afdc-7589ab4484ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:21.124705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbcbc52e-05ed-4d8e-afdc-7589ab4484ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:21.125140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbcbc52e-05ed-4d8e-afdc-7589ab4484ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:21.125839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbcbc52e-05ed-4d8e-afdc-7589ab4484ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:21.126303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbcbc52e-05ed-4d8e-afdc-7589ab4484ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:21.126752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cbcbc52e-05ed-4d8e-afdc-7589ab4484ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:21.255166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cbcbc52e-05ed-4d8e-afdc-7589ab4484ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:21.263622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cbcbc52e-05ed-4d8e-afdc-7589ab4484ce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150944 Sep 02 09:57:21.264194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 617/1306] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:21 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:21.976114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-67cc1c12-9042-4fbc-9c43-75a64eebffff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:21.976728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-67cc1c12-9042-4fbc-9c43-75a64eebffff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:21.983263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67cc1c12-9042-4fbc-9c43-75a64eebffff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:21.983744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67cc1c12-9042-4fbc-9c43-75a64eebffff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:21.984183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67cc1c12-9042-4fbc-9c43-75a64eebffff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:21.984871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67cc1c12-9042-4fbc-9c43-75a64eebffff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:21.985322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67cc1c12-9042-4fbc-9c43-75a64eebffff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:21.985747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67cc1c12-9042-4fbc-9c43-75a64eebffff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:22.048960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67cc1c12-9042-4fbc-9c43-75a64eebffff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:22.057550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-67cc1c12-9042-4fbc-9c43-75a64eebffff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085351 Sep 02 09:57:22.058106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 690/1307] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:21 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:22.284972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3ceb3018-8588-41cd-8c73-c3dc2ea9bf04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:22.285556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3ceb3018-8588-41cd-8c73-c3dc2ea9bf04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:22.291931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ceb3018-8588-41cd-8c73-c3dc2ea9bf04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:22.292407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ceb3018-8588-41cd-8c73-c3dc2ea9bf04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:22.292832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ceb3018-8588-41cd-8c73-c3dc2ea9bf04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:22.293504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ceb3018-8588-41cd-8c73-c3dc2ea9bf04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:22.293949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ceb3018-8588-41cd-8c73-c3dc2ea9bf04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:22.294365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ceb3018-8588-41cd-8c73-c3dc2ea9bf04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:22.422257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3ceb3018-8588-41cd-8c73-c3dc2ea9bf04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:22.431530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3ceb3018-8588-41cd-8c73-c3dc2ea9bf04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150450 Sep 02 09:57:22.432097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 618/1308] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:22 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:23.078760 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6ea7166a-fb77-4402-a1fa-3aabee30fafa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:23.079395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6ea7166a-fb77-4402-a1fa-3aabee30fafa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:23.086393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea7166a-fb77-4402-a1fa-3aabee30fafa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:23.093339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea7166a-fb77-4402-a1fa-3aabee30fafa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:23.093339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea7166a-fb77-4402-a1fa-3aabee30fafa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:23.093339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea7166a-fb77-4402-a1fa-3aabee30fafa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:23.093339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea7166a-fb77-4402-a1fa-3aabee30fafa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:23.093781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ea7166a-fb77-4402-a1fa-3aabee30fafa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:23.160189 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6ea7166a-fb77-4402-a1fa-3aabee30fafa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:23.168514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6ea7166a-fb77-4402-a1fa-3aabee30fafa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.093646 Sep 02 09:57:23.169083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 691/1309] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:23 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:23.452236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f5914772-ba11-410d-a83d-570c2ba6911f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:23.452784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f5914772-ba11-410d-a83d-570c2ba6911f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:23.460017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5914772-ba11-410d-a83d-570c2ba6911f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:23.460495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5914772-ba11-410d-a83d-570c2ba6911f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:23.460924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5914772-ba11-410d-a83d-570c2ba6911f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:23.461595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5914772-ba11-410d-a83d-570c2ba6911f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:23.462040 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5914772-ba11-410d-a83d-570c2ba6911f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:23.462458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5914772-ba11-410d-a83d-570c2ba6911f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:23.591656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f5914772-ba11-410d-a83d-570c2ba6911f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:23.600500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f5914772-ba11-410d-a83d-570c2ba6911f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152211 Sep 02 09:57:23.601055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 619/1310] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:23 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:24.192998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-73d1eb4a-890f-4086-91e0-22123e6d034f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:24.194012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-73d1eb4a-890f-4086-91e0-22123e6d034f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:24.200880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73d1eb4a-890f-4086-91e0-22123e6d034f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:24.201366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73d1eb4a-890f-4086-91e0-22123e6d034f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:24.201798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73d1eb4a-890f-4086-91e0-22123e6d034f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:24.202483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73d1eb4a-890f-4086-91e0-22123e6d034f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:24.202965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73d1eb4a-890f-4086-91e0-22123e6d034f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:24.203391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73d1eb4a-890f-4086-91e0-22123e6d034f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:24.264813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-73d1eb4a-890f-4086-91e0-22123e6d034f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:24.272860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-73d1eb4a-890f-4086-91e0-22123e6d034f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087422 Sep 02 09:57:24.273428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 692/1311] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:24 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:24.621691 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-eb63fb1f-57c7-4311-b3b6-3bebbf4eb599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:24.622317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-eb63fb1f-57c7-4311-b3b6-3bebbf4eb599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:24.628656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb63fb1f-57c7-4311-b3b6-3bebbf4eb599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:24.629124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb63fb1f-57c7-4311-b3b6-3bebbf4eb599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:24.629553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb63fb1f-57c7-4311-b3b6-3bebbf4eb599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:24.630228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb63fb1f-57c7-4311-b3b6-3bebbf4eb599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:24.630674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb63fb1f-57c7-4311-b3b6-3bebbf4eb599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:24.631114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb63fb1f-57c7-4311-b3b6-3bebbf4eb599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:24.759310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-eb63fb1f-57c7-4311-b3b6-3bebbf4eb599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:24.767876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-eb63fb1f-57c7-4311-b3b6-3bebbf4eb599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150418 Sep 02 09:57:24.768438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 620/1312] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:24 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:25.293336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-87b04e32-c42e-4cc4-a4d7-0ba5c725f106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:25.293908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-87b04e32-c42e-4cc4-a4d7-0ba5c725f106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:25.300150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-87b04e32-c42e-4cc4-a4d7-0ba5c725f106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:25.300623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-87b04e32-c42e-4cc4-a4d7-0ba5c725f106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:25.301057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-87b04e32-c42e-4cc4-a4d7-0ba5c725f106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:25.301738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-87b04e32-c42e-4cc4-a4d7-0ba5c725f106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:25.302184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-87b04e32-c42e-4cc4-a4d7-0ba5c725f106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:25.302604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-87b04e32-c42e-4cc4-a4d7-0ba5c725f106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:25.363932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-87b04e32-c42e-4cc4-a4d7-0ba5c725f106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:25.371948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-87b04e32-c42e-4cc4-a4d7-0ba5c725f106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082633 Sep 02 09:57:25.372506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 693/1313] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:25.789212 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0c4d8b57-3082-4311-a87a-2153409d1563 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:25.789825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0c4d8b57-3082-4311-a87a-2153409d1563 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:25.796245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c4d8b57-3082-4311-a87a-2153409d1563 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:25.796724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c4d8b57-3082-4311-a87a-2153409d1563 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:25.797151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c4d8b57-3082-4311-a87a-2153409d1563 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:25.797830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c4d8b57-3082-4311-a87a-2153409d1563 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:25.798269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c4d8b57-3082-4311-a87a-2153409d1563 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:25.798686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c4d8b57-3082-4311-a87a-2153409d1563 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:25.923870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0c4d8b57-3082-4311-a87a-2153409d1563 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:25.932434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0c4d8b57-3082-4311-a87a-2153409d1563 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147264 Sep 02 09:57:25.932997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 621/1314] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:25 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:26.392349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b84167de-5698-483b-ad46-18e7762dec02 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:26.392955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b84167de-5698-483b-ad46-18e7762dec02 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:26.399409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b84167de-5698-483b-ad46-18e7762dec02 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:26.399890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b84167de-5698-483b-ad46-18e7762dec02 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:26.400322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b84167de-5698-483b-ad46-18e7762dec02 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:26.400999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b84167de-5698-483b-ad46-18e7762dec02 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:26.401450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b84167de-5698-483b-ad46-18e7762dec02 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:26.401872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b84167de-5698-483b-ad46-18e7762dec02 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:26.465139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b84167de-5698-483b-ad46-18e7762dec02 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:26.473165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b84167de-5698-483b-ad46-18e7762dec02 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084653 Sep 02 09:57:26.473727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 694/1315] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:26 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:26.953861 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-12ac757c-0500-4da0-a2c3-b77895d685a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:26.954471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-12ac757c-0500-4da0-a2c3-b77895d685a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:26.961512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12ac757c-0500-4da0-a2c3-b77895d685a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:26.961989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12ac757c-0500-4da0-a2c3-b77895d685a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:26.962418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12ac757c-0500-4da0-a2c3-b77895d685a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:26.963114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12ac757c-0500-4da0-a2c3-b77895d685a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:26.963564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12ac757c-0500-4da0-a2c3-b77895d685a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:26.963981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12ac757c-0500-4da0-a2c3-b77895d685a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:27.095581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-12ac757c-0500-4da0-a2c3-b77895d685a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:27.103726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-12ac757c-0500-4da0-a2c3-b77895d685a0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153662 Sep 02 09:57:27.104231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 622/1316] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:26 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:27.494193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e9e54c52-4c3c-4801-a5b9-ecb186dd4722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:27.494769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e9e54c52-4c3c-4801-a5b9-ecb186dd4722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:27.501131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9e54c52-4c3c-4801-a5b9-ecb186dd4722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:27.501614 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9e54c52-4c3c-4801-a5b9-ecb186dd4722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:27.502049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9e54c52-4c3c-4801-a5b9-ecb186dd4722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:27.502755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9e54c52-4c3c-4801-a5b9-ecb186dd4722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:27.503211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9e54c52-4c3c-4801-a5b9-ecb186dd4722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:27.503634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9e54c52-4c3c-4801-a5b9-ecb186dd4722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:27.565040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e9e54c52-4c3c-4801-a5b9-ecb186dd4722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:27.573084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e9e54c52-4c3c-4801-a5b9-ecb186dd4722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083365 Sep 02 09:57:27.573643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 695/1317] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:27 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:28.124626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bf1de9c0-d1bc-481e-ac57-e3fcf7a0d72b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:28.132551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bf1de9c0-d1bc-481e-ac57-e3fcf7a0d72b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:28.132551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1de9c0-d1bc-481e-ac57-e3fcf7a0d72b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:28.132551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1de9c0-d1bc-481e-ac57-e3fcf7a0d72b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:28.132551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1de9c0-d1bc-481e-ac57-e3fcf7a0d72b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:28.133165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1de9c0-d1bc-481e-ac57-e3fcf7a0d72b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:28.133612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1de9c0-d1bc-481e-ac57-e3fcf7a0d72b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:28.134031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf1de9c0-d1bc-481e-ac57-e3fcf7a0d72b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:28.149609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:57:28.261185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bf1de9c0-d1bc-481e-ac57-e3fcf7a0d72b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:28.269258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bf1de9c0-d1bc-481e-ac57-e3fcf7a0d72b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148510 Sep 02 09:57:28.269815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 623/1318] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:28 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:28.593669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-23fd5056-845b-40d3-8185-18dc8e812a56 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:28.594284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-23fd5056-845b-40d3-8185-18dc8e812a56 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:28.600684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd5056-845b-40d3-8185-18dc8e812a56 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:28.601168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd5056-845b-40d3-8185-18dc8e812a56 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:28.601605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd5056-845b-40d3-8185-18dc8e812a56 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:28.602293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd5056-845b-40d3-8185-18dc8e812a56 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:28.602774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd5056-845b-40d3-8185-18dc8e812a56 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:28.603202 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23fd5056-845b-40d3-8185-18dc8e812a56 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:28.663951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-23fd5056-845b-40d3-8185-18dc8e812a56 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:28.672205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-23fd5056-845b-40d3-8185-18dc8e812a56 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082470 Sep 02 09:57:28.672795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 696/1319] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:28 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:29.289941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a538b7b2-019b-45c1-9df6-961a762fb56d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:29.290478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a538b7b2-019b-45c1-9df6-961a762fb56d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:29.296981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b7b2-019b-45c1-9df6-961a762fb56d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:29.297459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b7b2-019b-45c1-9df6-961a762fb56d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:29.297887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b7b2-019b-45c1-9df6-961a762fb56d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:29.298569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b7b2-019b-45c1-9df6-961a762fb56d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:29.299051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b7b2-019b-45c1-9df6-961a762fb56d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:29.299473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a538b7b2-019b-45c1-9df6-961a762fb56d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:29.428617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a538b7b2-019b-45c1-9df6-961a762fb56d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:29.436781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a538b7b2-019b-45c1-9df6-961a762fb56d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150762 Sep 02 09:57:29.437342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 624/1320] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:29 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:29.693727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-084a11f6-8163-40a9-a02c-606f3f9cdfbe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:29.694465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-084a11f6-8163-40a9-a02c-606f3f9cdfbe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:29.700920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084a11f6-8163-40a9-a02c-606f3f9cdfbe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:29.701407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084a11f6-8163-40a9-a02c-606f3f9cdfbe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:29.701844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084a11f6-8163-40a9-a02c-606f3f9cdfbe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:29.702531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084a11f6-8163-40a9-a02c-606f3f9cdfbe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:29.703014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084a11f6-8163-40a9-a02c-606f3f9cdfbe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:29.703445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-084a11f6-8163-40a9-a02c-606f3f9cdfbe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:29.764277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-084a11f6-8163-40a9-a02c-606f3f9cdfbe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:29.772316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-084a11f6-8163-40a9-a02c-606f3f9cdfbe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083065 Sep 02 09:57:29.772879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 697/1321] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:29 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:30.458080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9bac3bce-7504-4cd2-aa98-9e36d530e3a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:30.459295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9bac3bce-7504-4cd2-aa98-9e36d530e3a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:30.465633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bac3bce-7504-4cd2-aa98-9e36d530e3a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:30.466112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bac3bce-7504-4cd2-aa98-9e36d530e3a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:30.466545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bac3bce-7504-4cd2-aa98-9e36d530e3a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:30.467265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bac3bce-7504-4cd2-aa98-9e36d530e3a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:30.467722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bac3bce-7504-4cd2-aa98-9e36d530e3a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:30.468147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9bac3bce-7504-4cd2-aa98-9e36d530e3a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:30.593122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9bac3bce-7504-4cd2-aa98-9e36d530e3a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:30.601282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9bac3bce-7504-4cd2-aa98-9e36d530e3a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147139 Sep 02 09:57:30.601846 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 625/1322] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:30 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:30.792757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9f1c8f33-ab60-438b-839c-b1bcb1a532c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:30.793279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9f1c8f33-ab60-438b-839c-b1bcb1a532c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:30.799633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-ab60-438b-839c-b1bcb1a532c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:30.800111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-ab60-438b-839c-b1bcb1a532c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:30.800541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-ab60-438b-839c-b1bcb1a532c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:30.801221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-ab60-438b-839c-b1bcb1a532c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:30.801678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-ab60-438b-839c-b1bcb1a532c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:30.802095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f1c8f33-ab60-438b-839c-b1bcb1a532c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:30.806084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:57:30.865846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9f1c8f33-ab60-438b-839c-b1bcb1a532c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:30.873892 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9f1c8f33-ab60-438b-839c-b1bcb1a532c2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085016 Sep 02 09:57:30.874478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 698/1323] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:30 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:31.621920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-458c9c14-9346-4991-b21e-db935268054a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:31.622536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-458c9c14-9346-4991-b21e-db935268054a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:31.628706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-458c9c14-9346-4991-b21e-db935268054a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:31.629191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-458c9c14-9346-4991-b21e-db935268054a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:31.629629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-458c9c14-9346-4991-b21e-db935268054a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:31.630317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-458c9c14-9346-4991-b21e-db935268054a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:31.630799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-458c9c14-9346-4991-b21e-db935268054a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:31.631230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-458c9c14-9346-4991-b21e-db935268054a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:31.755941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-458c9c14-9346-4991-b21e-db935268054a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:31.764249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-458c9c14-9346-4991-b21e-db935268054a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146219 Sep 02 09:57:31.764809 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 626/1324] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:31 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:31.895666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cfeea1dc-2184-4387-ab8a-97b3549cb806 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:31.896187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cfeea1dc-2184-4387-ab8a-97b3549cb806 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:31.902547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfeea1dc-2184-4387-ab8a-97b3549cb806 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:31.903053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfeea1dc-2184-4387-ab8a-97b3549cb806 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:31.903486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfeea1dc-2184-4387-ab8a-97b3549cb806 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:31.904164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfeea1dc-2184-4387-ab8a-97b3549cb806 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:31.904613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfeea1dc-2184-4387-ab8a-97b3549cb806 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:31.905034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfeea1dc-2184-4387-ab8a-97b3549cb806 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:31.965372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cfeea1dc-2184-4387-ab8a-97b3549cb806 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:31.973497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cfeea1dc-2184-4387-ab8a-97b3549cb806 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082060 Sep 02 09:57:31.974052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 699/1325] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:31 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:32.784829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-205ffe24-dbe8-4091-b171-8c550e55a39a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:32.785467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-205ffe24-dbe8-4091-b171-8c550e55a39a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:32.792508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205ffe24-dbe8-4091-b171-8c550e55a39a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:32.792988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205ffe24-dbe8-4091-b171-8c550e55a39a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:32.793421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205ffe24-dbe8-4091-b171-8c550e55a39a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:32.794134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205ffe24-dbe8-4091-b171-8c550e55a39a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:32.794586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205ffe24-dbe8-4091-b171-8c550e55a39a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:32.795100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-205ffe24-dbe8-4091-b171-8c550e55a39a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:32.924302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-205ffe24-dbe8-4091-b171-8c550e55a39a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:32.932611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-205ffe24-dbe8-4091-b171-8c550e55a39a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151617 Sep 02 09:57:32.933181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 627/1326] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:32 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:32.993748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7ebc7e21-0d46-4a95-ad3e-8251b54c0efc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:32.994374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7ebc7e21-0d46-4a95-ad3e-8251b54c0efc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:33.001392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ebc7e21-0d46-4a95-ad3e-8251b54c0efc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:33.001891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ebc7e21-0d46-4a95-ad3e-8251b54c0efc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:33.002333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ebc7e21-0d46-4a95-ad3e-8251b54c0efc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:33.003097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ebc7e21-0d46-4a95-ad3e-8251b54c0efc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:33.003550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ebc7e21-0d46-4a95-ad3e-8251b54c0efc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:33.003978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ebc7e21-0d46-4a95-ad3e-8251b54c0efc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:33.071778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7ebc7e21-0d46-4a95-ad3e-8251b54c0efc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:33.080299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7ebc7e21-0d46-4a95-ad3e-8251b54c0efc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.090530 Sep 02 09:57:33.080882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 700/1327] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:32 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:33.953976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d93dcec-0b4f-4714-a564-850bb511b9be tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:33.954582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5d93dcec-0b4f-4714-a564-850bb511b9be tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:33.961519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d93dcec-0b4f-4714-a564-850bb511b9be tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:33.961988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d93dcec-0b4f-4714-a564-850bb511b9be tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:33.962414 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d93dcec-0b4f-4714-a564-850bb511b9be tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:33.963127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d93dcec-0b4f-4714-a564-850bb511b9be tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:33.963573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d93dcec-0b4f-4714-a564-850bb511b9be tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:33.963989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d93dcec-0b4f-4714-a564-850bb511b9be tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:34.089605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5d93dcec-0b4f-4714-a564-850bb511b9be tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:34.097728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5d93dcec-0b4f-4714-a564-850bb511b9be tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147612 Sep 02 09:57:34.105738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 628/1328] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:33 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:34.105921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-32895512-3746-450d-acae-e5a04d85da4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:34.105921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-32895512-3746-450d-acae-e5a04d85da4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:34.109075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32895512-3746-450d-acae-e5a04d85da4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:34.109553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32895512-3746-450d-acae-e5a04d85da4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:34.109982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32895512-3746-450d-acae-e5a04d85da4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:34.110698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32895512-3746-450d-acae-e5a04d85da4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:34.111167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32895512-3746-450d-acae-e5a04d85da4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:34.111589 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32895512-3746-450d-acae-e5a04d85da4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:34.172242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-32895512-3746-450d-acae-e5a04d85da4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:34.180274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-32895512-3746-450d-acae-e5a04d85da4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082735 Sep 02 09:57:34.180830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 701/1329] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:34 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:57:35.119652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a6e2209d-c8e5-4568-a20a-fcf202f4486e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:35.120262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a6e2209d-c8e5-4568-a20a-fcf202f4486e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:35.126550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6e2209d-c8e5-4568-a20a-fcf202f4486e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:35.127058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6e2209d-c8e5-4568-a20a-fcf202f4486e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:35.127491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6e2209d-c8e5-4568-a20a-fcf202f4486e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:35.128372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6e2209d-c8e5-4568-a20a-fcf202f4486e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:35.128828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6e2209d-c8e5-4568-a20a-fcf202f4486e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:35.129313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6e2209d-c8e5-4568-a20a-fcf202f4486e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:35.201704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-78d85b7c-36dd-4f0f-a2f5-17ef9f8e7b83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:35.202304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-78d85b7c-36dd-4f0f-a2f5-17ef9f8e7b83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:35.208850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78d85b7c-36dd-4f0f-a2f5-17ef9f8e7b83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:35.209331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78d85b7c-36dd-4f0f-a2f5-17ef9f8e7b83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:35.209825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78d85b7c-36dd-4f0f-a2f5-17ef9f8e7b83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:35.210429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78d85b7c-36dd-4f0f-a2f5-17ef9f8e7b83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:35.210902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78d85b7c-36dd-4f0f-a2f5-17ef9f8e7b83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:35.211314 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78d85b7c-36dd-4f0f-a2f5-17ef9f8e7b83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:35.262019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a6e2209d-c8e5-4568-a20a-fcf202f4486e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:35.270320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a6e2209d-c8e5-4568-a20a-fcf202f4486e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154600 Sep 02 09:57:35.270908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 629/1330] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:35 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:35.276706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-78d85b7c-36dd-4f0f-a2f5-17ef9f8e7b83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:35.284792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-78d85b7c-36dd-4f0f-a2f5-17ef9f8e7b83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087102 Sep 02 09:57:35.285528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 702/1331] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:35 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:57:36.291277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f9a6f677-ae62-4ff0-86d9-588e1c0c4929 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:36.291889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f9a6f677-ae62-4ff0-86d9-588e1c0c4929 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:36.298293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9a6f677-ae62-4ff0-86d9-588e1c0c4929 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:36.298796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9a6f677-ae62-4ff0-86d9-588e1c0c4929 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:36.299236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9a6f677-ae62-4ff0-86d9-588e1c0c4929 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:36.299916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9a6f677-ae62-4ff0-86d9-588e1c0c4929 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:36.300363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9a6f677-ae62-4ff0-86d9-588e1c0c4929 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:36.300788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f9a6f677-ae62-4ff0-86d9-588e1c0c4929 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:36.306299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cfd67741-320c-44a5-95bc-b28abbf0a2f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:36.306964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cfd67741-320c-44a5-95bc-b28abbf0a2f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:36.313220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfd67741-320c-44a5-95bc-b28abbf0a2f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:36.313701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfd67741-320c-44a5-95bc-b28abbf0a2f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:36.314134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfd67741-320c-44a5-95bc-b28abbf0a2f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:36.314842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfd67741-320c-44a5-95bc-b28abbf0a2f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:36.315291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfd67741-320c-44a5-95bc-b28abbf0a2f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:36.315712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfd67741-320c-44a5-95bc-b28abbf0a2f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:36.376301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cfd67741-320c-44a5-95bc-b28abbf0a2f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:36.385350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cfd67741-320c-44a5-95bc-b28abbf0a2f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083297 Sep 02 09:57:36.385921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 703/1332] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:36 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:36.429333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f9a6f677-ae62-4ff0-86d9-588e1c0c4929 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:36.437441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f9a6f677-ae62-4ff0-86d9-588e1c0c4929 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150066 Sep 02 09:57:36.438010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 630/1333] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:36 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:37.405618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d623529d-6231-494f-b9f0-639ebc6ba460 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:37.406235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d623529d-6231-494f-b9f0-639ebc6ba460 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:37.408591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:57:37.413798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d623529d-6231-494f-b9f0-639ebc6ba460 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:37.414284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d623529d-6231-494f-b9f0-639ebc6ba460 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:37.414741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d623529d-6231-494f-b9f0-639ebc6ba460 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:37.415437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d623529d-6231-494f-b9f0-639ebc6ba460 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:37.415895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d623529d-6231-494f-b9f0-639ebc6ba460 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:37.416348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d623529d-6231-494f-b9f0-639ebc6ba460 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:37.459189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a14cacb6-c56b-4e59-9fec-0cb5b2217a24 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:37.459828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a14cacb6-c56b-4e59-9fec-0cb5b2217a24 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:37.466539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a14cacb6-c56b-4e59-9fec-0cb5b2217a24 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:37.467053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a14cacb6-c56b-4e59-9fec-0cb5b2217a24 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:37.467487 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a14cacb6-c56b-4e59-9fec-0cb5b2217a24 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:37.468173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a14cacb6-c56b-4e59-9fec-0cb5b2217a24 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:37.468624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a14cacb6-c56b-4e59-9fec-0cb5b2217a24 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:37.469044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a14cacb6-c56b-4e59-9fec-0cb5b2217a24 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:37.478637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d623529d-6231-494f-b9f0-639ebc6ba460 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:37.486687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d623529d-6231-494f-b9f0-639ebc6ba460 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084997 Sep 02 09:57:37.487292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 704/1334] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:37 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:37.597370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a14cacb6-c56b-4e59-9fec-0cb5b2217a24 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:37.605965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a14cacb6-c56b-4e59-9fec-0cb5b2217a24 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150869 Sep 02 09:57:37.606531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 631/1335] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:37 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:57:38.507852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4c9d3bc1-86cc-4e2e-9f7b-75a40527851d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:38.508450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4c9d3bc1-86cc-4e2e-9f7b-75a40527851d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:38.515187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9d3bc1-86cc-4e2e-9f7b-75a40527851d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:38.515668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9d3bc1-86cc-4e2e-9f7b-75a40527851d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:38.516106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9d3bc1-86cc-4e2e-9f7b-75a40527851d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:38.516788 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9d3bc1-86cc-4e2e-9f7b-75a40527851d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:38.517238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9d3bc1-86cc-4e2e-9f7b-75a40527851d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:38.517663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9d3bc1-86cc-4e2e-9f7b-75a40527851d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:38.577775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4c9d3bc1-86cc-4e2e-9f7b-75a40527851d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:38.586265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4c9d3bc1-86cc-4e2e-9f7b-75a40527851d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082283 Sep 02 09:57:38.586949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 705/1336] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:38 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:38.627395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7f954208-5740-4376-90b5-3a76b6c9e29a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:38.627996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7f954208-5740-4376-90b5-3a76b6c9e29a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:38.634316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f954208-5740-4376-90b5-3a76b6c9e29a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:38.635094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f954208-5740-4376-90b5-3a76b6c9e29a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:38.635503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f954208-5740-4376-90b5-3a76b6c9e29a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:38.636176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f954208-5740-4376-90b5-3a76b6c9e29a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:38.636619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f954208-5740-4376-90b5-3a76b6c9e29a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:38.637034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7f954208-5740-4376-90b5-3a76b6c9e29a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:38.768239 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7f954208-5740-4376-90b5-3a76b6c9e29a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:38.776953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7f954208-5740-4376-90b5-3a76b6c9e29a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153434 Sep 02 09:57:38.777525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 632/1337] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:38 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:39.606776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8995727d-051b-4a69-b690-85f849c2d9c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:39.607391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8995727d-051b-4a69-b690-85f849c2d9c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:39.613775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8995727d-051b-4a69-b690-85f849c2d9c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:39.614257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8995727d-051b-4a69-b690-85f849c2d9c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:39.615312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8995727d-051b-4a69-b690-85f849c2d9c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:39.616009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8995727d-051b-4a69-b690-85f849c2d9c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:39.616461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8995727d-051b-4a69-b690-85f849c2d9c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:39.616884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8995727d-051b-4a69-b690-85f849c2d9c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:39.683057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8995727d-051b-4a69-b690-85f849c2d9c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:39.691143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8995727d-051b-4a69-b690-85f849c2d9c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.088331 Sep 02 09:57:39.691701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 706/1338] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:39 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:39.799196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-071a0d04-6c5e-4d25-9067-ad39fb02245e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:39.800233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-071a0d04-6c5e-4d25-9067-ad39fb02245e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:39.806983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-071a0d04-6c5e-4d25-9067-ad39fb02245e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:39.807466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-071a0d04-6c5e-4d25-9067-ad39fb02245e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:39.807901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-071a0d04-6c5e-4d25-9067-ad39fb02245e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:39.808585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-071a0d04-6c5e-4d25-9067-ad39fb02245e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:39.809037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-071a0d04-6c5e-4d25-9067-ad39fb02245e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:39.809459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-071a0d04-6c5e-4d25-9067-ad39fb02245e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:39.933614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-071a0d04-6c5e-4d25-9067-ad39fb02245e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:39.941714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-071a0d04-6c5e-4d25-9067-ad39fb02245e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146423 Sep 02 09:57:39.942282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 633/1339] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:39 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:40.711607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5c6feeac-c790-43ef-9a43-6c31540ed8fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:40.712217 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5c6feeac-c790-43ef-9a43-6c31540ed8fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:40.718578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c6feeac-c790-43ef-9a43-6c31540ed8fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:40.719088 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c6feeac-c790-43ef-9a43-6c31540ed8fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:40.719520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c6feeac-c790-43ef-9a43-6c31540ed8fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:40.720208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c6feeac-c790-43ef-9a43-6c31540ed8fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:40.720662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c6feeac-c790-43ef-9a43-6c31540ed8fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:40.721083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c6feeac-c790-43ef-9a43-6c31540ed8fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:40.780995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5c6feeac-c790-43ef-9a43-6c31540ed8fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:40.789138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5c6feeac-c790-43ef-9a43-6c31540ed8fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081394 Sep 02 09:57:40.789707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 707/1340] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:40 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:40.961754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4ec0249c-6a3f-42df-8624-4a7b4d7e30ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:40.962297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4ec0249c-6a3f-42df-8624-4a7b4d7e30ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:40.968733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ec0249c-6a3f-42df-8624-4a7b4d7e30ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:40.969216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ec0249c-6a3f-42df-8624-4a7b4d7e30ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:40.969650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ec0249c-6a3f-42df-8624-4a7b4d7e30ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:40.970332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ec0249c-6a3f-42df-8624-4a7b4d7e30ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:40.970827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ec0249c-6a3f-42df-8624-4a7b4d7e30ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:40.971250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4ec0249c-6a3f-42df-8624-4a7b4d7e30ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:41.101136 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4ec0249c-6a3f-42df-8624-4a7b4d7e30ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:41.109421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4ec0249c-6a3f-42df-8624-4a7b4d7e30ed tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151606 Sep 02 09:57:41.109990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 634/1341] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:40 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:41.811253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-55a04b60-9966-4000-a321-0b9bfaa89b12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:41.811862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-55a04b60-9966-4000-a321-0b9bfaa89b12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:41.819099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a04b60-9966-4000-a321-0b9bfaa89b12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:41.819643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a04b60-9966-4000-a321-0b9bfaa89b12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:41.820095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a04b60-9966-4000-a321-0b9bfaa89b12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:41.820853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a04b60-9966-4000-a321-0b9bfaa89b12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:41.821396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a04b60-9966-4000-a321-0b9bfaa89b12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:41.821820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a04b60-9966-4000-a321-0b9bfaa89b12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:41.883138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-55a04b60-9966-4000-a321-0b9bfaa89b12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:41.891747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-55a04b60-9966-4000-a321-0b9bfaa89b12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084370 Sep 02 09:57:41.892315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 708/1342] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:41 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:42.131481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fadce21e-b1d7-4b10-8f2a-ca7271059496 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:42.132096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fadce21e-b1d7-4b10-8f2a-ca7271059496 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:42.138778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fadce21e-b1d7-4b10-8f2a-ca7271059496 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:42.139266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fadce21e-b1d7-4b10-8f2a-ca7271059496 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:42.139702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fadce21e-b1d7-4b10-8f2a-ca7271059496 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:42.140386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fadce21e-b1d7-4b10-8f2a-ca7271059496 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:42.140838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fadce21e-b1d7-4b10-8f2a-ca7271059496 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:42.141269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fadce21e-b1d7-4b10-8f2a-ca7271059496 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:42.268716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fadce21e-b1d7-4b10-8f2a-ca7271059496 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:42.276834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fadce21e-b1d7-4b10-8f2a-ca7271059496 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149715 Sep 02 09:57:42.277402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 635/1343] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:42 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:42.913644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bc0a17c8-3498-4236-80d4-ee5aba0ce39e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:42.914246 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bc0a17c8-3498-4236-80d4-ee5aba0ce39e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:42.920896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc0a17c8-3498-4236-80d4-ee5aba0ce39e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:42.921384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc0a17c8-3498-4236-80d4-ee5aba0ce39e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:42.921822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc0a17c8-3498-4236-80d4-ee5aba0ce39e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:42.922512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc0a17c8-3498-4236-80d4-ee5aba0ce39e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:42.923003 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc0a17c8-3498-4236-80d4-ee5aba0ce39e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:42.923425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc0a17c8-3498-4236-80d4-ee5aba0ce39e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:42.984190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bc0a17c8-3498-4236-80d4-ee5aba0ce39e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:42.992282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bc0a17c8-3498-4236-80d4-ee5aba0ce39e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083042 Sep 02 09:57:42.992849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 709/1344] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:42 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:43.297714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2f2e7fc4-409e-43ed-97e1-b5aebb091680 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:43.298281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2f2e7fc4-409e-43ed-97e1-b5aebb091680 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:43.304678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f2e7fc4-409e-43ed-97e1-b5aebb091680 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:43.305154 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f2e7fc4-409e-43ed-97e1-b5aebb091680 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:43.305580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f2e7fc4-409e-43ed-97e1-b5aebb091680 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:43.306253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f2e7fc4-409e-43ed-97e1-b5aebb091680 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:43.306718 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f2e7fc4-409e-43ed-97e1-b5aebb091680 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:43.307142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2f2e7fc4-409e-43ed-97e1-b5aebb091680 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:43.435245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2f2e7fc4-409e-43ed-97e1-b5aebb091680 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:43.443796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2f2e7fc4-409e-43ed-97e1-b5aebb091680 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149975 Sep 02 09:57:43.444360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 636/1345] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:43 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:44.012773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d9e7a8b8-a729-480b-841d-b64f06c6af7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:44.013376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d9e7a8b8-a729-480b-841d-b64f06c6af7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:44.019725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9e7a8b8-a729-480b-841d-b64f06c6af7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:44.020201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9e7a8b8-a729-480b-841d-b64f06c6af7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:44.020633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9e7a8b8-a729-480b-841d-b64f06c6af7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:44.021839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9e7a8b8-a729-480b-841d-b64f06c6af7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:44.022285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9e7a8b8-a729-480b-841d-b64f06c6af7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:44.022724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9e7a8b8-a729-480b-841d-b64f06c6af7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:44.085785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d9e7a8b8-a729-480b-841d-b64f06c6af7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:44.093784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d9e7a8b8-a729-480b-841d-b64f06c6af7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085149 Sep 02 09:57:44.094334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 710/1346] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:44 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:44.464594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-26ae0052-8e8b-478a-9752-e1407198888f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:44.465201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-26ae0052-8e8b-478a-9752-e1407198888f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:44.471596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ae0052-8e8b-478a-9752-e1407198888f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:44.472074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ae0052-8e8b-478a-9752-e1407198888f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:44.472503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ae0052-8e8b-478a-9752-e1407198888f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:44.473180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ae0052-8e8b-478a-9752-e1407198888f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:44.473624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ae0052-8e8b-478a-9752-e1407198888f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:44.474086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ae0052-8e8b-478a-9752-e1407198888f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:44.599030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-26ae0052-8e8b-478a-9752-e1407198888f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:44.607114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-26ae0052-8e8b-478a-9752-e1407198888f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146339 Sep 02 09:57:44.607679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 637/1347] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:44 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:45.114225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d5c8157e-7768-4582-b76f-8966dce9ab61 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:45.115425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d5c8157e-7768-4582-b76f-8966dce9ab61 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:45.121662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5c8157e-7768-4582-b76f-8966dce9ab61 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:45.122143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5c8157e-7768-4582-b76f-8966dce9ab61 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:45.122576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5c8157e-7768-4582-b76f-8966dce9ab61 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:45.123281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5c8157e-7768-4582-b76f-8966dce9ab61 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:45.123723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5c8157e-7768-4582-b76f-8966dce9ab61 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:45.124144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d5c8157e-7768-4582-b76f-8966dce9ab61 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:45.184812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d5c8157e-7768-4582-b76f-8966dce9ab61 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:45.193157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d5c8157e-7768-4582-b76f-8966dce9ab61 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082784 Sep 02 09:57:45.199214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 711/1348] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:45 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:45.628529 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ff706980-dcd3-4037-9e5b-c318f7b9442d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:45.629144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ff706980-dcd3-4037-9e5b-c318f7b9442d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:45.631969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=54 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:57:45.636953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff706980-dcd3-4037-9e5b-c318f7b9442d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:45.637432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff706980-dcd3-4037-9e5b-c318f7b9442d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:45.637868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff706980-dcd3-4037-9e5b-c318f7b9442d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:45.638581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff706980-dcd3-4037-9e5b-c318f7b9442d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:45.639057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff706980-dcd3-4037-9e5b-c318f7b9442d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:45.644530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff706980-dcd3-4037-9e5b-c318f7b9442d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:45.763078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ff706980-dcd3-4037-9e5b-c318f7b9442d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:45.771739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ff706980-dcd3-4037-9e5b-c318f7b9442d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146601 Sep 02 09:57:45.772319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 638/1349] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:45 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:46.213952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2d6cc7a8-37b2-4c08-b461-c7600b1902b1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:46.214575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2d6cc7a8-37b2-4c08-b461-c7600b1902b1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:46.221163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d6cc7a8-37b2-4c08-b461-c7600b1902b1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:46.221648 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d6cc7a8-37b2-4c08-b461-c7600b1902b1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:46.222086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d6cc7a8-37b2-4c08-b461-c7600b1902b1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:46.222801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d6cc7a8-37b2-4c08-b461-c7600b1902b1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:46.223260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d6cc7a8-37b2-4c08-b461-c7600b1902b1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:46.223687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d6cc7a8-37b2-4c08-b461-c7600b1902b1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:46.284274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2d6cc7a8-37b2-4c08-b461-c7600b1902b1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:46.292857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2d6cc7a8-37b2-4c08-b461-c7600b1902b1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082769 Sep 02 09:57:46.293422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 712/1350] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:46 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:46.793086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-712e84ea-f6b8-4915-8910-d06408f83cc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:46.793695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-712e84ea-f6b8-4915-8910-d06408f83cc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:46.800140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712e84ea-f6b8-4915-8910-d06408f83cc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:46.800615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712e84ea-f6b8-4915-8910-d06408f83cc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:46.805055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712e84ea-f6b8-4915-8910-d06408f83cc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:46.805055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712e84ea-f6b8-4915-8910-d06408f83cc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:46.805055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712e84ea-f6b8-4915-8910-d06408f83cc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:46.805055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-712e84ea-f6b8-4915-8910-d06408f83cc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:46.934387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-712e84ea-f6b8-4915-8910-d06408f83cc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:46.942556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-712e84ea-f6b8-4915-8910-d06408f83cc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153354 Sep 02 09:57:46.943153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 639/1351] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:46 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:47.314653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-121da432-dd3e-420c-a6fb-4934abd2d75b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:47.315289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-121da432-dd3e-420c-a6fb-4934abd2d75b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:47.322174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121da432-dd3e-420c-a6fb-4934abd2d75b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:47.322660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121da432-dd3e-420c-a6fb-4934abd2d75b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:47.323210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121da432-dd3e-420c-a6fb-4934abd2d75b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:47.323895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121da432-dd3e-420c-a6fb-4934abd2d75b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:47.324349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121da432-dd3e-420c-a6fb-4934abd2d75b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:47.324805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121da432-dd3e-420c-a6fb-4934abd2d75b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:47.386964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-121da432-dd3e-420c-a6fb-4934abd2d75b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:47.395037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-121da432-dd3e-420c-a6fb-4934abd2d75b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084254 Sep 02 09:57:47.395601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 713/1352] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:47 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:47.963518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-22dd52df-36b2-4fd0-b7c4-eeaea91cc3c7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:47.964057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-22dd52df-36b2-4fd0-b7c4-eeaea91cc3c7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:47.970473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22dd52df-36b2-4fd0-b7c4-eeaea91cc3c7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:47.970982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22dd52df-36b2-4fd0-b7c4-eeaea91cc3c7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:47.971415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22dd52df-36b2-4fd0-b7c4-eeaea91cc3c7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:47.972092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22dd52df-36b2-4fd0-b7c4-eeaea91cc3c7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:47.972539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22dd52df-36b2-4fd0-b7c4-eeaea91cc3c7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:47.972957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-22dd52df-36b2-4fd0-b7c4-eeaea91cc3c7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:47.977302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:57:48.096754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-22dd52df-36b2-4fd0-b7c4-eeaea91cc3c7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:48.105301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-22dd52df-36b2-4fd0-b7c4-eeaea91cc3c7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.145801 Sep 02 09:57:48.105863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 640/1353] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:47 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:48.416255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9bc344cf-4f0b-42a1-9e50-0d9281ac3b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:48.416897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9bc344cf-4f0b-42a1-9e50-0d9281ac3b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:48.423264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bc344cf-4f0b-42a1-9e50-0d9281ac3b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:48.423745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bc344cf-4f0b-42a1-9e50-0d9281ac3b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:48.424180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bc344cf-4f0b-42a1-9e50-0d9281ac3b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:48.424869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bc344cf-4f0b-42a1-9e50-0d9281ac3b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:48.425321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bc344cf-4f0b-42a1-9e50-0d9281ac3b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:48.425748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9bc344cf-4f0b-42a1-9e50-0d9281ac3b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:48.489966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9bc344cf-4f0b-42a1-9e50-0d9281ac3b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:48.492239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:57:48.498697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9bc344cf-4f0b-42a1-9e50-0d9281ac3b95 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086914 Sep 02 09:57:48.499279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 714/1354] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:48 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:49.127105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5522ef68-1cf3-42fa-ae6b-0cb16f91884a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:49.127766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5522ef68-1cf3-42fa-ae6b-0cb16f91884a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:49.135112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5522ef68-1cf3-42fa-ae6b-0cb16f91884a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:49.135593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5522ef68-1cf3-42fa-ae6b-0cb16f91884a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:49.136027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5522ef68-1cf3-42fa-ae6b-0cb16f91884a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:49.136709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5522ef68-1cf3-42fa-ae6b-0cb16f91884a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:49.137161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5522ef68-1cf3-42fa-ae6b-0cb16f91884a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:49.137585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5522ef68-1cf3-42fa-ae6b-0cb16f91884a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:49.263886 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5522ef68-1cf3-42fa-ae6b-0cb16f91884a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:49.272041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5522ef68-1cf3-42fa-ae6b-0cb16f91884a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148838 Sep 02 09:57:49.272604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 641/1355] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:49 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:49.519888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2893a40e-9283-4b56-8d1a-f95b714b8e63 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:49.520436 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2893a40e-9283-4b56-8d1a-f95b714b8e63 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:49.527163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2893a40e-9283-4b56-8d1a-f95b714b8e63 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:49.527648 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2893a40e-9283-4b56-8d1a-f95b714b8e63 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:49.528085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2893a40e-9283-4b56-8d1a-f95b714b8e63 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:49.528769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2893a40e-9283-4b56-8d1a-f95b714b8e63 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:49.529223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2893a40e-9283-4b56-8d1a-f95b714b8e63 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:49.529646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2893a40e-9283-4b56-8d1a-f95b714b8e63 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:49.590444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2893a40e-9283-4b56-8d1a-f95b714b8e63 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:49.598514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2893a40e-9283-4b56-8d1a-f95b714b8e63 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082570 Sep 02 09:57:49.599632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 715/1356] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:49 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:50.292864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-122396bd-8c18-401a-867a-1356bdd30710 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:50.293470 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-122396bd-8c18-401a-867a-1356bdd30710 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:50.300159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-122396bd-8c18-401a-867a-1356bdd30710 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:50.300633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-122396bd-8c18-401a-867a-1356bdd30710 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:50.301060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-122396bd-8c18-401a-867a-1356bdd30710 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:50.301738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-122396bd-8c18-401a-867a-1356bdd30710 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:50.303256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-122396bd-8c18-401a-867a-1356bdd30710 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:50.303719 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-122396bd-8c18-401a-867a-1356bdd30710 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:50.431439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-122396bd-8c18-401a-867a-1356bdd30710 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:50.439519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-122396bd-8c18-401a-867a-1356bdd30710 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150535 Sep 02 09:57:50.440083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 642/1357] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:50 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:50.620092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9e53ace6-601e-4d8a-a05c-a9417f6ec0f0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:50.620703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9e53ace6-601e-4d8a-a05c-a9417f6ec0f0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:50.627125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e53ace6-601e-4d8a-a05c-a9417f6ec0f0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:50.627611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e53ace6-601e-4d8a-a05c-a9417f6ec0f0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:50.628054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e53ace6-601e-4d8a-a05c-a9417f6ec0f0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:50.628737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e53ace6-601e-4d8a-a05c-a9417f6ec0f0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:50.629190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e53ace6-601e-4d8a-a05c-a9417f6ec0f0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:50.629616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e53ace6-601e-4d8a-a05c-a9417f6ec0f0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:50.689646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9e53ace6-601e-4d8a-a05c-a9417f6ec0f0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:50.698308 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9e53ace6-601e-4d8a-a05c-a9417f6ec0f0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082116 Sep 02 09:57:50.698910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 716/1358] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:50 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:51.461648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-244396a1-f9fb-4df2-acfe-4d845a9cdba8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:51.462262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-244396a1-f9fb-4df2-acfe-4d845a9cdba8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:51.468645 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-244396a1-f9fb-4df2-acfe-4d845a9cdba8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:51.469127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-244396a1-f9fb-4df2-acfe-4d845a9cdba8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:51.469561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-244396a1-f9fb-4df2-acfe-4d845a9cdba8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:51.470237 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-244396a1-f9fb-4df2-acfe-4d845a9cdba8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:51.470686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-244396a1-f9fb-4df2-acfe-4d845a9cdba8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:51.471131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-244396a1-f9fb-4df2-acfe-4d845a9cdba8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:51.601587 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-244396a1-f9fb-4df2-acfe-4d845a9cdba8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:51.609703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-244396a1-f9fb-4df2-acfe-4d845a9cdba8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152467 Sep 02 09:57:51.610263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 643/1359] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:51 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:51.718511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-50f14077-1b96-4014-a7ba-f9609bda40d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:51.719085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-50f14077-1b96-4014-a7ba-f9609bda40d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:51.725559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50f14077-1b96-4014-a7ba-f9609bda40d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:51.726067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50f14077-1b96-4014-a7ba-f9609bda40d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:51.726509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50f14077-1b96-4014-a7ba-f9609bda40d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:51.727230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50f14077-1b96-4014-a7ba-f9609bda40d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:51.727688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50f14077-1b96-4014-a7ba-f9609bda40d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:51.728114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50f14077-1b96-4014-a7ba-f9609bda40d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:51.788977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-50f14077-1b96-4014-a7ba-f9609bda40d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:51.797200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-50f14077-1b96-4014-a7ba-f9609bda40d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082627 Sep 02 09:57:51.797766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 717/1360] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:51 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:52.632990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8ad54d32-dde9-41dc-9b02-2b3a60af38a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:52.634048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8ad54d32-dde9-41dc-9b02-2b3a60af38a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:52.641101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad54d32-dde9-41dc-9b02-2b3a60af38a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:52.641587 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad54d32-dde9-41dc-9b02-2b3a60af38a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:52.642025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad54d32-dde9-41dc-9b02-2b3a60af38a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:52.642728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad54d32-dde9-41dc-9b02-2b3a60af38a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:52.643189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad54d32-dde9-41dc-9b02-2b3a60af38a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:52.643655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad54d32-dde9-41dc-9b02-2b3a60af38a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:52.767520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ad54d32-dde9-41dc-9b02-2b3a60af38a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:52.776171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8ad54d32-dde9-41dc-9b02-2b3a60af38a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149256 Sep 02 09:57:52.776735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 644/1361] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:52 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:52.817347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-00ede221-855d-44bb-b767-105030d0db16 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:52.817959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-00ede221-855d-44bb-b767-105030d0db16 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:52.824338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ede221-855d-44bb-b767-105030d0db16 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:52.824820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ede221-855d-44bb-b767-105030d0db16 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:52.825259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ede221-855d-44bb-b767-105030d0db16 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:52.825953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ede221-855d-44bb-b767-105030d0db16 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:52.826404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ede221-855d-44bb-b767-105030d0db16 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:52.826849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ede221-855d-44bb-b767-105030d0db16 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:52.890361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-00ede221-855d-44bb-b767-105030d0db16 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:52.900046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-00ede221-855d-44bb-b767-105030d0db16 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086561 Sep 02 09:57:52.900606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 718/1362] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:52 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:53.797709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5bfbc4df-32cc-43f1-8066-f47a17e85d9f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:53.798296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5bfbc4df-32cc-43f1-8066-f47a17e85d9f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:53.806019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bfbc4df-32cc-43f1-8066-f47a17e85d9f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:53.806019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bfbc4df-32cc-43f1-8066-f47a17e85d9f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:53.806408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bfbc4df-32cc-43f1-8066-f47a17e85d9f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:53.807118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bfbc4df-32cc-43f1-8066-f47a17e85d9f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:53.807565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bfbc4df-32cc-43f1-8066-f47a17e85d9f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:53.807980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5bfbc4df-32cc-43f1-8066-f47a17e85d9f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:53.920465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4550779f-1a4a-40f8-814e-27d6dfac21a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:53.921186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4550779f-1a4a-40f8-814e-27d6dfac21a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:53.928210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4550779f-1a4a-40f8-814e-27d6dfac21a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:53.928774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4550779f-1a4a-40f8-814e-27d6dfac21a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:53.929217 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4550779f-1a4a-40f8-814e-27d6dfac21a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:53.929909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4550779f-1a4a-40f8-814e-27d6dfac21a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:53.930364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4550779f-1a4a-40f8-814e-27d6dfac21a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:53.930820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4550779f-1a4a-40f8-814e-27d6dfac21a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:53.933577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5bfbc4df-32cc-43f1-8066-f47a17e85d9f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:53.941616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5bfbc4df-32cc-43f1-8066-f47a17e85d9f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147728 Sep 02 09:57:53.942186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 645/1363] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:53 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:53.993866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4550779f-1a4a-40f8-814e-27d6dfac21a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:54.001913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4550779f-1a4a-40f8-814e-27d6dfac21a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085361 Sep 02 09:57:54.002477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 719/1364] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:53 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:57:54.962343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-93528bf3-3ec7-484d-9418-268859f58ee5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:54.962977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-93528bf3-3ec7-484d-9418-268859f58ee5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:54.969327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93528bf3-3ec7-484d-9418-268859f58ee5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:54.969802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93528bf3-3ec7-484d-9418-268859f58ee5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:54.970230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93528bf3-3ec7-484d-9418-268859f58ee5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:54.970943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93528bf3-3ec7-484d-9418-268859f58ee5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:54.971427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93528bf3-3ec7-484d-9418-268859f58ee5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:54.971795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-93528bf3-3ec7-484d-9418-268859f58ee5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:55.028945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2d045915-48fe-4564-8e05-8dca4379a527 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:55.029546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2d045915-48fe-4564-8e05-8dca4379a527 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:55.036002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d045915-48fe-4564-8e05-8dca4379a527 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:55.037031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d045915-48fe-4564-8e05-8dca4379a527 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:55.037462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d045915-48fe-4564-8e05-8dca4379a527 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:55.038148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d045915-48fe-4564-8e05-8dca4379a527 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:55.038617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d045915-48fe-4564-8e05-8dca4379a527 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:55.039068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d045915-48fe-4564-8e05-8dca4379a527 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:55.099664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2d045915-48fe-4564-8e05-8dca4379a527 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:55.103905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-93528bf3-3ec7-484d-9418-268859f58ee5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:55.108102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2d045915-48fe-4564-8e05-8dca4379a527 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087792 Sep 02 09:57:55.108757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 720/1365] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:55 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:55.112229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-93528bf3-3ec7-484d-9418-268859f58ee5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154381 Sep 02 09:57:55.112787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 646/1366] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:54 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:56.128595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-63d052a4-0287-4d7d-a46a-2a1d2840497f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:56.129204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-63d052a4-0287-4d7d-a46a-2a1d2840497f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:56.132783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bb9e38fc-dd71-45c2-993e-437dbe66a5c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:56.133399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bb9e38fc-dd71-45c2-993e-437dbe66a5c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:56.135965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63d052a4-0287-4d7d-a46a-2a1d2840497f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:56.136446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63d052a4-0287-4d7d-a46a-2a1d2840497f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:56.136879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63d052a4-0287-4d7d-a46a-2a1d2840497f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:56.137563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63d052a4-0287-4d7d-a46a-2a1d2840497f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:56.138016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63d052a4-0287-4d7d-a46a-2a1d2840497f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:56.138434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63d052a4-0287-4d7d-a46a-2a1d2840497f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:56.139989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb9e38fc-dd71-45c2-993e-437dbe66a5c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:56.140473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb9e38fc-dd71-45c2-993e-437dbe66a5c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:56.140903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb9e38fc-dd71-45c2-993e-437dbe66a5c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:56.141624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb9e38fc-dd71-45c2-993e-437dbe66a5c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:56.142072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb9e38fc-dd71-45c2-993e-437dbe66a5c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:56.142503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb9e38fc-dd71-45c2-993e-437dbe66a5c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:56.199421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-63d052a4-0287-4d7d-a46a-2a1d2840497f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:56.207574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-63d052a4-0287-4d7d-a46a-2a1d2840497f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082803 Sep 02 09:57:56.208144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 721/1367] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:56 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:56.267475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb9e38fc-dd71-45c2-993e-437dbe66a5c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:56.275646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bb9e38fc-dd71-45c2-993e-437dbe66a5c6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146672 Sep 02 09:57:56.276221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 647/1368] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:56 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:57:57.228225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a81c1736-65c1-4c1c-949d-8ab1152352db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:57.228835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a81c1736-65c1-4c1c-949d-8ab1152352db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:57.235348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a81c1736-65c1-4c1c-949d-8ab1152352db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:57.235827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a81c1736-65c1-4c1c-949d-8ab1152352db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:57.236260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a81c1736-65c1-4c1c-949d-8ab1152352db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:57.236934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a81c1736-65c1-4c1c-949d-8ab1152352db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:57.237382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a81c1736-65c1-4c1c-949d-8ab1152352db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:57.237799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a81c1736-65c1-4c1c-949d-8ab1152352db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:57.296451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-702547ca-2ba9-46fb-b12a-170406f75b4d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:57.302415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-702547ca-2ba9-46fb-b12a-170406f75b4d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:57.303014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a81c1736-65c1-4c1c-949d-8ab1152352db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:57.304091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702547ca-2ba9-46fb-b12a-170406f75b4d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:57.304582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702547ca-2ba9-46fb-b12a-170406f75b4d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:57.305018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702547ca-2ba9-46fb-b12a-170406f75b4d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:57.305709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702547ca-2ba9-46fb-b12a-170406f75b4d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:57.306162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702547ca-2ba9-46fb-b12a-170406f75b4d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:57.306584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-702547ca-2ba9-46fb-b12a-170406f75b4d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:57.310544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a81c1736-65c1-4c1c-949d-8ab1152352db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086197 Sep 02 09:57:57.311144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 722/1369] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:57 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:57.441660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-702547ca-2ba9-46fb-b12a-170406f75b4d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:57.450451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-702547ca-2ba9-46fb-b12a-170406f75b4d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.157887 Sep 02 09:57:57.451220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 648/1370] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:57 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:57:58.332093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-94d18539-b61d-4eb1-8add-93a70c82c5ed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:58.333302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-94d18539-b61d-4eb1-8add-93a70c82c5ed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:58.339775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94d18539-b61d-4eb1-8add-93a70c82c5ed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:58.340265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94d18539-b61d-4eb1-8add-93a70c82c5ed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:58.340714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94d18539-b61d-4eb1-8add-93a70c82c5ed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:58.341407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94d18539-b61d-4eb1-8add-93a70c82c5ed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:58.341864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94d18539-b61d-4eb1-8add-93a70c82c5ed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:58.342290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-94d18539-b61d-4eb1-8add-93a70c82c5ed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:58.403404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-94d18539-b61d-4eb1-8add-93a70c82c5ed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:58.411563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-94d18539-b61d-4eb1-8add-93a70c82c5ed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083421 Sep 02 09:57:58.412161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 723/1371] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:58 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:58.471371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d4c31cb2-c028-482b-9104-6ad252ef1fb2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:58.471975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d4c31cb2-c028-482b-9104-6ad252ef1fb2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:58.478218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4c31cb2-c028-482b-9104-6ad252ef1fb2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:58.478693 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4c31cb2-c028-482b-9104-6ad252ef1fb2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:58.479147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4c31cb2-c028-482b-9104-6ad252ef1fb2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:58.479820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4c31cb2-c028-482b-9104-6ad252ef1fb2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:58.480264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4c31cb2-c028-482b-9104-6ad252ef1fb2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:58.480683 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4c31cb2-c028-482b-9104-6ad252ef1fb2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:58.605096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d4c31cb2-c028-482b-9104-6ad252ef1fb2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:58.613207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d4c31cb2-c028-482b-9104-6ad252ef1fb2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.145722 Sep 02 09:57:58.613759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 649/1372] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:58 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:59.432219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c67fa615-e405-4c46-b9cf-d129749f3573 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:59.432826 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c67fa615-e405-4c46-b9cf-d129749f3573 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:59.439336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c67fa615-e405-4c46-b9cf-d129749f3573 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:59.439822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c67fa615-e405-4c46-b9cf-d129749f3573 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:59.440255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c67fa615-e405-4c46-b9cf-d129749f3573 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:59.440939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c67fa615-e405-4c46-b9cf-d129749f3573 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:59.441390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c67fa615-e405-4c46-b9cf-d129749f3573 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:59.441810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c67fa615-e405-4c46-b9cf-d129749f3573 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:59.505035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c67fa615-e405-4c46-b9cf-d129749f3573 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:59.513391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c67fa615-e405-4c46-b9cf-d129749f3573 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085063 Sep 02 09:57:59.513954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 724/1373] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:59 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:57:59.633957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-deb336e1-4849-4c19-8d29-096c03843d5c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:57:59.634854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-deb336e1-4849-4c19-8d29-096c03843d5c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:57:59.641203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-deb336e1-4849-4c19-8d29-096c03843d5c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:59.641682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-deb336e1-4849-4c19-8d29-096c03843d5c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:59.642116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-deb336e1-4849-4c19-8d29-096c03843d5c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:59.642859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-deb336e1-4849-4c19-8d29-096c03843d5c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:57:59.643320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-deb336e1-4849-4c19-8d29-096c03843d5c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:57:59.643743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-deb336e1-4849-4c19-8d29-096c03843d5c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:57:59.776177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-deb336e1-4849-4c19-8d29-096c03843d5c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:57:59.784535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-deb336e1-4849-4c19-8d29-096c03843d5c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154433 Sep 02 09:57:59.785107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 650/1374] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:57:59 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:00.534309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-892a2e9c-b6f9-4054-beb3-d5fe22bce611 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:00.534986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-892a2e9c-b6f9-4054-beb3-d5fe22bce611 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:00.541889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-892a2e9c-b6f9-4054-beb3-d5fe22bce611 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:00.542373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-892a2e9c-b6f9-4054-beb3-d5fe22bce611 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:00.542838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-892a2e9c-b6f9-4054-beb3-d5fe22bce611 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:00.543529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-892a2e9c-b6f9-4054-beb3-d5fe22bce611 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:00.543984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-892a2e9c-b6f9-4054-beb3-d5fe22bce611 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:00.544408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-892a2e9c-b6f9-4054-beb3-d5fe22bce611 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:00.604698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-892a2e9c-b6f9-4054-beb3-d5fe22bce611 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:00.612811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-892a2e9c-b6f9-4054-beb3-d5fe22bce611 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082333 Sep 02 09:58:00.613316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 725/1375] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:00 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:00.805822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c2ccb71a-1bb3-4c52-962e-f85195993b0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:00.806468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c2ccb71a-1bb3-4c52-962e-f85195993b0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:00.812960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2ccb71a-1bb3-4c52-962e-f85195993b0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:00.813442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2ccb71a-1bb3-4c52-962e-f85195993b0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:00.813876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2ccb71a-1bb3-4c52-962e-f85195993b0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:00.814565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2ccb71a-1bb3-4c52-962e-f85195993b0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:00.815039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2ccb71a-1bb3-4c52-962e-f85195993b0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:00.815496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2ccb71a-1bb3-4c52-962e-f85195993b0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:00.943105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c2ccb71a-1bb3-4c52-962e-f85195993b0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:00.951200 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c2ccb71a-1bb3-4c52-962e-f85195993b0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149754 Sep 02 09:58:00.951765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 651/1376] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:00 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:01.633854 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-59edebe1-8c4a-48d5-a44d-b19de32920cd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:01.634725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-59edebe1-8c4a-48d5-a44d-b19de32920cd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:01.641286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59edebe1-8c4a-48d5-a44d-b19de32920cd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:01.641798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59edebe1-8c4a-48d5-a44d-b19de32920cd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:01.642229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59edebe1-8c4a-48d5-a44d-b19de32920cd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:01.642945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59edebe1-8c4a-48d5-a44d-b19de32920cd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:01.643396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59edebe1-8c4a-48d5-a44d-b19de32920cd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:01.643811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-59edebe1-8c4a-48d5-a44d-b19de32920cd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:01.709755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-59edebe1-8c4a-48d5-a44d-b19de32920cd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:01.717836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-59edebe1-8c4a-48d5-a44d-b19de32920cd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.088352 Sep 02 09:58:01.718399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 726/1377] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:01 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:01.973562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f4cb5d1b-1b51-421e-9010-5a564f405d3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:01.974121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f4cb5d1b-1b51-421e-9010-5a564f405d3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:01.980264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb5d1b-1b51-421e-9010-5a564f405d3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:01.980731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb5d1b-1b51-421e-9010-5a564f405d3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:01.981156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb5d1b-1b51-421e-9010-5a564f405d3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:01.981825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb5d1b-1b51-421e-9010-5a564f405d3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:01.982267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb5d1b-1b51-421e-9010-5a564f405d3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:01.982693 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb5d1b-1b51-421e-9010-5a564f405d3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:02.107337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f4cb5d1b-1b51-421e-9010-5a564f405d3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:02.117632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f4cb5d1b-1b51-421e-9010-5a564f405d3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.145643 Sep 02 09:58:02.118223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 652/1378] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:01 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:02.738381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-917eb70a-4425-4c33-98a4-603e20cc913c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:02.738957 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-917eb70a-4425-4c33-98a4-603e20cc913c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:02.745368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-917eb70a-4425-4c33-98a4-603e20cc913c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:02.745853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-917eb70a-4425-4c33-98a4-603e20cc913c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:02.746292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-917eb70a-4425-4c33-98a4-603e20cc913c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:02.747018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-917eb70a-4425-4c33-98a4-603e20cc913c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:02.747471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-917eb70a-4425-4c33-98a4-603e20cc913c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:02.747895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-917eb70a-4425-4c33-98a4-603e20cc913c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:02.809336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-917eb70a-4425-4c33-98a4-603e20cc913c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:02.817432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-917eb70a-4425-4c33-98a4-603e20cc913c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083010 Sep 02 09:58:02.818001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 727/1379] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:02 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:03.139163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f3a87db7-e344-4f17-a1f3-dced891fb943 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:03.139814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f3a87db7-e344-4f17-a1f3-dced891fb943 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:03.146312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3a87db7-e344-4f17-a1f3-dced891fb943 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:03.147428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3a87db7-e344-4f17-a1f3-dced891fb943 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:03.147935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3a87db7-e344-4f17-a1f3-dced891fb943 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:03.148619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3a87db7-e344-4f17-a1f3-dced891fb943 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:03.149107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3a87db7-e344-4f17-a1f3-dced891fb943 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:03.149530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3a87db7-e344-4f17-a1f3-dced891fb943 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:03.276592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f3a87db7-e344-4f17-a1f3-dced891fb943 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:03.284671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f3a87db7-e344-4f17-a1f3-dced891fb943 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149433 Sep 02 09:58:03.285245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 653/1380] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:03 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:03.838119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4c0c9065-a187-46cd-9894-d2de9988330d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:03.838745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4c0c9065-a187-46cd-9894-d2de9988330d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:03.845139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c0c9065-a187-46cd-9894-d2de9988330d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:03.846118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c0c9065-a187-46cd-9894-d2de9988330d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:03.846118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c0c9065-a187-46cd-9894-d2de9988330d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:03.846720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c0c9065-a187-46cd-9894-d2de9988330d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:03.847175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c0c9065-a187-46cd-9894-d2de9988330d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:03.847602 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c0c9065-a187-46cd-9894-d2de9988330d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:03.909509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4c0c9065-a187-46cd-9894-d2de9988330d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:03.917667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4c0c9065-a187-46cd-9894-d2de9988330d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083965 Sep 02 09:58:03.918233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 728/1381] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:03 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:04.305574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6ba0d920-fc02-4345-9d3c-10a7c150f0eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:04.306217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6ba0d920-fc02-4345-9d3c-10a7c150f0eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:04.312721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ba0d920-fc02-4345-9d3c-10a7c150f0eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:04.313203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ba0d920-fc02-4345-9d3c-10a7c150f0eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:04.313653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ba0d920-fc02-4345-9d3c-10a7c150f0eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:04.314327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ba0d920-fc02-4345-9d3c-10a7c150f0eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:04.314804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ba0d920-fc02-4345-9d3c-10a7c150f0eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:04.315254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ba0d920-fc02-4345-9d3c-10a7c150f0eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:04.439759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6ba0d920-fc02-4345-9d3c-10a7c150f0eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:04.448283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6ba0d920-fc02-4345-9d3c-10a7c150f0eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147249 Sep 02 09:58:04.448940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 654/1382] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:04 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:04.938739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f28e5429-3a76-4378-9376-29a8ca852282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:04.939334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f28e5429-3a76-4378-9376-29a8ca852282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:04.945674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f28e5429-3a76-4378-9376-29a8ca852282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:04.946148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f28e5429-3a76-4378-9376-29a8ca852282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:04.946577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f28e5429-3a76-4378-9376-29a8ca852282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:04.947313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f28e5429-3a76-4378-9376-29a8ca852282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:04.947762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f28e5429-3a76-4378-9376-29a8ca852282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:04.948181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f28e5429-3a76-4378-9376-29a8ca852282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:05.009983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f28e5429-3a76-4378-9376-29a8ca852282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:05.018049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f28e5429-3a76-4378-9376-29a8ca852282 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083203 Sep 02 09:58:05.018611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 729/1383] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:04 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:05.472976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-269a1b1f-c045-4c59-ac7b-cd05c2d97698 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:05.473584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-269a1b1f-c045-4c59-ac7b-cd05c2d97698 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:05.480175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-269a1b1f-c045-4c59-ac7b-cd05c2d97698 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:05.480683 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-269a1b1f-c045-4c59-ac7b-cd05c2d97698 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:05.481115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-269a1b1f-c045-4c59-ac7b-cd05c2d97698 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:05.481799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-269a1b1f-c045-4c59-ac7b-cd05c2d97698 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:05.482245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-269a1b1f-c045-4c59-ac7b-cd05c2d97698 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:05.482697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-269a1b1f-c045-4c59-ac7b-cd05c2d97698 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:05.610463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-269a1b1f-c045-4c59-ac7b-cd05c2d97698 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:05.619210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-269a1b1f-c045-4c59-ac7b-cd05c2d97698 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150193 Sep 02 09:58:05.619775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 655/1384] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:05 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:06.039587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b7dd2dbf-2c9c-4e99-8cc2-cd4126d531d0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:06.040217 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b7dd2dbf-2c9c-4e99-8cc2-cd4126d531d0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:06.046573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7dd2dbf-2c9c-4e99-8cc2-cd4126d531d0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:06.047083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7dd2dbf-2c9c-4e99-8cc2-cd4126d531d0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:06.047514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7dd2dbf-2c9c-4e99-8cc2-cd4126d531d0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:06.048194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7dd2dbf-2c9c-4e99-8cc2-cd4126d531d0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:06.048640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7dd2dbf-2c9c-4e99-8cc2-cd4126d531d0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:06.049061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7dd2dbf-2c9c-4e99-8cc2-cd4126d531d0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:06.112175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b7dd2dbf-2c9c-4e99-8cc2-cd4126d531d0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:06.120978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b7dd2dbf-2c9c-4e99-8cc2-cd4126d531d0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085726 Sep 02 09:58:06.121533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 730/1385] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:06 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:06.640680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8c45ea7a-68d4-4bb5-bb7f-05082cbca845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:06.641300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8c45ea7a-68d4-4bb5-bb7f-05082cbca845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:06.648367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c45ea7a-68d4-4bb5-bb7f-05082cbca845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:06.648849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c45ea7a-68d4-4bb5-bb7f-05082cbca845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:06.649284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c45ea7a-68d4-4bb5-bb7f-05082cbca845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:06.649968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c45ea7a-68d4-4bb5-bb7f-05082cbca845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:06.650419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c45ea7a-68d4-4bb5-bb7f-05082cbca845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:06.650952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8c45ea7a-68d4-4bb5-bb7f-05082cbca845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:06.775994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8c45ea7a-68d4-4bb5-bb7f-05082cbca845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:06.778236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:58:06.784757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8c45ea7a-68d4-4bb5-bb7f-05082cbca845 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147930 Sep 02 09:58:06.785321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 656/1386] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:06 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:07.141310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-89e83aaf-c05b-46f5-8269-0ddde59f87d8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:07.141951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-89e83aaf-c05b-46f5-8269-0ddde59f87d8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:07.148445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89e83aaf-c05b-46f5-8269-0ddde59f87d8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:07.148927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89e83aaf-c05b-46f5-8269-0ddde59f87d8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:07.149359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89e83aaf-c05b-46f5-8269-0ddde59f87d8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:07.150039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89e83aaf-c05b-46f5-8269-0ddde59f87d8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:07.150487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89e83aaf-c05b-46f5-8269-0ddde59f87d8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:07.150931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89e83aaf-c05b-46f5-8269-0ddde59f87d8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:07.165198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:58:07.211916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-89e83aaf-c05b-46f5-8269-0ddde59f87d8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:07.220065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-89e83aaf-c05b-46f5-8269-0ddde59f87d8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082611 Sep 02 09:58:07.220644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 731/1387] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:07 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:07.805678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a0e1c8d8-e367-45ba-9255-d118ed4acfe5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:07.806217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a0e1c8d8-e367-45ba-9255-d118ed4acfe5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:07.812960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0e1c8d8-e367-45ba-9255-d118ed4acfe5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:07.813592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0e1c8d8-e367-45ba-9255-d118ed4acfe5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:07.813865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0e1c8d8-e367-45ba-9255-d118ed4acfe5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:07.814544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0e1c8d8-e367-45ba-9255-d118ed4acfe5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:07.815025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0e1c8d8-e367-45ba-9255-d118ed4acfe5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:07.815450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a0e1c8d8-e367-45ba-9255-d118ed4acfe5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:07.942022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a0e1c8d8-e367-45ba-9255-d118ed4acfe5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:07.950158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a0e1c8d8-e367-45ba-9255-d118ed4acfe5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148468 Sep 02 09:58:07.950729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 657/1388] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:07 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:08.240888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-06a01529-cce2-4c8f-9019-86ef8f5693ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:08.241502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-06a01529-cce2-4c8f-9019-86ef8f5693ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:08.243491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=56 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:58:08.248178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a01529-cce2-4c8f-9019-86ef8f5693ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:08.248663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a01529-cce2-4c8f-9019-86ef8f5693ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:08.249102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a01529-cce2-4c8f-9019-86ef8f5693ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:08.249784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a01529-cce2-4c8f-9019-86ef8f5693ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:08.250237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a01529-cce2-4c8f-9019-86ef8f5693ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:08.250783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-06a01529-cce2-4c8f-9019-86ef8f5693ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:08.314318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-06a01529-cce2-4c8f-9019-86ef8f5693ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:08.323462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-06a01529-cce2-4c8f-9019-86ef8f5693ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086671 Sep 02 09:58:08.324030 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 732/1389] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:08 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:08.971417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-99e311e7-29e3-4952-a403-6b764738d0cb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:08.972028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-99e311e7-29e3-4952-a403-6b764738d0cb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:08.978952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e311e7-29e3-4952-a403-6b764738d0cb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:08.979432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e311e7-29e3-4952-a403-6b764738d0cb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:08.979865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e311e7-29e3-4952-a403-6b764738d0cb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:08.980553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e311e7-29e3-4952-a403-6b764738d0cb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:08.981003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e311e7-29e3-4952-a403-6b764738d0cb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:08.981426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99e311e7-29e3-4952-a403-6b764738d0cb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:09.111082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-99e311e7-29e3-4952-a403-6b764738d0cb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:09.119940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-99e311e7-29e3-4952-a403-6b764738d0cb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152423 Sep 02 09:58:09.120505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 658/1390] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:08 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:09.344979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4da4cf7f-ba05-4fa5-bad8-a71611f916cc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:09.345585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4da4cf7f-ba05-4fa5-bad8-a71611f916cc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:09.352739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4da4cf7f-ba05-4fa5-bad8-a71611f916cc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:09.353219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4da4cf7f-ba05-4fa5-bad8-a71611f916cc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:09.353650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4da4cf7f-ba05-4fa5-bad8-a71611f916cc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:09.354324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4da4cf7f-ba05-4fa5-bad8-a71611f916cc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:09.354808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4da4cf7f-ba05-4fa5-bad8-a71611f916cc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:09.355254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4da4cf7f-ba05-4fa5-bad8-a71611f916cc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:09.415156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4da4cf7f-ba05-4fa5-bad8-a71611f916cc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:09.423201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4da4cf7f-ba05-4fa5-bad8-a71611f916cc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082110 Sep 02 09:58:09.423763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 733/1391] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:09 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:10.140993 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d2e4b7f3-8f14-46ac-80ae-7331f8c1ca5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:10.141615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d2e4b7f3-8f14-46ac-80ae-7331f8c1ca5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:10.148092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2e4b7f3-8f14-46ac-80ae-7331f8c1ca5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:10.148575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2e4b7f3-8f14-46ac-80ae-7331f8c1ca5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:10.149010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2e4b7f3-8f14-46ac-80ae-7331f8c1ca5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:10.149693 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2e4b7f3-8f14-46ac-80ae-7331f8c1ca5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:10.150146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2e4b7f3-8f14-46ac-80ae-7331f8c1ca5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:10.150572 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2e4b7f3-8f14-46ac-80ae-7331f8c1ca5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:10.274894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d2e4b7f3-8f14-46ac-80ae-7331f8c1ca5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:10.283165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d2e4b7f3-8f14-46ac-80ae-7331f8c1ca5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146012 Sep 02 09:58:10.283765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 659/1392] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:10 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:10.443754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fdfd35f7-3257-4265-b641-fad688795953 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:10.444313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fdfd35f7-3257-4265-b641-fad688795953 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:10.450738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdfd35f7-3257-4265-b641-fad688795953 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:10.451219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdfd35f7-3257-4265-b641-fad688795953 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:10.451656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdfd35f7-3257-4265-b641-fad688795953 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:10.452333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdfd35f7-3257-4265-b641-fad688795953 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:10.452780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdfd35f7-3257-4265-b641-fad688795953 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:10.453199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdfd35f7-3257-4265-b641-fad688795953 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:10.516344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fdfd35f7-3257-4265-b641-fad688795953 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:10.524450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fdfd35f7-3257-4265-b641-fad688795953 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084645 Sep 02 09:58:10.525018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 734/1393] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:10 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:11.304547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-73991d15-c401-4367-a67a-10c228129cb0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:11.305071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-73991d15-c401-4367-a67a-10c228129cb0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:11.311549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73991d15-c401-4367-a67a-10c228129cb0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:11.312019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73991d15-c401-4367-a67a-10c228129cb0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:11.312449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73991d15-c401-4367-a67a-10c228129cb0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:11.313121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73991d15-c401-4367-a67a-10c228129cb0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:11.313570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73991d15-c401-4367-a67a-10c228129cb0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:11.313988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73991d15-c401-4367-a67a-10c228129cb0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:11.442097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-73991d15-c401-4367-a67a-10c228129cb0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:11.450996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-73991d15-c401-4367-a67a-10c228129cb0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150340 Sep 02 09:58:11.451558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 660/1394] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:11 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:11.545277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1cb72613-59a6-4d2e-bd83-42ba69484a31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:11.545895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1cb72613-59a6-4d2e-bd83-42ba69484a31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:11.552228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb72613-59a6-4d2e-bd83-42ba69484a31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:11.553196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb72613-59a6-4d2e-bd83-42ba69484a31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:11.553631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb72613-59a6-4d2e-bd83-42ba69484a31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:11.554318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb72613-59a6-4d2e-bd83-42ba69484a31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:11.554852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb72613-59a6-4d2e-bd83-42ba69484a31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:11.555227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb72613-59a6-4d2e-bd83-42ba69484a31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:11.614360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1cb72613-59a6-4d2e-bd83-42ba69484a31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:11.622937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1cb72613-59a6-4d2e-bd83-42ba69484a31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081453 Sep 02 09:58:11.623497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 735/1395] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:11 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:12.471390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f0b7b16a-dfe3-47b4-9fe4-0a3173d955a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:12.472003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f0b7b16a-dfe3-47b4-9fe4-0a3173d955a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:12.478991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0b7b16a-dfe3-47b4-9fe4-0a3173d955a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:12.479475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0b7b16a-dfe3-47b4-9fe4-0a3173d955a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:12.479906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0b7b16a-dfe3-47b4-9fe4-0a3173d955a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:12.480588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0b7b16a-dfe3-47b4-9fe4-0a3173d955a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:12.481036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0b7b16a-dfe3-47b4-9fe4-0a3173d955a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:12.481458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f0b7b16a-dfe3-47b4-9fe4-0a3173d955a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:12.606378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f0b7b16a-dfe3-47b4-9fe4-0a3173d955a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:12.614588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f0b7b16a-dfe3-47b4-9fe4-0a3173d955a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147071 Sep 02 09:58:12.615207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 661/1396] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:12 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:12.644557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-277b16a4-0569-45c6-acda-a6cb5b168e0d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:12.645218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-277b16a4-0569-45c6-acda-a6cb5b168e0d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:12.651943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-277b16a4-0569-45c6-acda-a6cb5b168e0d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:12.652421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-277b16a4-0569-45c6-acda-a6cb5b168e0d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:12.652854 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-277b16a4-0569-45c6-acda-a6cb5b168e0d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:12.653534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-277b16a4-0569-45c6-acda-a6cb5b168e0d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:12.653988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-277b16a4-0569-45c6-acda-a6cb5b168e0d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:12.654407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-277b16a4-0569-45c6-acda-a6cb5b168e0d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:12.714553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-277b16a4-0569-45c6-acda-a6cb5b168e0d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:12.722625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-277b16a4-0569-45c6-acda-a6cb5b168e0d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082043 Sep 02 09:58:12.723209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 736/1397] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:12 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:13.635919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8dc6aba4-cc68-44a1-a4ff-33593ec89a16 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:13.636506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8dc6aba4-cc68-44a1-a4ff-33593ec89a16 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:13.642923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8dc6aba4-cc68-44a1-a4ff-33593ec89a16 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:13.643399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8dc6aba4-cc68-44a1-a4ff-33593ec89a16 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:13.643828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8dc6aba4-cc68-44a1-a4ff-33593ec89a16 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:13.644505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8dc6aba4-cc68-44a1-a4ff-33593ec89a16 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:13.644954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8dc6aba4-cc68-44a1-a4ff-33593ec89a16 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:13.645394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8dc6aba4-cc68-44a1-a4ff-33593ec89a16 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:13.742573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2c68d7b8-d887-4592-99ee-d95f56bacee3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:13.743232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2c68d7b8-d887-4592-99ee-d95f56bacee3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:13.749771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c68d7b8-d887-4592-99ee-d95f56bacee3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:13.750265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c68d7b8-d887-4592-99ee-d95f56bacee3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:13.750721 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c68d7b8-d887-4592-99ee-d95f56bacee3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:13.751423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c68d7b8-d887-4592-99ee-d95f56bacee3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:13.751880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c68d7b8-d887-4592-99ee-d95f56bacee3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:13.752309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c68d7b8-d887-4592-99ee-d95f56bacee3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:13.776019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8dc6aba4-cc68-44a1-a4ff-33593ec89a16 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:13.784351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8dc6aba4-cc68-44a1-a4ff-33593ec89a16 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152539 Sep 02 09:58:13.784934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 662/1398] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:13 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:13.814403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2c68d7b8-d887-4592-99ee-d95f56bacee3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:13.822748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2c68d7b8-d887-4592-99ee-d95f56bacee3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084020 Sep 02 09:58:13.823321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 737/1399] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:13 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:14.806539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b3a7f767-7db0-43b3-a894-241a254da83f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:14.807184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b3a7f767-7db0-43b3-a894-241a254da83f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:14.813620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a7f767-7db0-43b3-a894-241a254da83f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:14.814102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a7f767-7db0-43b3-a894-241a254da83f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:14.814539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a7f767-7db0-43b3-a894-241a254da83f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:14.815254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a7f767-7db0-43b3-a894-241a254da83f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:14.815707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a7f767-7db0-43b3-a894-241a254da83f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:14.816131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3a7f767-7db0-43b3-a894-241a254da83f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:14.843848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f49eb505-d330-445b-8eeb-e1fb0c747903 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:14.844466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f49eb505-d330-445b-8eeb-e1fb0c747903 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:14.851597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f49eb505-d330-445b-8eeb-e1fb0c747903 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:14.852088 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f49eb505-d330-445b-8eeb-e1fb0c747903 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:14.852524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f49eb505-d330-445b-8eeb-e1fb0c747903 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:14.853220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f49eb505-d330-445b-8eeb-e1fb0c747903 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:14.853672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f49eb505-d330-445b-8eeb-e1fb0c747903 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:14.854099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f49eb505-d330-445b-8eeb-e1fb0c747903 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:14.919090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f49eb505-d330-445b-8eeb-e1fb0c747903 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:14.927307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f49eb505-d330-445b-8eeb-e1fb0c747903 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087305 Sep 02 09:58:14.928532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 738/1400] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:14 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:14.946973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3a7f767-7db0-43b3-a894-241a254da83f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:14.955022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b3a7f767-7db0-43b3-a894-241a254da83f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152897 Sep 02 09:58:14.955576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 663/1401] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:14 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:15.949081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d3217b45-2f18-4b2a-817f-b6db79ede912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:15.949691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d3217b45-2f18-4b2a-817f-b6db79ede912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:15.956190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3217b45-2f18-4b2a-817f-b6db79ede912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:15.956673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3217b45-2f18-4b2a-817f-b6db79ede912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:15.957110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3217b45-2f18-4b2a-817f-b6db79ede912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:15.957795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3217b45-2f18-4b2a-817f-b6db79ede912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:15.958248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3217b45-2f18-4b2a-817f-b6db79ede912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:15.958673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d3217b45-2f18-4b2a-817f-b6db79ede912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:15.975770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aaf8410f-c6e8-4720-8abb-99b747377d78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:15.976376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aaf8410f-c6e8-4720-8abb-99b747377d78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:15.978682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=52 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:58:15.983325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf8410f-c6e8-4720-8abb-99b747377d78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:15.983806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf8410f-c6e8-4720-8abb-99b747377d78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:15.984240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf8410f-c6e8-4720-8abb-99b747377d78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:15.984923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf8410f-c6e8-4720-8abb-99b747377d78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:15.985376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf8410f-c6e8-4720-8abb-99b747377d78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:15.985794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aaf8410f-c6e8-4720-8abb-99b747377d78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:16.022680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d3217b45-2f18-4b2a-817f-b6db79ede912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:16.031113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d3217b45-2f18-4b2a-817f-b6db79ede912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085880 Sep 02 09:58:16.031689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 739/1402] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:15 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:16.113742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-aaf8410f-c6e8-4720-8abb-99b747377d78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:16.122387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aaf8410f-c6e8-4720-8abb-99b747377d78 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150496 Sep 02 09:58:16.122983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 664/1403] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:15 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:17.051737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5b4f566b-5028-4f13-891c-9dd17899e76d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:17.052291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5b4f566b-5028-4f13-891c-9dd17899e76d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:17.059214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b4f566b-5028-4f13-891c-9dd17899e76d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:17.059690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b4f566b-5028-4f13-891c-9dd17899e76d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:17.060118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b4f566b-5028-4f13-891c-9dd17899e76d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:17.060794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b4f566b-5028-4f13-891c-9dd17899e76d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:17.061247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b4f566b-5028-4f13-891c-9dd17899e76d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:17.061664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b4f566b-5028-4f13-891c-9dd17899e76d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:17.122071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5b4f566b-5028-4f13-891c-9dd17899e76d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:17.130123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5b4f566b-5028-4f13-891c-9dd17899e76d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082372 Sep 02 09:58:17.130681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 740/1404] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:17 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:17.143955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-52df4a43-fea2-42da-81c4-d00d064f2eb4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:17.144622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-52df4a43-fea2-42da-81c4-d00d064f2eb4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:17.151065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52df4a43-fea2-42da-81c4-d00d064f2eb4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:17.151550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52df4a43-fea2-42da-81c4-d00d064f2eb4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:17.151987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52df4a43-fea2-42da-81c4-d00d064f2eb4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:17.152703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52df4a43-fea2-42da-81c4-d00d064f2eb4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:17.153163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52df4a43-fea2-42da-81c4-d00d064f2eb4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:17.153587 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52df4a43-fea2-42da-81c4-d00d064f2eb4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:17.280698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-52df4a43-fea2-42da-81c4-d00d064f2eb4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:17.289349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-52df4a43-fea2-42da-81c4-d00d064f2eb4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149266 Sep 02 09:58:17.289915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 665/1405] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:17 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:18.151503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ba05696e-d810-4285-91f3-e9eb732b6746 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:18.152111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ba05696e-d810-4285-91f3-e9eb732b6746 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:18.158522 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba05696e-d810-4285-91f3-e9eb732b6746 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:18.159028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba05696e-d810-4285-91f3-e9eb732b6746 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:18.159461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba05696e-d810-4285-91f3-e9eb732b6746 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:18.160139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba05696e-d810-4285-91f3-e9eb732b6746 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:18.160588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba05696e-d810-4285-91f3-e9eb732b6746 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:18.161007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba05696e-d810-4285-91f3-e9eb732b6746 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:18.222087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ba05696e-d810-4285-91f3-e9eb732b6746 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:18.230366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ba05696e-d810-4285-91f3-e9eb732b6746 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082714 Sep 02 09:58:18.235169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 741/1406] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:18 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:18.310151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7e8463fa-26ad-4f22-be28-ba2440496d8d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:18.310785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7e8463fa-26ad-4f22-be28-ba2440496d8d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:18.317250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e8463fa-26ad-4f22-be28-ba2440496d8d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:18.317734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e8463fa-26ad-4f22-be28-ba2440496d8d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:18.318815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e8463fa-26ad-4f22-be28-ba2440496d8d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:18.319507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e8463fa-26ad-4f22-be28-ba2440496d8d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:18.319965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e8463fa-26ad-4f22-be28-ba2440496d8d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:18.320424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e8463fa-26ad-4f22-be28-ba2440496d8d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:18.445269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7e8463fa-26ad-4f22-be28-ba2440496d8d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:18.453872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7e8463fa-26ad-4f22-be28-ba2440496d8d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147643 Sep 02 09:58:18.454433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 666/1407] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:18 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:19.251818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-679c8ea9-826a-459a-b5df-098c6d678152 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:19.252361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-679c8ea9-826a-459a-b5df-098c6d678152 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:19.259548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-679c8ea9-826a-459a-b5df-098c6d678152 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:19.260033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-679c8ea9-826a-459a-b5df-098c6d678152 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:19.260468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-679c8ea9-826a-459a-b5df-098c6d678152 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:19.261154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-679c8ea9-826a-459a-b5df-098c6d678152 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:19.261608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-679c8ea9-826a-459a-b5df-098c6d678152 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:19.262037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-679c8ea9-826a-459a-b5df-098c6d678152 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:19.326555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-679c8ea9-826a-459a-b5df-098c6d678152 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:19.339832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-679c8ea9-826a-459a-b5df-098c6d678152 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.092177 Sep 02 09:58:19.340409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 742/1408] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:19 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:19.474873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-91c428b4-bb4a-4d11-95c0-a70cdc7f1aef tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:19.475457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-91c428b4-bb4a-4d11-95c0-a70cdc7f1aef tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:19.481943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c428b4-bb4a-4d11-95c0-a70cdc7f1aef tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:19.482420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c428b4-bb4a-4d11-95c0-a70cdc7f1aef tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:19.482895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c428b4-bb4a-4d11-95c0-a70cdc7f1aef tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:19.483561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c428b4-bb4a-4d11-95c0-a70cdc7f1aef tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:19.484017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c428b4-bb4a-4d11-95c0-a70cdc7f1aef tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:19.484428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91c428b4-bb4a-4d11-95c0-a70cdc7f1aef tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:19.610770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-91c428b4-bb4a-4d11-95c0-a70cdc7f1aef tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:19.618830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-91c428b4-bb4a-4d11-95c0-a70cdc7f1aef tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147861 Sep 02 09:58:19.619386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 667/1409] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:19 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:20.361773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c6c1e4e2-7b76-4660-bd66-e5a67ac100d5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:20.362383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c6c1e4e2-7b76-4660-bd66-e5a67ac100d5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:20.369499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1e4e2-7b76-4660-bd66-e5a67ac100d5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:20.369980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1e4e2-7b76-4660-bd66-e5a67ac100d5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:20.370414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1e4e2-7b76-4660-bd66-e5a67ac100d5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:20.371119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1e4e2-7b76-4660-bd66-e5a67ac100d5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:20.371569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1e4e2-7b76-4660-bd66-e5a67ac100d5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:20.372038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c6c1e4e2-7b76-4660-bd66-e5a67ac100d5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:20.437507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c6c1e4e2-7b76-4660-bd66-e5a67ac100d5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:20.445688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c6c1e4e2-7b76-4660-bd66-e5a67ac100d5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087863 Sep 02 09:58:20.446279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 743/1410] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:20 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:20.640379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-337a1397-ac53-4622-b26c-95e2a820235c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:20.640999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-337a1397-ac53-4622-b26c-95e2a820235c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:20.647899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337a1397-ac53-4622-b26c-95e2a820235c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:20.648386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337a1397-ac53-4622-b26c-95e2a820235c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:20.648823 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337a1397-ac53-4622-b26c-95e2a820235c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:20.649512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337a1397-ac53-4622-b26c-95e2a820235c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:20.649961 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337a1397-ac53-4622-b26c-95e2a820235c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:20.650388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337a1397-ac53-4622-b26c-95e2a820235c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:20.778157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-337a1397-ac53-4622-b26c-95e2a820235c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:20.786282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-337a1397-ac53-4622-b26c-95e2a820235c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149780 Sep 02 09:58:20.786927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 668/1411] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:20 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:21.466549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-925192b5-e7ab-46ba-910d-10bb5ddedeea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:21.467225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-925192b5-e7ab-46ba-910d-10bb5ddedeea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:21.473732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-925192b5-e7ab-46ba-910d-10bb5ddedeea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:21.474214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-925192b5-e7ab-46ba-910d-10bb5ddedeea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:21.474653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-925192b5-e7ab-46ba-910d-10bb5ddedeea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:21.475851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-925192b5-e7ab-46ba-910d-10bb5ddedeea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:21.476305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-925192b5-e7ab-46ba-910d-10bb5ddedeea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:21.476732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-925192b5-e7ab-46ba-910d-10bb5ddedeea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:21.537166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-925192b5-e7ab-46ba-910d-10bb5ddedeea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:21.545691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-925192b5-e7ab-46ba-910d-10bb5ddedeea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083004 Sep 02 09:58:21.546254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 744/1412] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:21 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:21.807815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-877c4dfc-b526-4993-ae82-eee47e22e31e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:21.808332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-877c4dfc-b526-4993-ae82-eee47e22e31e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:21.814966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-877c4dfc-b526-4993-ae82-eee47e22e31e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:21.815439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-877c4dfc-b526-4993-ae82-eee47e22e31e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:21.815868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-877c4dfc-b526-4993-ae82-eee47e22e31e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:21.816540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-877c4dfc-b526-4993-ae82-eee47e22e31e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:21.816986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-877c4dfc-b526-4993-ae82-eee47e22e31e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:21.817400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-877c4dfc-b526-4993-ae82-eee47e22e31e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:21.944135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-877c4dfc-b526-4993-ae82-eee47e22e31e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:21.952278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-877c4dfc-b526-4993-ae82-eee47e22e31e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149156 Sep 02 09:58:21.952839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 669/1413] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:21 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:22.566769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f991d3bd-92c5-4877-a468-cbcd918c6534 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:22.567416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f991d3bd-92c5-4877-a468-cbcd918c6534 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:22.574385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f991d3bd-92c5-4877-a468-cbcd918c6534 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:22.574907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f991d3bd-92c5-4877-a468-cbcd918c6534 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:22.575354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f991d3bd-92c5-4877-a468-cbcd918c6534 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:22.576042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f991d3bd-92c5-4877-a468-cbcd918c6534 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:22.576496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f991d3bd-92c5-4877-a468-cbcd918c6534 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:22.576924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f991d3bd-92c5-4877-a468-cbcd918c6534 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:22.640079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f991d3bd-92c5-4877-a468-cbcd918c6534 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:22.648239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f991d3bd-92c5-4877-a468-cbcd918c6534 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085360 Sep 02 09:58:22.648805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 745/1414] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:22 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:22.973425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5355011d-4c82-4786-948b-517e4d8c5646 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:22.974026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5355011d-4c82-4786-948b-517e4d8c5646 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:22.980980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5355011d-4c82-4786-948b-517e4d8c5646 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:22.981452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5355011d-4c82-4786-948b-517e4d8c5646 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:22.981883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5355011d-4c82-4786-948b-517e4d8c5646 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:22.982553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5355011d-4c82-4786-948b-517e4d8c5646 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:22.983031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5355011d-4c82-4786-948b-517e4d8c5646 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:22.983450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5355011d-4c82-4786-948b-517e4d8c5646 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:23.113892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5355011d-4c82-4786-948b-517e4d8c5646 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:23.122640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5355011d-4c82-4786-948b-517e4d8c5646 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153098 Sep 02 09:58:23.123230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 670/1415] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:22 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:23.668988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-870876cf-1239-4d7b-b62d-f423f1fa7086 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:23.669677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-870876cf-1239-4d7b-b62d-f423f1fa7086 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:23.675922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-870876cf-1239-4d7b-b62d-f423f1fa7086 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:23.676451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-870876cf-1239-4d7b-b62d-f423f1fa7086 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:23.676884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-870876cf-1239-4d7b-b62d-f423f1fa7086 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:23.677558 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-870876cf-1239-4d7b-b62d-f423f1fa7086 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:23.678509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-870876cf-1239-4d7b-b62d-f423f1fa7086 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:23.678953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-870876cf-1239-4d7b-b62d-f423f1fa7086 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:23.742431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-870876cf-1239-4d7b-b62d-f423f1fa7086 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:23.750527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-870876cf-1239-4d7b-b62d-f423f1fa7086 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085463 Sep 02 09:58:23.751104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 746/1416] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:23 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:24.145377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-238c6f2f-ea33-4b70-bc0c-44d825483edb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:24.145998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-238c6f2f-ea33-4b70-bc0c-44d825483edb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:24.152493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-238c6f2f-ea33-4b70-bc0c-44d825483edb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:24.152976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-238c6f2f-ea33-4b70-bc0c-44d825483edb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:24.153414 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-238c6f2f-ea33-4b70-bc0c-44d825483edb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:24.154099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-238c6f2f-ea33-4b70-bc0c-44d825483edb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:24.154555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-238c6f2f-ea33-4b70-bc0c-44d825483edb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:24.155083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-238c6f2f-ea33-4b70-bc0c-44d825483edb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:24.278993 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-238c6f2f-ea33-4b70-bc0c-44d825483edb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:24.287223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-238c6f2f-ea33-4b70-bc0c-44d825483edb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.145755 Sep 02 09:58:24.287813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 671/1417] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:24 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:24.771501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0065598c-ce16-4b63-adf4-2473f932658f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:24.772104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0065598c-ce16-4b63-adf4-2473f932658f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:24.778361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0065598c-ce16-4b63-adf4-2473f932658f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:24.778875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0065598c-ce16-4b63-adf4-2473f932658f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:24.779311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0065598c-ce16-4b63-adf4-2473f932658f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:24.779989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0065598c-ce16-4b63-adf4-2473f932658f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:24.780441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0065598c-ce16-4b63-adf4-2473f932658f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:24.780857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0065598c-ce16-4b63-adf4-2473f932658f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:24.843132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0065598c-ce16-4b63-adf4-2473f932658f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:24.852064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0065598c-ce16-4b63-adf4-2473f932658f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084440 Sep 02 09:58:24.852667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 747/1418] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:24 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:25.307582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d4820c4e-a357-449c-b33e-4cadbe63d90b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:25.308195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d4820c4e-a357-449c-b33e-4cadbe63d90b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:25.314572 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4820c4e-a357-449c-b33e-4cadbe63d90b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:25.315102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4820c4e-a357-449c-b33e-4cadbe63d90b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:25.315523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4820c4e-a357-449c-b33e-4cadbe63d90b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:25.316206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4820c4e-a357-449c-b33e-4cadbe63d90b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:25.316657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4820c4e-a357-449c-b33e-4cadbe63d90b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:25.317080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d4820c4e-a357-449c-b33e-4cadbe63d90b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:25.688841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d4820c4e-a357-449c-b33e-4cadbe63d90b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:25.697575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d4820c4e-a357-449c-b33e-4cadbe63d90b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.393820 Sep 02 09:58:25.698138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 672/1419] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:25 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:25.872919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5a96efa9-2e32-40a3-8d81-559042a4c13f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:25.873611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5a96efa9-2e32-40a3-8d81-559042a4c13f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:25.880032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a96efa9-2e32-40a3-8d81-559042a4c13f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:25.880517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a96efa9-2e32-40a3-8d81-559042a4c13f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:25.880972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a96efa9-2e32-40a3-8d81-559042a4c13f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:25.882210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a96efa9-2e32-40a3-8d81-559042a4c13f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:25.882661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a96efa9-2e32-40a3-8d81-559042a4c13f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:25.883110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a96efa9-2e32-40a3-8d81-559042a4c13f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:25.887274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:58:25.943244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5a96efa9-2e32-40a3-8d81-559042a4c13f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:25.952125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5a96efa9-2e32-40a3-8d81-559042a4c13f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083095 Sep 02 09:58:25.952735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 748/1420] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:26.718438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3b33034-5373-40dd-8aae-a9ad3a387719 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:26.719077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3b33034-5373-40dd-8aae-a9ad3a387719 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:26.726068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b33034-5373-40dd-8aae-a9ad3a387719 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:26.726539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b33034-5373-40dd-8aae-a9ad3a387719 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:26.726998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b33034-5373-40dd-8aae-a9ad3a387719 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:26.727675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b33034-5373-40dd-8aae-a9ad3a387719 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:26.728126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b33034-5373-40dd-8aae-a9ad3a387719 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:26.728544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3b33034-5373-40dd-8aae-a9ad3a387719 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:26.743003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:58:26.854989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e3b33034-5373-40dd-8aae-a9ad3a387719 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:26.863232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3b33034-5373-40dd-8aae-a9ad3a387719 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148658 Sep 02 09:58:26.863800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 673/1421] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:26 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:26.972546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2c4bff3d-8a26-4f4f-8291-2c647ca097f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:26.973071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2c4bff3d-8a26-4f4f-8291-2c647ca097f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:26.979478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c4bff3d-8a26-4f4f-8291-2c647ca097f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:26.979960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c4bff3d-8a26-4f4f-8291-2c647ca097f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:26.980395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c4bff3d-8a26-4f4f-8291-2c647ca097f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:26.981081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c4bff3d-8a26-4f4f-8291-2c647ca097f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:26.981534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c4bff3d-8a26-4f4f-8291-2c647ca097f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:26.981958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c4bff3d-8a26-4f4f-8291-2c647ca097f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:27.042181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2c4bff3d-8a26-4f4f-8291-2c647ca097f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:27.050225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2c4bff3d-8a26-4f4f-8291-2c647ca097f7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081587 Sep 02 09:58:27.050803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 749/1422] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:26 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:27.884536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ec1f6fab-5f53-4be9-8fe0-f06a5c3de76c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:27.885146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ec1f6fab-5f53-4be9-8fe0-f06a5c3de76c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:27.891535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1f6fab-5f53-4be9-8fe0-f06a5c3de76c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:27.892010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1f6fab-5f53-4be9-8fe0-f06a5c3de76c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:27.892439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1f6fab-5f53-4be9-8fe0-f06a5c3de76c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:27.893119 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1f6fab-5f53-4be9-8fe0-f06a5c3de76c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:27.893564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1f6fab-5f53-4be9-8fe0-f06a5c3de76c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:27.893982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec1f6fab-5f53-4be9-8fe0-f06a5c3de76c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:28.020848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ec1f6fab-5f53-4be9-8fe0-f06a5c3de76c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:28.029460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ec1f6fab-5f53-4be9-8fe0-f06a5c3de76c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149091 Sep 02 09:58:28.030025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 674/1423] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:27 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:28.070459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-03badbba-0808-44b6-8f51-51d8931e143a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:28.071134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-03badbba-0808-44b6-8f51-51d8931e143a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:28.077540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03badbba-0808-44b6-8f51-51d8931e143a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:28.077969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03badbba-0808-44b6-8f51-51d8931e143a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:28.078406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03badbba-0808-44b6-8f51-51d8931e143a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:28.079124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03badbba-0808-44b6-8f51-51d8931e143a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:28.079582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03badbba-0808-44b6-8f51-51d8931e143a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:28.080008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-03badbba-0808-44b6-8f51-51d8931e143a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:28.143421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-03badbba-0808-44b6-8f51-51d8931e143a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:28.151959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-03badbba-0808-44b6-8f51-51d8931e143a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085325 Sep 02 09:58:28.152522 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 750/1424] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:28 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:29.051093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cc27eaf4-df82-475a-8468-b95940348296 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:29.051638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cc27eaf4-df82-475a-8468-b95940348296 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:29.060382 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc27eaf4-df82-475a-8468-b95940348296 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:29.060858 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc27eaf4-df82-475a-8468-b95940348296 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:29.061289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc27eaf4-df82-475a-8468-b95940348296 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:29.061996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc27eaf4-df82-475a-8468-b95940348296 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:29.062595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc27eaf4-df82-475a-8468-b95940348296 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:29.063047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc27eaf4-df82-475a-8468-b95940348296 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:29.172435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b6cdd47a-ba3a-40ff-b1d5-d90c09415946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:29.173019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b6cdd47a-ba3a-40ff-b1d5-d90c09415946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:29.179229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6cdd47a-ba3a-40ff-b1d5-d90c09415946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:29.179667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6cdd47a-ba3a-40ff-b1d5-d90c09415946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:29.180111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6cdd47a-ba3a-40ff-b1d5-d90c09415946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:29.180785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6cdd47a-ba3a-40ff-b1d5-d90c09415946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:29.181235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6cdd47a-ba3a-40ff-b1d5-d90c09415946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:29.181653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6cdd47a-ba3a-40ff-b1d5-d90c09415946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:29.197815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cc27eaf4-df82-475a-8468-b95940348296 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:29.206050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cc27eaf4-df82-475a-8468-b95940348296 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.158999 Sep 02 09:58:29.206624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 675/1425] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:29 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:29.242757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b6cdd47a-ba3a-40ff-b1d5-d90c09415946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:29.250938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b6cdd47a-ba3a-40ff-b1d5-d90c09415946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082272 Sep 02 09:58:29.251566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 751/1426] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:29 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:30.228000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1cf59d6c-c301-4ef0-ab07-6aceb768d1a8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:30.228611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1cf59d6c-c301-4ef0-ab07-6aceb768d1a8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:30.234984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf59d6c-c301-4ef0-ab07-6aceb768d1a8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:30.235464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf59d6c-c301-4ef0-ab07-6aceb768d1a8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:30.235889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf59d6c-c301-4ef0-ab07-6aceb768d1a8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:30.236561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf59d6c-c301-4ef0-ab07-6aceb768d1a8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:30.237007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf59d6c-c301-4ef0-ab07-6aceb768d1a8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:30.237423 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf59d6c-c301-4ef0-ab07-6aceb768d1a8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:30.272526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-940d4da7-f4d2-4a8f-bffb-aec004feceaf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:30.273134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-940d4da7-f4d2-4a8f-bffb-aec004feceaf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:30.279653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-940d4da7-f4d2-4a8f-bffb-aec004feceaf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:30.280165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-940d4da7-f4d2-4a8f-bffb-aec004feceaf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:30.280616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-940d4da7-f4d2-4a8f-bffb-aec004feceaf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:30.281294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-940d4da7-f4d2-4a8f-bffb-aec004feceaf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:30.281743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-940d4da7-f4d2-4a8f-bffb-aec004feceaf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:30.282166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-940d4da7-f4d2-4a8f-bffb-aec004feceaf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:30.345599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-940d4da7-f4d2-4a8f-bffb-aec004feceaf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:30.354526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-940d4da7-f4d2-4a8f-bffb-aec004feceaf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086215 Sep 02 09:58:30.355406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 752/1427] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:30 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:30.365211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1cf59d6c-c301-4ef0-ab07-6aceb768d1a8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:30.373475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1cf59d6c-c301-4ef0-ab07-6aceb768d1a8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149870 Sep 02 09:58:30.374038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 676/1428] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:30 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:31.375010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-da44abf1-307d-45a2-b495-b2d1580dba7b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:31.375654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-da44abf1-307d-45a2-b495-b2d1580dba7b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:31.382533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da44abf1-307d-45a2-b495-b2d1580dba7b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:31.383058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da44abf1-307d-45a2-b495-b2d1580dba7b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:31.383764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da44abf1-307d-45a2-b495-b2d1580dba7b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:31.384461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da44abf1-307d-45a2-b495-b2d1580dba7b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:31.384947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da44abf1-307d-45a2-b495-b2d1580dba7b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:31.385376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da44abf1-307d-45a2-b495-b2d1580dba7b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:31.397210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c2a7a697-a340-4349-b655-9c5836f66002 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:31.397835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c2a7a697-a340-4349-b655-9c5836f66002 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:31.404198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2a7a697-a340-4349-b655-9c5836f66002 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:31.404682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2a7a697-a340-4349-b655-9c5836f66002 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:31.405117 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2a7a697-a340-4349-b655-9c5836f66002 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:31.405804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2a7a697-a340-4349-b655-9c5836f66002 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:31.406256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2a7a697-a340-4349-b655-9c5836f66002 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:31.406680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2a7a697-a340-4349-b655-9c5836f66002 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:31.447183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-da44abf1-307d-45a2-b495-b2d1580dba7b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:31.455428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-da44abf1-307d-45a2-b495-b2d1580dba7b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084331 Sep 02 09:58:31.456006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 753/1429] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:31 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:31.535368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c2a7a697-a340-4349-b655-9c5836f66002 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:31.543485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c2a7a697-a340-4349-b655-9c5836f66002 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150676 Sep 02 09:58:31.544048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 677/1430] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:31 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:32.476817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-48273e3f-be5d-4490-be30-c17e206ed256 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:32.477432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-48273e3f-be5d-4490-be30-c17e206ed256 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:32.483818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48273e3f-be5d-4490-be30-c17e206ed256 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:32.484301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48273e3f-be5d-4490-be30-c17e206ed256 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:32.484735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48273e3f-be5d-4490-be30-c17e206ed256 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:32.485418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48273e3f-be5d-4490-be30-c17e206ed256 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:32.485907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48273e3f-be5d-4490-be30-c17e206ed256 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:32.486329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48273e3f-be5d-4490-be30-c17e206ed256 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:32.549432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-48273e3f-be5d-4490-be30-c17e206ed256 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:32.557547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-48273e3f-be5d-4490-be30-c17e206ed256 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085215 Sep 02 09:58:32.558111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 754/1431] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:32 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:32.563541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d5d2deaa-3895-4e57-903c-7ba2acf58dfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:32.564211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d5d2deaa-3895-4e57-903c-7ba2acf58dfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:32.570279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5d2deaa-3895-4e57-903c-7ba2acf58dfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:32.570792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5d2deaa-3895-4e57-903c-7ba2acf58dfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:32.571227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5d2deaa-3895-4e57-903c-7ba2acf58dfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:32.571910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5d2deaa-3895-4e57-903c-7ba2acf58dfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:32.572362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5d2deaa-3895-4e57-903c-7ba2acf58dfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:32.572784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5d2deaa-3895-4e57-903c-7ba2acf58dfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:32.696331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d5d2deaa-3895-4e57-903c-7ba2acf58dfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:32.704413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d5d2deaa-3895-4e57-903c-7ba2acf58dfa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.144632 Sep 02 09:58:32.704970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 678/1432] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:32 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:33.577898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3c14ab16-bf22-42b7-8d42-1d2cd32924e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:33.578505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3c14ab16-bf22-42b7-8d42-1d2cd32924e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:33.585662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c14ab16-bf22-42b7-8d42-1d2cd32924e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:33.586148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c14ab16-bf22-42b7-8d42-1d2cd32924e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:33.586583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c14ab16-bf22-42b7-8d42-1d2cd32924e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:33.587307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c14ab16-bf22-42b7-8d42-1d2cd32924e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:33.587762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c14ab16-bf22-42b7-8d42-1d2cd32924e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:33.588187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c14ab16-bf22-42b7-8d42-1d2cd32924e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:33.649610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3c14ab16-bf22-42b7-8d42-1d2cd32924e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:33.657759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3c14ab16-bf22-42b7-8d42-1d2cd32924e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083753 Sep 02 09:58:33.658321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 755/1433] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:33 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:33.725194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-efc0ba8c-14db-4908-8d28-f880e6352f45 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:33.725809 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-efc0ba8c-14db-4908-8d28-f880e6352f45 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:33.732197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc0ba8c-14db-4908-8d28-f880e6352f45 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:33.732680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc0ba8c-14db-4908-8d28-f880e6352f45 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:33.733112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc0ba8c-14db-4908-8d28-f880e6352f45 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:33.733801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc0ba8c-14db-4908-8d28-f880e6352f45 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:33.734252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc0ba8c-14db-4908-8d28-f880e6352f45 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:33.734689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc0ba8c-14db-4908-8d28-f880e6352f45 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:33.864675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-efc0ba8c-14db-4908-8d28-f880e6352f45 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:33.873304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-efc0ba8c-14db-4908-8d28-f880e6352f45 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151928 Sep 02 09:58:33.873868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 679/1434] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:33 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:34.677643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7bea5170-be06-49b1-a392-40bf0da2dada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:34.678250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7bea5170-be06-49b1-a392-40bf0da2dada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:34.684702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bea5170-be06-49b1-a392-40bf0da2dada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:34.685176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bea5170-be06-49b1-a392-40bf0da2dada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:34.685609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bea5170-be06-49b1-a392-40bf0da2dada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:34.686281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bea5170-be06-49b1-a392-40bf0da2dada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:34.686747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bea5170-be06-49b1-a392-40bf0da2dada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:34.687170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bea5170-be06-49b1-a392-40bf0da2dada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:34.747182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7bea5170-be06-49b1-a392-40bf0da2dada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:34.755222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7bea5170-be06-49b1-a392-40bf0da2dada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081536 Sep 02 09:58:34.755776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 756/1435] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:34 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:34.895097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-59350f78-eb84-4488-be74-f076d417e038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:34.895713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-59350f78-eb84-4488-be74-f076d417e038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:34.902685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59350f78-eb84-4488-be74-f076d417e038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:34.903191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59350f78-eb84-4488-be74-f076d417e038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:34.903623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59350f78-eb84-4488-be74-f076d417e038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:34.904305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59350f78-eb84-4488-be74-f076d417e038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:34.904752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59350f78-eb84-4488-be74-f076d417e038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:34.905174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59350f78-eb84-4488-be74-f076d417e038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:35.031032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-59350f78-eb84-4488-be74-f076d417e038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:35.039143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-59350f78-eb84-4488-be74-f076d417e038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148007 Sep 02 09:58:35.039708 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 680/1436] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:34 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:35.775856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d05e46f5-7915-4b57-93d2-de13e68462ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:35.776445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d05e46f5-7915-4b57-93d2-de13e68462ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:35.783439 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d05e46f5-7915-4b57-93d2-de13e68462ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:35.783922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d05e46f5-7915-4b57-93d2-de13e68462ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:35.784357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d05e46f5-7915-4b57-93d2-de13e68462ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:35.785039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d05e46f5-7915-4b57-93d2-de13e68462ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:35.785485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d05e46f5-7915-4b57-93d2-de13e68462ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:35.785908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d05e46f5-7915-4b57-93d2-de13e68462ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:35.846847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d05e46f5-7915-4b57-93d2-de13e68462ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:35.855568 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d05e46f5-7915-4b57-93d2-de13e68462ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083539 Sep 02 09:58:35.856124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 757/1437] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:35 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:36.060804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a53cc723-2ee4-424b-9f93-1057ad4598b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:36.061350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a53cc723-2ee4-424b-9f93-1057ad4598b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:36.067750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a53cc723-2ee4-424b-9f93-1057ad4598b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:36.068233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a53cc723-2ee4-424b-9f93-1057ad4598b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:36.068671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a53cc723-2ee4-424b-9f93-1057ad4598b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:36.069354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a53cc723-2ee4-424b-9f93-1057ad4598b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:36.069805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a53cc723-2ee4-424b-9f93-1057ad4598b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:36.070229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a53cc723-2ee4-424b-9f93-1057ad4598b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:36.194550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a53cc723-2ee4-424b-9f93-1057ad4598b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:36.202830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a53cc723-2ee4-424b-9f93-1057ad4598b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146046 Sep 02 09:58:36.203420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 681/1438] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:36 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:36.877033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b440ef5d-f106-430a-ba68-791bdfe4d5cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:36.877666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b440ef5d-f106-430a-ba68-791bdfe4d5cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:36.884461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b440ef5d-f106-430a-ba68-791bdfe4d5cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:36.884937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b440ef5d-f106-430a-ba68-791bdfe4d5cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:36.885368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b440ef5d-f106-430a-ba68-791bdfe4d5cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:36.886047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b440ef5d-f106-430a-ba68-791bdfe4d5cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:36.886493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b440ef5d-f106-430a-ba68-791bdfe4d5cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:36.886937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b440ef5d-f106-430a-ba68-791bdfe4d5cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:36.952355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b440ef5d-f106-430a-ba68-791bdfe4d5cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:36.960838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b440ef5d-f106-430a-ba68-791bdfe4d5cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087712 Sep 02 09:58:36.961390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 758/1439] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:36 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:37.224399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-86e48138-2d8f-4bf9-8212-36382c9666de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:37.224929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-86e48138-2d8f-4bf9-8212-36382c9666de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:37.231882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86e48138-2d8f-4bf9-8212-36382c9666de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:37.232363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86e48138-2d8f-4bf9-8212-36382c9666de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:37.232795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86e48138-2d8f-4bf9-8212-36382c9666de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:37.233479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86e48138-2d8f-4bf9-8212-36382c9666de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:37.233937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86e48138-2d8f-4bf9-8212-36382c9666de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:37.234360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86e48138-2d8f-4bf9-8212-36382c9666de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:37.364723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-86e48138-2d8f-4bf9-8212-36382c9666de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:37.372747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-86e48138-2d8f-4bf9-8212-36382c9666de tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152382 Sep 02 09:58:37.375924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 682/1440] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:37 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:37.980974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1fb08e70-be0d-4d32-adba-1db5ba25fd3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:37.981577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1fb08e70-be0d-4d32-adba-1db5ba25fd3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:37.987774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1fb08e70-be0d-4d32-adba-1db5ba25fd3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:37.988195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1fb08e70-be0d-4d32-adba-1db5ba25fd3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:37.988625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1fb08e70-be0d-4d32-adba-1db5ba25fd3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:37.989299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1fb08e70-be0d-4d32-adba-1db5ba25fd3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:37.989744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1fb08e70-be0d-4d32-adba-1db5ba25fd3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:37.990162 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1fb08e70-be0d-4d32-adba-1db5ba25fd3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:38.050209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1fb08e70-be0d-4d32-adba-1db5ba25fd3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:38.059168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1fb08e70-be0d-4d32-adba-1db5ba25fd3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082016 Sep 02 09:58:38.059807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 759/1441] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:37 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:38.396172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0d4f739b-4cf3-44c0-a9ad-9ad8872c4406 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:38.396795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0d4f739b-4cf3-44c0-a9ad-9ad8872c4406 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:38.405757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d4f739b-4cf3-44c0-a9ad-9ad8872c4406 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:38.406265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d4f739b-4cf3-44c0-a9ad-9ad8872c4406 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:38.406733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d4f739b-4cf3-44c0-a9ad-9ad8872c4406 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:38.407429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d4f739b-4cf3-44c0-a9ad-9ad8872c4406 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:38.407887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d4f739b-4cf3-44c0-a9ad-9ad8872c4406 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:38.408317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d4f739b-4cf3-44c0-a9ad-9ad8872c4406 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:38.533463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0d4f739b-4cf3-44c0-a9ad-9ad8872c4406 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:38.541551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0d4f739b-4cf3-44c0-a9ad-9ad8872c4406 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149763 Sep 02 09:58:38.542123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 683/1442] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:38 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:39.080473 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c8373a43-a0d5-44e7-b013-e25438e7af41 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:39.081104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c8373a43-a0d5-44e7-b013-e25438e7af41 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:39.088141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8373a43-a0d5-44e7-b013-e25438e7af41 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:39.088625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8373a43-a0d5-44e7-b013-e25438e7af41 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:39.089059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8373a43-a0d5-44e7-b013-e25438e7af41 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:39.089745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8373a43-a0d5-44e7-b013-e25438e7af41 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:39.090196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8373a43-a0d5-44e7-b013-e25438e7af41 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:39.090623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8373a43-a0d5-44e7-b013-e25438e7af41 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:39.156275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c8373a43-a0d5-44e7-b013-e25438e7af41 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:39.164299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c8373a43-a0d5-44e7-b013-e25438e7af41 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087674 Sep 02 09:58:39.164858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 760/1443] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:39 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:39.562200 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d2209d96-c61f-470a-90ab-1f057cf582a9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:39.562768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d2209d96-c61f-470a-90ab-1f057cf582a9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:39.569480 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2209d96-c61f-470a-90ab-1f057cf582a9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:39.569966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2209d96-c61f-470a-90ab-1f057cf582a9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:39.570399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2209d96-c61f-470a-90ab-1f057cf582a9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:39.571114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2209d96-c61f-470a-90ab-1f057cf582a9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:39.571588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2209d96-c61f-470a-90ab-1f057cf582a9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:39.571992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2209d96-c61f-470a-90ab-1f057cf582a9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:39.700780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d2209d96-c61f-470a-90ab-1f057cf582a9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:39.708932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d2209d96-c61f-470a-90ab-1f057cf582a9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150765 Sep 02 09:58:39.709496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 684/1444] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:39 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:40.184696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-89511e4b-e816-4028-93db-dad73f295bf0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:40.185299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-89511e4b-e816-4028-93db-dad73f295bf0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:40.187620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=58 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:58:40.192188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89511e4b-e816-4028-93db-dad73f295bf0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:40.192667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89511e4b-e816-4028-93db-dad73f295bf0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:40.193099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89511e4b-e816-4028-93db-dad73f295bf0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:40.193777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89511e4b-e816-4028-93db-dad73f295bf0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:40.194221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89511e4b-e816-4028-93db-dad73f295bf0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:40.194640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89511e4b-e816-4028-93db-dad73f295bf0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:40.255235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-89511e4b-e816-4028-93db-dad73f295bf0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:40.263940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-89511e4b-e816-4028-93db-dad73f295bf0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083139 Sep 02 09:58:40.264501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 761/1445] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:40 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:40.729889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0593fd79-5b36-4c6d-8754-2cc0c9a99b6f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:40.730496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0593fd79-5b36-4c6d-8754-2cc0c9a99b6f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:40.736963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0593fd79-5b36-4c6d-8754-2cc0c9a99b6f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:40.737439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0593fd79-5b36-4c6d-8754-2cc0c9a99b6f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:40.737869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0593fd79-5b36-4c6d-8754-2cc0c9a99b6f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:40.738548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0593fd79-5b36-4c6d-8754-2cc0c9a99b6f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:40.739046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0593fd79-5b36-4c6d-8754-2cc0c9a99b6f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:40.739462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0593fd79-5b36-4c6d-8754-2cc0c9a99b6f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:40.865459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0593fd79-5b36-4c6d-8754-2cc0c9a99b6f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:40.874735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0593fd79-5b36-4c6d-8754-2cc0c9a99b6f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148980 Sep 02 09:58:40.875308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 685/1446] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:40 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:41.284978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0bc9865c-1145-4fb3-9178-09f3f9880392 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:41.285582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0bc9865c-1145-4fb3-9178-09f3f9880392 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:41.292602 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bc9865c-1145-4fb3-9178-09f3f9880392 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:41.293084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bc9865c-1145-4fb3-9178-09f3f9880392 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:41.293516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bc9865c-1145-4fb3-9178-09f3f9880392 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:41.294194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bc9865c-1145-4fb3-9178-09f3f9880392 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:41.294646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bc9865c-1145-4fb3-9178-09f3f9880392 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:41.295090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bc9865c-1145-4fb3-9178-09f3f9880392 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:41.358320 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0bc9865c-1145-4fb3-9178-09f3f9880392 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:41.366523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0bc9865c-1145-4fb3-9178-09f3f9880392 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085424 Sep 02 09:58:41.367118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 762/1447] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:41 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:41.896920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5f84e70d-b0d7-45f6-a097-54d1f6cab6c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:41.897556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5f84e70d-b0d7-45f6-a097-54d1f6cab6c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:41.904669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f84e70d-b0d7-45f6-a097-54d1f6cab6c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:41.905147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f84e70d-b0d7-45f6-a097-54d1f6cab6c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:41.905576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f84e70d-b0d7-45f6-a097-54d1f6cab6c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:41.906259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f84e70d-b0d7-45f6-a097-54d1f6cab6c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:41.906726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f84e70d-b0d7-45f6-a097-54d1f6cab6c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:41.907153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f84e70d-b0d7-45f6-a097-54d1f6cab6c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:42.034280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5f84e70d-b0d7-45f6-a097-54d1f6cab6c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:42.042282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5f84e70d-b0d7-45f6-a097-54d1f6cab6c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149292 Sep 02 09:58:42.042870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 686/1448] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:41 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:42.388579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4619c5b9-4a4d-47f1-ae40-aad942f185fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:42.389222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4619c5b9-4a4d-47f1-ae40-aad942f185fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:42.395650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4619c5b9-4a4d-47f1-ae40-aad942f185fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:42.396130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4619c5b9-4a4d-47f1-ae40-aad942f185fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:42.399259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4619c5b9-4a4d-47f1-ae40-aad942f185fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:42.399259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4619c5b9-4a4d-47f1-ae40-aad942f185fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:42.399259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4619c5b9-4a4d-47f1-ae40-aad942f185fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:42.399259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4619c5b9-4a4d-47f1-ae40-aad942f185fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:42.459403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4619c5b9-4a4d-47f1-ae40-aad942f185fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:42.467477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4619c5b9-4a4d-47f1-ae40-aad942f185fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083256 Sep 02 09:58:42.468076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 763/1449] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:42 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:43.063152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6a374322-93f2-4473-80bb-d57da12c8b72 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:43.063766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6a374322-93f2-4473-80bb-d57da12c8b72 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:43.070230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a374322-93f2-4473-80bb-d57da12c8b72 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:43.070729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a374322-93f2-4473-80bb-d57da12c8b72 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:43.071185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a374322-93f2-4473-80bb-d57da12c8b72 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:43.071868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a374322-93f2-4473-80bb-d57da12c8b72 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:43.072322 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a374322-93f2-4473-80bb-d57da12c8b72 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:43.072747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a374322-93f2-4473-80bb-d57da12c8b72 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:43.197671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6a374322-93f2-4473-80bb-d57da12c8b72 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:43.205929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6a374322-93f2-4473-80bb-d57da12c8b72 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146628 Sep 02 09:58:43.206493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 687/1450] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:43 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:43.488688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a6070588-4b05-4aec-934f-5e4f25df2801 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:43.489249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a6070588-4b05-4aec-934f-5e4f25df2801 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:43.495934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a6070588-4b05-4aec-934f-5e4f25df2801 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:43.496410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a6070588-4b05-4aec-934f-5e4f25df2801 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:43.496843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a6070588-4b05-4aec-934f-5e4f25df2801 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:43.497520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a6070588-4b05-4aec-934f-5e4f25df2801 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:43.497969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a6070588-4b05-4aec-934f-5e4f25df2801 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:43.498393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a6070588-4b05-4aec-934f-5e4f25df2801 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:43.559154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a6070588-4b05-4aec-934f-5e4f25df2801 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:43.561332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:58:43.567823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a6070588-4b05-4aec-934f-5e4f25df2801 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083057 Sep 02 09:58:43.568369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 764/1451] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:43 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:44.227905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e99ffe3-25e7-4782-9832-1a9223720d6a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:44.228509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e99ffe3-25e7-4782-9832-1a9223720d6a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:44.234866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e99ffe3-25e7-4782-9832-1a9223720d6a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:44.235346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e99ffe3-25e7-4782-9832-1a9223720d6a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:44.235776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e99ffe3-25e7-4782-9832-1a9223720d6a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:44.236455 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e99ffe3-25e7-4782-9832-1a9223720d6a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:44.236899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e99ffe3-25e7-4782-9832-1a9223720d6a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:44.237317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e99ffe3-25e7-4782-9832-1a9223720d6a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:44.366147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1e99ffe3-25e7-4782-9832-1a9223720d6a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:44.374249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e99ffe3-25e7-4782-9832-1a9223720d6a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150661 Sep 02 09:58:44.374864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 688/1452] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:44 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:44.588711 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3bb88036-6cff-4972-a59a-440d33bbb5c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:44.589247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3bb88036-6cff-4972-a59a-440d33bbb5c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:44.596117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bb88036-6cff-4972-a59a-440d33bbb5c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:44.596599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bb88036-6cff-4972-a59a-440d33bbb5c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:44.597039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bb88036-6cff-4972-a59a-440d33bbb5c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:44.597741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bb88036-6cff-4972-a59a-440d33bbb5c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:44.598176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bb88036-6cff-4972-a59a-440d33bbb5c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:44.598600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3bb88036-6cff-4972-a59a-440d33bbb5c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:44.660949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3bb88036-6cff-4972-a59a-440d33bbb5c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:44.669635 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3bb88036-6cff-4972-a59a-440d33bbb5c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085384 Sep 02 09:58:44.670198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 765/1453] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:44 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:45.395607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-06a05290-b387-442b-89e7-2e798a7e6f7c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:45.396218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-06a05290-b387-442b-89e7-2e798a7e6f7c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:45.403186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06a05290-b387-442b-89e7-2e798a7e6f7c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:45.403670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06a05290-b387-442b-89e7-2e798a7e6f7c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:45.404103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06a05290-b387-442b-89e7-2e798a7e6f7c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:45.404781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06a05290-b387-442b-89e7-2e798a7e6f7c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:45.405267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06a05290-b387-442b-89e7-2e798a7e6f7c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:45.405657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-06a05290-b387-442b-89e7-2e798a7e6f7c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:45.536079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-06a05290-b387-442b-89e7-2e798a7e6f7c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:45.544795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-06a05290-b387-442b-89e7-2e798a7e6f7c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153129 Sep 02 09:58:45.545365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 689/1454] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:45 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:45.689821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7e455b9c-527b-4f79-af39-e57bc9174439 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:45.690369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7e455b9c-527b-4f79-af39-e57bc9174439 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:45.696858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e455b9c-527b-4f79-af39-e57bc9174439 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:45.697342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e455b9c-527b-4f79-af39-e57bc9174439 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:45.697781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e455b9c-527b-4f79-af39-e57bc9174439 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:45.698478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e455b9c-527b-4f79-af39-e57bc9174439 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:45.698959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e455b9c-527b-4f79-af39-e57bc9174439 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:45.699386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e455b9c-527b-4f79-af39-e57bc9174439 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:45.762278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7e455b9c-527b-4f79-af39-e57bc9174439 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:45.770457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7e455b9c-527b-4f79-af39-e57bc9174439 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084539 Sep 02 09:58:45.771052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 766/1455] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:45 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:46.702286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c33a7f25-291b-4920-84bc-84733a6547a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:46.703160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c33a7f25-291b-4920-84bc-84733a6547a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:46.705885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=52 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:58:46.713557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c33a7f25-291b-4920-84bc-84733a6547a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:46.714393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c33a7f25-291b-4920-84bc-84733a6547a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:46.715138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c33a7f25-291b-4920-84bc-84733a6547a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:46.716278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c33a7f25-291b-4920-84bc-84733a6547a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:46.717047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c33a7f25-291b-4920-84bc-84733a6547a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:46.717742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c33a7f25-291b-4920-84bc-84733a6547a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:46.724444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:58:46.791014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-194b3e0a-3b18-4c01-b025-db064dc88d65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:46.791624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-194b3e0a-3b18-4c01-b025-db064dc88d65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:46.797862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-194b3e0a-3b18-4c01-b025-db064dc88d65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:46.798352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-194b3e0a-3b18-4c01-b025-db064dc88d65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:46.798816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-194b3e0a-3b18-4c01-b025-db064dc88d65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:46.799503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-194b3e0a-3b18-4c01-b025-db064dc88d65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:46.799949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-194b3e0a-3b18-4c01-b025-db064dc88d65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:46.800372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-194b3e0a-3b18-4c01-b025-db064dc88d65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:46.871113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-194b3e0a-3b18-4c01-b025-db064dc88d65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:46.872146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c33a7f25-291b-4920-84bc-84733a6547a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:46.879655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-194b3e0a-3b18-4c01-b025-db064dc88d65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.092522 Sep 02 09:58:46.880231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 767/1456] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:46 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:46.880768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c33a7f25-291b-4920-84bc-84733a6547a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.318116 Sep 02 09:58:46.881510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 690/1457] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:46 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:47.901037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ab35c9e0-3f1e-482a-b1f6-8208da876bfc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:47.901576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ab35c9e0-3f1e-482a-b1f6-8208da876bfc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:47.903035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-50dc6e2b-6b05-44bc-9e8b-deee9982a8dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:47.903659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-50dc6e2b-6b05-44bc-9e8b-deee9982a8dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:47.908023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab35c9e0-3f1e-482a-b1f6-8208da876bfc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:47.908507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab35c9e0-3f1e-482a-b1f6-8208da876bfc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:47.908948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab35c9e0-3f1e-482a-b1f6-8208da876bfc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:47.909640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab35c9e0-3f1e-482a-b1f6-8208da876bfc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:47.909981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50dc6e2b-6b05-44bc-9e8b-deee9982a8dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:47.910103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab35c9e0-3f1e-482a-b1f6-8208da876bfc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:47.910464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50dc6e2b-6b05-44bc-9e8b-deee9982a8dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:47.910572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab35c9e0-3f1e-482a-b1f6-8208da876bfc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:47.910943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50dc6e2b-6b05-44bc-9e8b-deee9982a8dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:47.911632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50dc6e2b-6b05-44bc-9e8b-deee9982a8dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:47.912090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50dc6e2b-6b05-44bc-9e8b-deee9982a8dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:47.912543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-50dc6e2b-6b05-44bc-9e8b-deee9982a8dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:47.971956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ab35c9e0-3f1e-482a-b1f6-8208da876bfc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:47.980513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ab35c9e0-3f1e-482a-b1f6-8208da876bfc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084063 Sep 02 09:58:47.981082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 768/1458] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:47 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:48.042556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-50dc6e2b-6b05-44bc-9e8b-deee9982a8dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:48.050903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-50dc6e2b-6b05-44bc-9e8b-deee9982a8dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152287 Sep 02 09:58:48.051471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 691/1459] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:47 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:49.000182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d684cc83-4692-44c1-a6a9-6ed9f1e9b5e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:49.000795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d684cc83-4692-44c1-a6a9-6ed9f1e9b5e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:49.007455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d684cc83-4692-44c1-a6a9-6ed9f1e9b5e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:49.009353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d684cc83-4692-44c1-a6a9-6ed9f1e9b5e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:49.009353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d684cc83-4692-44c1-a6a9-6ed9f1e9b5e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:49.009353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d684cc83-4692-44c1-a6a9-6ed9f1e9b5e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:49.010846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d684cc83-4692-44c1-a6a9-6ed9f1e9b5e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:49.010846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d684cc83-4692-44c1-a6a9-6ed9f1e9b5e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:49.070910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d684cc83-4692-44c1-a6a9-6ed9f1e9b5e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:49.072377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5c6ece9a-460f-4519-a27e-1d502dea4667 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:49.072986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5c6ece9a-460f-4519-a27e-1d502dea4667 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:49.079105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d684cc83-4692-44c1-a6a9-6ed9f1e9b5e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082813 Sep 02 09:58:49.079271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c6ece9a-460f-4519-a27e-1d502dea4667 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:49.079682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 769/1460] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:48 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:49.079818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c6ece9a-460f-4519-a27e-1d502dea4667 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:49.080147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c6ece9a-460f-4519-a27e-1d502dea4667 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:49.080935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c6ece9a-460f-4519-a27e-1d502dea4667 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:49.081384 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c6ece9a-460f-4519-a27e-1d502dea4667 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:49.081802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c6ece9a-460f-4519-a27e-1d502dea4667 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:49.208224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5c6ece9a-460f-4519-a27e-1d502dea4667 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:49.216895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5c6ece9a-460f-4519-a27e-1d502dea4667 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148345 Sep 02 09:58:49.217459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 692/1461] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:49 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:50.100399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-011d1f54-e14c-4cb1-a3f9-efc64697e0b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:50.101003 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-011d1f54-e14c-4cb1-a3f9-efc64697e0b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:50.108679 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-011d1f54-e14c-4cb1-a3f9-efc64697e0b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:50.109161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-011d1f54-e14c-4cb1-a3f9-efc64697e0b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:50.109594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-011d1f54-e14c-4cb1-a3f9-efc64697e0b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:50.110283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-011d1f54-e14c-4cb1-a3f9-efc64697e0b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:50.110750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-011d1f54-e14c-4cb1-a3f9-efc64697e0b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:50.111176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-011d1f54-e14c-4cb1-a3f9-efc64697e0b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:50.175043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-011d1f54-e14c-4cb1-a3f9-efc64697e0b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:50.184075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-011d1f54-e14c-4cb1-a3f9-efc64697e0b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087687 Sep 02 09:58:50.184631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 770/1462] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:50 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:50.237537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7dcea0f9-ceeb-4926-9012-8f5d22b81233 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:50.238156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7dcea0f9-ceeb-4926-9012-8f5d22b81233 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:50.245177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dcea0f9-ceeb-4926-9012-8f5d22b81233 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:50.245656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dcea0f9-ceeb-4926-9012-8f5d22b81233 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:50.246108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dcea0f9-ceeb-4926-9012-8f5d22b81233 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:50.246828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dcea0f9-ceeb-4926-9012-8f5d22b81233 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:50.247276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dcea0f9-ceeb-4926-9012-8f5d22b81233 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:50.247698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dcea0f9-ceeb-4926-9012-8f5d22b81233 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:50.374402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7dcea0f9-ceeb-4926-9012-8f5d22b81233 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:50.382458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7dcea0f9-ceeb-4926-9012-8f5d22b81233 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148757 Sep 02 09:58:50.383314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 693/1463] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:50 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:51.204700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f58f50c4-d49e-413d-937e-9cbe5f995352 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:51.205273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f58f50c4-d49e-413d-937e-9cbe5f995352 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:51.211976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f58f50c4-d49e-413d-937e-9cbe5f995352 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:51.212452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f58f50c4-d49e-413d-937e-9cbe5f995352 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:51.212910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f58f50c4-d49e-413d-937e-9cbe5f995352 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:51.213957 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f58f50c4-d49e-413d-937e-9cbe5f995352 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:51.214416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f58f50c4-d49e-413d-937e-9cbe5f995352 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:51.214879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f58f50c4-d49e-413d-937e-9cbe5f995352 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:51.404028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e5e20544-0f75-41fd-a4de-0694448a1a29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:51.404643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e5e20544-0f75-41fd-a4de-0694448a1a29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:51.411339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e20544-0f75-41fd-a4de-0694448a1a29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:51.411822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e20544-0f75-41fd-a4de-0694448a1a29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:51.412252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e20544-0f75-41fd-a4de-0694448a1a29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:51.412954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e20544-0f75-41fd-a4de-0694448a1a29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:51.413406 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e20544-0f75-41fd-a4de-0694448a1a29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:51.413827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5e20544-0f75-41fd-a4de-0694448a1a29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:51.508400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f58f50c4-d49e-413d-937e-9cbe5f995352 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:51.516506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f58f50c4-d49e-413d-937e-9cbe5f995352 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.315782 Sep 02 09:58:51.517073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 771/1464] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:51 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:51.549009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e5e20544-0f75-41fd-a4de-0694448a1a29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:51.557724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e5e20544-0f75-41fd-a4de-0694448a1a29 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.157651 Sep 02 09:58:51.558466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 694/1465] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:51 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:52.536902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f12fab68-589c-4be4-b7f0-b3119179d901 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:52.537518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f12fab68-589c-4be4-b7f0-b3119179d901 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:52.543970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f12fab68-589c-4be4-b7f0-b3119179d901 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:52.544457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f12fab68-589c-4be4-b7f0-b3119179d901 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:52.544893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f12fab68-589c-4be4-b7f0-b3119179d901 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:52.545574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f12fab68-589c-4be4-b7f0-b3119179d901 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:52.546023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f12fab68-589c-4be4-b7f0-b3119179d901 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:52.546446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f12fab68-589c-4be4-b7f0-b3119179d901 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:52.578981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6e1ff04d-0f75-49fb-864d-d8f0881aa092 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:52.579770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6e1ff04d-0f75-49fb-864d-d8f0881aa092 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:52.586265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e1ff04d-0f75-49fb-864d-d8f0881aa092 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:52.586883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e1ff04d-0f75-49fb-864d-d8f0881aa092 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:52.587346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e1ff04d-0f75-49fb-864d-d8f0881aa092 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:52.588042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e1ff04d-0f75-49fb-864d-d8f0881aa092 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:52.588493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e1ff04d-0f75-49fb-864d-d8f0881aa092 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:52.588909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6e1ff04d-0f75-49fb-864d-d8f0881aa092 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:52.606466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f12fab68-589c-4be4-b7f0-b3119179d901 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:52.614637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f12fab68-589c-4be4-b7f0-b3119179d901 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081580 Sep 02 09:58:52.615235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 772/1466] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:52 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:52.718600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6e1ff04d-0f75-49fb-864d-d8f0881aa092 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:52.726658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6e1ff04d-0f75-49fb-864d-d8f0881aa092 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151574 Sep 02 09:58:52.727241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 695/1467] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:52 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:53.636755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0292f5bd-88e6-4d3b-810b-80df3fa63807 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:53.637372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0292f5bd-88e6-4d3b-810b-80df3fa63807 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:53.643853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0292f5bd-88e6-4d3b-810b-80df3fa63807 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:53.644342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0292f5bd-88e6-4d3b-810b-80df3fa63807 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:53.644803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0292f5bd-88e6-4d3b-810b-80df3fa63807 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:53.645493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0292f5bd-88e6-4d3b-810b-80df3fa63807 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:53.645945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0292f5bd-88e6-4d3b-810b-80df3fa63807 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:53.646369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0292f5bd-88e6-4d3b-810b-80df3fa63807 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:53.707180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0292f5bd-88e6-4d3b-810b-80df3fa63807 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:53.715199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0292f5bd-88e6-4d3b-810b-80df3fa63807 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083193 Sep 02 09:58:53.715760 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 773/1468] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:53 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:58:53.747901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f886c26f-508b-41f5-909c-b115c4316bdc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:53.748514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f886c26f-508b-41f5-909c-b115c4316bdc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:53.755181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f886c26f-508b-41f5-909c-b115c4316bdc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:53.755668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f886c26f-508b-41f5-909c-b115c4316bdc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:53.756144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f886c26f-508b-41f5-909c-b115c4316bdc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:53.756865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f886c26f-508b-41f5-909c-b115c4316bdc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:53.757319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f886c26f-508b-41f5-909c-b115c4316bdc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:53.758031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f886c26f-508b-41f5-909c-b115c4316bdc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:53.890082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f886c26f-508b-41f5-909c-b115c4316bdc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:53.898461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f886c26f-508b-41f5-909c-b115c4316bdc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154443 Sep 02 09:58:53.899055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 696/1469] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:53 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:54.736010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2dbeee10-6ac2-4a36-a621-e72faf8cbadb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:54.736619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2dbeee10-6ac2-4a36-a621-e72faf8cbadb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:54.743089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2dbeee10-6ac2-4a36-a621-e72faf8cbadb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:54.743575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2dbeee10-6ac2-4a36-a621-e72faf8cbadb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:54.744007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2dbeee10-6ac2-4a36-a621-e72faf8cbadb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:54.744689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2dbeee10-6ac2-4a36-a621-e72faf8cbadb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:54.745139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2dbeee10-6ac2-4a36-a621-e72faf8cbadb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:54.745660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2dbeee10-6ac2-4a36-a621-e72faf8cbadb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:54.807831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2dbeee10-6ac2-4a36-a621-e72faf8cbadb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:54.816165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2dbeee10-6ac2-4a36-a621-e72faf8cbadb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083968 Sep 02 09:58:54.816646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 774/1470] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:54 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:54.919012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-89c2e5a8-0191-406b-a569-8bb09ac6e113 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:54.919620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-89c2e5a8-0191-406b-a569-8bb09ac6e113 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:54.926077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89c2e5a8-0191-406b-a569-8bb09ac6e113 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:54.926549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89c2e5a8-0191-406b-a569-8bb09ac6e113 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:54.927011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89c2e5a8-0191-406b-a569-8bb09ac6e113 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:54.927688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89c2e5a8-0191-406b-a569-8bb09ac6e113 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:54.928130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89c2e5a8-0191-406b-a569-8bb09ac6e113 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:54.928547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89c2e5a8-0191-406b-a569-8bb09ac6e113 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:55.056589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-89c2e5a8-0191-406b-a569-8bb09ac6e113 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:55.064657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-89c2e5a8-0191-406b-a569-8bb09ac6e113 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149546 Sep 02 09:58:55.065214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 697/1471] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:54 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:55.837805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0ff8b2d3-2ffc-442f-8d28-e4ca2151df2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:55.838256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0ff8b2d3-2ffc-442f-8d28-e4ca2151df2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:55.844495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ff8b2d3-2ffc-442f-8d28-e4ca2151df2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:55.844984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ff8b2d3-2ffc-442f-8d28-e4ca2151df2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:55.845424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ff8b2d3-2ffc-442f-8d28-e4ca2151df2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:55.846121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ff8b2d3-2ffc-442f-8d28-e4ca2151df2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:55.846575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ff8b2d3-2ffc-442f-8d28-e4ca2151df2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:55.847026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ff8b2d3-2ffc-442f-8d28-e4ca2151df2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:55.909978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0ff8b2d3-2ffc-442f-8d28-e4ca2151df2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:55.918749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0ff8b2d3-2ffc-442f-8d28-e4ca2151df2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085490 Sep 02 09:58:55.919317 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 775/1472] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:55 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:56.085418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c3a816f3-4f1c-4ac6-821a-1647588e000e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:56.087399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c3a816f3-4f1c-4ac6-821a-1647588e000e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:56.093892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3a816f3-4f1c-4ac6-821a-1647588e000e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:56.094372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3a816f3-4f1c-4ac6-821a-1647588e000e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:56.094833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3a816f3-4f1c-4ac6-821a-1647588e000e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:56.095527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3a816f3-4f1c-4ac6-821a-1647588e000e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:56.095979 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3a816f3-4f1c-4ac6-821a-1647588e000e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:56.096402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3a816f3-4f1c-4ac6-821a-1647588e000e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:56.225402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c3a816f3-4f1c-4ac6-821a-1647588e000e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:56.233599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c3a816f3-4f1c-4ac6-821a-1647588e000e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152094 Sep 02 09:58:56.234152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 698/1473] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:56 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:56.939493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f735a431-17f4-44c2-bda5-2a26659920e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:56.940036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f735a431-17f4-44c2-bda5-2a26659920e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:56.946434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f735a431-17f4-44c2-bda5-2a26659920e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:56.946960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f735a431-17f4-44c2-bda5-2a26659920e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:56.947397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f735a431-17f4-44c2-bda5-2a26659920e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:56.948130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f735a431-17f4-44c2-bda5-2a26659920e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:56.948585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f735a431-17f4-44c2-bda5-2a26659920e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:56.949011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f735a431-17f4-44c2-bda5-2a26659920e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:57.010879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f735a431-17f4-44c2-bda5-2a26659920e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:57.019293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f735a431-17f4-44c2-bda5-2a26659920e9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083853 Sep 02 09:58:57.019859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 776/1474] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:56 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:57.254125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4de84b8e-be6b-4f6c-850b-19f9b1f2662a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:57.254668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4de84b8e-be6b-4f6c-850b-19f9b1f2662a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:57.261365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4de84b8e-be6b-4f6c-850b-19f9b1f2662a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:57.261851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4de84b8e-be6b-4f6c-850b-19f9b1f2662a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:57.262289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4de84b8e-be6b-4f6c-850b-19f9b1f2662a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:57.263011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4de84b8e-be6b-4f6c-850b-19f9b1f2662a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:57.263468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4de84b8e-be6b-4f6c-850b-19f9b1f2662a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:57.263898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4de84b8e-be6b-4f6c-850b-19f9b1f2662a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:57.387906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4de84b8e-be6b-4f6c-850b-19f9b1f2662a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:57.396134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4de84b8e-be6b-4f6c-850b-19f9b1f2662a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.145912 Sep 02 09:58:57.396699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 699/1475] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:57 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:58.040149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-00081008-c1b7-4037-a49e-390ff01bd8e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:58.040744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-00081008-c1b7-4037-a49e-390ff01bd8e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:58.047131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00081008-c1b7-4037-a49e-390ff01bd8e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:58.047607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00081008-c1b7-4037-a49e-390ff01bd8e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:58.048045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00081008-c1b7-4037-a49e-390ff01bd8e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:58.048730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00081008-c1b7-4037-a49e-390ff01bd8e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:58.049177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00081008-c1b7-4037-a49e-390ff01bd8e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:58.049600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00081008-c1b7-4037-a49e-390ff01bd8e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:58.109643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-00081008-c1b7-4037-a49e-390ff01bd8e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:58.118165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-00081008-c1b7-4037-a49e-390ff01bd8e6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081889 Sep 02 09:58:58.118745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 777/1476] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:58 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:58.418901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9babe31e-7468-470f-98e0-f02d4730fd1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:58.419534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9babe31e-7468-470f-98e0-f02d4730fd1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:58.425975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9babe31e-7468-470f-98e0-f02d4730fd1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:58.426461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9babe31e-7468-470f-98e0-f02d4730fd1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:58.426937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9babe31e-7468-470f-98e0-f02d4730fd1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:58.427741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9babe31e-7468-470f-98e0-f02d4730fd1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:58.428124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9babe31e-7468-470f-98e0-f02d4730fd1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:58.428573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9babe31e-7468-470f-98e0-f02d4730fd1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:58.555817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9babe31e-7468-470f-98e0-f02d4730fd1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:58.564002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9babe31e-7468-470f-98e0-f02d4730fd1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148978 Sep 02 09:58:58.564606 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 700/1477] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:58 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:59.138969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fe38c2fe-bbba-41fe-b7f4-651a925a20fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:59.139527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fe38c2fe-bbba-41fe-b7f4-651a925a20fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:59.145861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe38c2fe-bbba-41fe-b7f4-651a925a20fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:59.146345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe38c2fe-bbba-41fe-b7f4-651a925a20fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:59.146822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe38c2fe-bbba-41fe-b7f4-651a925a20fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:59.147507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe38c2fe-bbba-41fe-b7f4-651a925a20fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:59.147960 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe38c2fe-bbba-41fe-b7f4-651a925a20fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:59.148385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe38c2fe-bbba-41fe-b7f4-651a925a20fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:59.210574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fe38c2fe-bbba-41fe-b7f4-651a925a20fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:59.218588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fe38c2fe-bbba-41fe-b7f4-651a925a20fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083589 Sep 02 09:58:59.219187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 778/1478] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:59 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:58:59.584399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-10de07d0-bb8f-4c69-a115-2384f8c665eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:58:59.585193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-10de07d0-bb8f-4c69-a115-2384f8c665eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:58:59.592101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10de07d0-bb8f-4c69-a115-2384f8c665eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:59.592579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10de07d0-bb8f-4c69-a115-2384f8c665eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:59.593007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10de07d0-bb8f-4c69-a115-2384f8c665eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:59.593679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10de07d0-bb8f-4c69-a115-2384f8c665eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:58:59.594125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10de07d0-bb8f-4c69-a115-2384f8c665eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:58:59.594543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10de07d0-bb8f-4c69-a115-2384f8c665eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:58:59.730349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-10de07d0-bb8f-4c69-a115-2384f8c665eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:58:59.738667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-10de07d0-bb8f-4c69-a115-2384f8c665eb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.158223 Sep 02 09:58:59.739257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 701/1479] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:58:59 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:00.239608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1471c1af-8591-4c4d-b3fa-f42c90bf45b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:00.240219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1471c1af-8591-4c4d-b3fa-f42c90bf45b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:00.247147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1471c1af-8591-4c4d-b3fa-f42c90bf45b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:00.247635 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1471c1af-8591-4c4d-b3fa-f42c90bf45b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:00.248072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1471c1af-8591-4c4d-b3fa-f42c90bf45b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:00.248753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1471c1af-8591-4c4d-b3fa-f42c90bf45b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:00.249209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1471c1af-8591-4c4d-b3fa-f42c90bf45b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:00.249633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1471c1af-8591-4c4d-b3fa-f42c90bf45b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:00.313168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1471c1af-8591-4c4d-b3fa-f42c90bf45b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:00.321320 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1471c1af-8591-4c4d-b3fa-f42c90bf45b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085613 Sep 02 09:59:00.322768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 779/1480] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:00 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:00.761938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6f1b1d23-8560-41f1-812e-ed201344e2cc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:00.762590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6f1b1d23-8560-41f1-812e-ed201344e2cc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:00.769021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f1b1d23-8560-41f1-812e-ed201344e2cc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:00.769508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f1b1d23-8560-41f1-812e-ed201344e2cc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:00.769951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f1b1d23-8560-41f1-812e-ed201344e2cc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:00.770740 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f1b1d23-8560-41f1-812e-ed201344e2cc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:00.771200 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f1b1d23-8560-41f1-812e-ed201344e2cc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:00.771630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f1b1d23-8560-41f1-812e-ed201344e2cc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:00.901157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6f1b1d23-8560-41f1-812e-ed201344e2cc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:00.909409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6f1b1d23-8560-41f1-812e-ed201344e2cc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152294 Sep 02 09:59:00.909961 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 702/1481] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:00 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:01.342591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b6b26357-c9ba-40ee-a2b4-969ba271c592 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:01.343189 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b6b26357-c9ba-40ee-a2b4-969ba271c592 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:01.349634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6b26357-c9ba-40ee-a2b4-969ba271c592 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:01.350116 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6b26357-c9ba-40ee-a2b4-969ba271c592 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:01.350558 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6b26357-c9ba-40ee-a2b4-969ba271c592 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:01.351273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6b26357-c9ba-40ee-a2b4-969ba271c592 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:01.351728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6b26357-c9ba-40ee-a2b4-969ba271c592 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:01.352155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b6b26357-c9ba-40ee-a2b4-969ba271c592 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:01.420877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b6b26357-c9ba-40ee-a2b4-969ba271c592 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:01.428889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b6b26357-c9ba-40ee-a2b4-969ba271c592 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.090331 Sep 02 09:59:01.429459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 780/1482] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:01 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:01.931012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6087badb-8793-438e-ad33-a635524a8d50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:01.931647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6087badb-8793-438e-ad33-a635524a8d50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:01.937750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6087badb-8793-438e-ad33-a635524a8d50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:01.938226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6087badb-8793-438e-ad33-a635524a8d50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:01.938654 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6087badb-8793-438e-ad33-a635524a8d50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:01.939357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6087badb-8793-438e-ad33-a635524a8d50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:01.939808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6087badb-8793-438e-ad33-a635524a8d50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:01.940230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6087badb-8793-438e-ad33-a635524a8d50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:02.069277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6087badb-8793-438e-ad33-a635524a8d50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:02.077983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6087badb-8793-438e-ad33-a635524a8d50 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150933 Sep 02 09:59:02.078546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 703/1483] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:01 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:02.451748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2b46ea33-fc53-4755-8d95-1967b708e595 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:02.452355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2b46ea33-fc53-4755-8d95-1967b708e595 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:02.458910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b46ea33-fc53-4755-8d95-1967b708e595 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:02.459394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b46ea33-fc53-4755-8d95-1967b708e595 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:02.459837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b46ea33-fc53-4755-8d95-1967b708e595 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:02.460573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b46ea33-fc53-4755-8d95-1967b708e595 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:02.461026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b46ea33-fc53-4755-8d95-1967b708e595 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:02.461459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b46ea33-fc53-4755-8d95-1967b708e595 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:02.475946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:02.523229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2b46ea33-fc53-4755-8d95-1967b708e595 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:02.531327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2b46ea33-fc53-4755-8d95-1967b708e595 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084190 Sep 02 09:59:02.531890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 781/1484] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:02 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:03.099925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4035b2b5-4275-413a-a62a-baee7fbd3f04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:03.100464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4035b2b5-4275-413a-a62a-baee7fbd3f04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:03.107619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4035b2b5-4275-413a-a62a-baee7fbd3f04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:03.108104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4035b2b5-4275-413a-a62a-baee7fbd3f04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:03.108540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4035b2b5-4275-413a-a62a-baee7fbd3f04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:03.109233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4035b2b5-4275-413a-a62a-baee7fbd3f04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:03.109685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4035b2b5-4275-413a-a62a-baee7fbd3f04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:03.110112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4035b2b5-4275-413a-a62a-baee7fbd3f04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:03.236143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4035b2b5-4275-413a-a62a-baee7fbd3f04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:03.244396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4035b2b5-4275-413a-a62a-baee7fbd3f04 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148391 Sep 02 09:59:03.245012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 704/1485] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:03 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:03.552006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-aea94fca-7239-4d87-97bf-45415b51ad0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:03.552544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-aea94fca-7239-4d87-97bf-45415b51ad0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:03.558934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aea94fca-7239-4d87-97bf-45415b51ad0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:03.559412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aea94fca-7239-4d87-97bf-45415b51ad0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:03.559844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aea94fca-7239-4d87-97bf-45415b51ad0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:03.560522 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aea94fca-7239-4d87-97bf-45415b51ad0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:03.560967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aea94fca-7239-4d87-97bf-45415b51ad0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:03.561383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aea94fca-7239-4d87-97bf-45415b51ad0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:03.625569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-aea94fca-7239-4d87-97bf-45415b51ad0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:03.633907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-aea94fca-7239-4d87-97bf-45415b51ad0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085832 Sep 02 09:59:03.634488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 782/1486] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:03 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:04.265526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a516bfbb-7237-4fb8-999a-998227fa216e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:04.266139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a516bfbb-7237-4fb8-999a-998227fa216e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:04.272741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a516bfbb-7237-4fb8-999a-998227fa216e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:04.273225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a516bfbb-7237-4fb8-999a-998227fa216e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:04.273658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a516bfbb-7237-4fb8-999a-998227fa216e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:04.274341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a516bfbb-7237-4fb8-999a-998227fa216e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:04.274817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a516bfbb-7237-4fb8-999a-998227fa216e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:04.275325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a516bfbb-7237-4fb8-999a-998227fa216e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:04.399813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a516bfbb-7237-4fb8-999a-998227fa216e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:04.408138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a516bfbb-7237-4fb8-999a-998227fa216e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146467 Sep 02 09:59:04.408707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 705/1487] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:04 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:04.657325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6bc8ae20-8dae-4348-99c0-c86f00403937 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:04.657931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6bc8ae20-8dae-4348-99c0-c86f00403937 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:04.664286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bc8ae20-8dae-4348-99c0-c86f00403937 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:04.664763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bc8ae20-8dae-4348-99c0-c86f00403937 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:04.665194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bc8ae20-8dae-4348-99c0-c86f00403937 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:04.665870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bc8ae20-8dae-4348-99c0-c86f00403937 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:04.666338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bc8ae20-8dae-4348-99c0-c86f00403937 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:04.667499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6bc8ae20-8dae-4348-99c0-c86f00403937 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:04.726957 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6bc8ae20-8dae-4348-99c0-c86f00403937 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:04.735927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6bc8ae20-8dae-4348-99c0-c86f00403937 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082173 Sep 02 09:59:04.736493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 783/1488] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:04 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:05.429532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-df543f30-bf54-42a2-8aa8-2b68844e94d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:05.430163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-df543f30-bf54-42a2-8aa8-2b68844e94d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:05.437147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df543f30-bf54-42a2-8aa8-2b68844e94d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:05.437632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df543f30-bf54-42a2-8aa8-2b68844e94d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:05.438070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df543f30-bf54-42a2-8aa8-2b68844e94d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:05.438778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df543f30-bf54-42a2-8aa8-2b68844e94d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:05.439231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df543f30-bf54-42a2-8aa8-2b68844e94d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:05.439657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df543f30-bf54-42a2-8aa8-2b68844e94d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:05.568906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-df543f30-bf54-42a2-8aa8-2b68844e94d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:05.571144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:05.578188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-df543f30-bf54-42a2-8aa8-2b68844e94d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152522 Sep 02 09:59:05.578773 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 706/1489] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:05 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:05.756252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f5121ed0-bf4d-4085-bc14-1827057d1979 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:05.756767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f5121ed0-bf4d-4085-bc14-1827057d1979 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:05.763378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5121ed0-bf4d-4085-bc14-1827057d1979 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:05.763859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5121ed0-bf4d-4085-bc14-1827057d1979 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:05.764294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5121ed0-bf4d-4085-bc14-1827057d1979 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:05.764976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5121ed0-bf4d-4085-bc14-1827057d1979 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:05.765424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5121ed0-bf4d-4085-bc14-1827057d1979 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:05.765845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5121ed0-bf4d-4085-bc14-1827057d1979 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:05.828703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f5121ed0-bf4d-4085-bc14-1827057d1979 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:05.837006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f5121ed0-bf4d-4085-bc14-1827057d1979 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084693 Sep 02 09:59:05.837568 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 784/1490] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:05 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:06.599250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-45b1c336-4738-4f44-ab45-11e33d90e4f2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:06.599850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-45b1c336-4738-4f44-ab45-11e33d90e4f2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:06.607241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45b1c336-4738-4f44-ab45-11e33d90e4f2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:06.607746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45b1c336-4738-4f44-ab45-11e33d90e4f2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:06.608177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45b1c336-4738-4f44-ab45-11e33d90e4f2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:06.608851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45b1c336-4738-4f44-ab45-11e33d90e4f2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:06.609297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45b1c336-4738-4f44-ab45-11e33d90e4f2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:06.609712 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45b1c336-4738-4f44-ab45-11e33d90e4f2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:06.735107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-45b1c336-4738-4f44-ab45-11e33d90e4f2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:06.743404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-45b1c336-4738-4f44-ab45-11e33d90e4f2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147983 Sep 02 09:59:06.743972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 707/1491] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:06 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:06.857428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ace14315-0577-48ed-8177-3eb57d1cfb36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:06.857998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ace14315-0577-48ed-8177-3eb57d1cfb36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:06.864346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ace14315-0577-48ed-8177-3eb57d1cfb36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:06.864824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ace14315-0577-48ed-8177-3eb57d1cfb36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:06.865254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ace14315-0577-48ed-8177-3eb57d1cfb36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:06.865933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ace14315-0577-48ed-8177-3eb57d1cfb36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:06.866379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ace14315-0577-48ed-8177-3eb57d1cfb36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:06.866832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ace14315-0577-48ed-8177-3eb57d1cfb36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:06.927338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ace14315-0577-48ed-8177-3eb57d1cfb36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:06.935546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ace14315-0577-48ed-8177-3eb57d1cfb36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082798 Sep 02 09:59:06.936118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 785/1492] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:06 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:07.764984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9b0c22e4-ebc3-48b7-b594-cab579ad6743 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:07.765594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9b0c22e4-ebc3-48b7-b594-cab579ad6743 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:07.771978 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b0c22e4-ebc3-48b7-b594-cab579ad6743 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:07.772456 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b0c22e4-ebc3-48b7-b594-cab579ad6743 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:07.772885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b0c22e4-ebc3-48b7-b594-cab579ad6743 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:07.773568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b0c22e4-ebc3-48b7-b594-cab579ad6743 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:07.774015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b0c22e4-ebc3-48b7-b594-cab579ad6743 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:07.774435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b0c22e4-ebc3-48b7-b594-cab579ad6743 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:07.906644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9b0c22e4-ebc3-48b7-b594-cab579ad6743 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:07.914749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9b0c22e4-ebc3-48b7-b594-cab579ad6743 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154303 Sep 02 09:59:07.915310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 708/1493] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:07 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:07.956046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9d142dba-9ac4-4e38-800a-1cb2940dec91 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:07.956656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9d142dba-9ac4-4e38-800a-1cb2940dec91 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:07.963074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d142dba-9ac4-4e38-800a-1cb2940dec91 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:07.963546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d142dba-9ac4-4e38-800a-1cb2940dec91 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:07.964012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d142dba-9ac4-4e38-800a-1cb2940dec91 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:07.964694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d142dba-9ac4-4e38-800a-1cb2940dec91 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:07.965140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d142dba-9ac4-4e38-800a-1cb2940dec91 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:07.965563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d142dba-9ac4-4e38-800a-1cb2940dec91 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:08.028774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9d142dba-9ac4-4e38-800a-1cb2940dec91 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:08.036814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9d142dba-9ac4-4e38-800a-1cb2940dec91 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084670 Sep 02 09:59:08.037379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 786/1494] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:07 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:08.935988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9b5a25a1-b997-4f53-8b0f-17a66657e0ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:08.936594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9b5a25a1-b997-4f53-8b0f-17a66657e0ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:08.943031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b5a25a1-b997-4f53-8b0f-17a66657e0ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:08.943506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b5a25a1-b997-4f53-8b0f-17a66657e0ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:08.943932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b5a25a1-b997-4f53-8b0f-17a66657e0ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:08.944608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b5a25a1-b997-4f53-8b0f-17a66657e0ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:08.945049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b5a25a1-b997-4f53-8b0f-17a66657e0ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:08.945465 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9b5a25a1-b997-4f53-8b0f-17a66657e0ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:09.057969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7895036e-a26e-4b4b-88a8-eb3df4df743b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:09.058558 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7895036e-a26e-4b4b-88a8-eb3df4df743b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:09.064887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7895036e-a26e-4b4b-88a8-eb3df4df743b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:09.065376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7895036e-a26e-4b4b-88a8-eb3df4df743b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:09.065805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7895036e-a26e-4b4b-88a8-eb3df4df743b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:09.066499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7895036e-a26e-4b4b-88a8-eb3df4df743b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:09.066975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7895036e-a26e-4b4b-88a8-eb3df4df743b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:09.067397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7895036e-a26e-4b4b-88a8-eb3df4df743b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:09.072208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9b5a25a1-b997-4f53-8b0f-17a66657e0ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:09.080953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9b5a25a1-b997-4f53-8b0f-17a66657e0ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148863 Sep 02 09:59:09.082009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 709/1495] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:08 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:09.128573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7895036e-a26e-4b4b-88a8-eb3df4df743b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:09.137535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7895036e-a26e-4b4b-88a8-eb3df4df743b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083983 Sep 02 09:59:09.138102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 787/1496] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:09 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:10.102125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2585f3ab-5752-45b6-9c49-9e67284fe106 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:10.103397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2585f3ab-5752-45b6-9c49-9e67284fe106 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:10.110934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2585f3ab-5752-45b6-9c49-9e67284fe106 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:10.111628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2585f3ab-5752-45b6-9c49-9e67284fe106 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:10.112248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2585f3ab-5752-45b6-9c49-9e67284fe106 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:10.113183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2585f3ab-5752-45b6-9c49-9e67284fe106 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:10.113800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2585f3ab-5752-45b6-9c49-9e67284fe106 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:10.114394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2585f3ab-5752-45b6-9c49-9e67284fe106 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:10.158994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-67ce6140-fbed-4029-b17e-1416496764a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:10.159601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-67ce6140-fbed-4029-b17e-1416496764a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:10.165688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67ce6140-fbed-4029-b17e-1416496764a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:10.166177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67ce6140-fbed-4029-b17e-1416496764a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:10.166618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67ce6140-fbed-4029-b17e-1416496764a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:10.167414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67ce6140-fbed-4029-b17e-1416496764a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:10.167882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67ce6140-fbed-4029-b17e-1416496764a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:10.168305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67ce6140-fbed-4029-b17e-1416496764a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:10.231811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67ce6140-fbed-4029-b17e-1416496764a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:10.239979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-67ce6140-fbed-4029-b17e-1416496764a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085824 Sep 02 09:59:10.240547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 788/1497] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:10 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:10.251575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2585f3ab-5752-45b6-9c49-9e67284fe106 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:10.260020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2585f3ab-5752-45b6-9c49-9e67284fe106 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.161949 Sep 02 09:59:10.261104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 710/1498] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:10 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:11.261602 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-00849235-da7e-4f3b-8052-26df357cc060 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:11.262164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-00849235-da7e-4f3b-8052-26df357cc060 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:11.264513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=56 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:11.269200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00849235-da7e-4f3b-8052-26df357cc060 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:11.269686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00849235-da7e-4f3b-8052-26df357cc060 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:11.270125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00849235-da7e-4f3b-8052-26df357cc060 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:11.270923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00849235-da7e-4f3b-8052-26df357cc060 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:11.271380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00849235-da7e-4f3b-8052-26df357cc060 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:11.271809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00849235-da7e-4f3b-8052-26df357cc060 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:11.280441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8021966b-0605-46d6-ac49-70c590c89901 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:11.281073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8021966b-0605-46d6-ac49-70c590c89901 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:11.287484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8021966b-0605-46d6-ac49-70c590c89901 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:11.287957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8021966b-0605-46d6-ac49-70c590c89901 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:11.288383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8021966b-0605-46d6-ac49-70c590c89901 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:11.289100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8021966b-0605-46d6-ac49-70c590c89901 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:11.289548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8021966b-0605-46d6-ac49-70c590c89901 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:11.289969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8021966b-0605-46d6-ac49-70c590c89901 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:11.334355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-00849235-da7e-4f3b-8052-26df357cc060 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:11.342662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-00849235-da7e-4f3b-8052-26df357cc060 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085947 Sep 02 09:59:11.343254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 789/1499] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:11 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:11.416392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8021966b-0605-46d6-ac49-70c590c89901 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:11.424500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8021966b-0605-46d6-ac49-70c590c89901 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147907 Sep 02 09:59:11.425074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 711/1500] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:11 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:12.363617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1d788f9b-de62-4c50-a4a6-dc8d6472b866 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:12.364236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1d788f9b-de62-4c50-a4a6-dc8d6472b866 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:12.370843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d788f9b-de62-4c50-a4a6-dc8d6472b866 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:12.380229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d788f9b-de62-4c50-a4a6-dc8d6472b866 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:12.380229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d788f9b-de62-4c50-a4a6-dc8d6472b866 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:12.380229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d788f9b-de62-4c50-a4a6-dc8d6472b866 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:12.380229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d788f9b-de62-4c50-a4a6-dc8d6472b866 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:12.380665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d788f9b-de62-4c50-a4a6-dc8d6472b866 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:12.438880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1d788f9b-de62-4c50-a4a6-dc8d6472b866 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:12.445501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5076103d-b977-4ece-8bad-1abe4ba498f8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:12.446112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5076103d-b977-4ece-8bad-1abe4ba498f8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:12.448295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1d788f9b-de62-4c50-a4a6-dc8d6472b866 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.088057 Sep 02 09:59:12.448881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 790/1501] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:12 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:12.453392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5076103d-b977-4ece-8bad-1abe4ba498f8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:12.454583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5076103d-b977-4ece-8bad-1abe4ba498f8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:12.454583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5076103d-b977-4ece-8bad-1abe4ba498f8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:12.455055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5076103d-b977-4ece-8bad-1abe4ba498f8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:12.455510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5076103d-b977-4ece-8bad-1abe4ba498f8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:12.455945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5076103d-b977-4ece-8bad-1abe4ba498f8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:12.582343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5076103d-b977-4ece-8bad-1abe4ba498f8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:12.591083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5076103d-b977-4ece-8bad-1abe4ba498f8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149410 Sep 02 09:59:12.591649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 712/1502] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:12 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:13.470211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a7e04b75-1cb1-4244-8320-5e00eb197762 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:13.470852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a7e04b75-1cb1-4244-8320-5e00eb197762 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:13.477309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a7e04b75-1cb1-4244-8320-5e00eb197762 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:13.477798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a7e04b75-1cb1-4244-8320-5e00eb197762 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:13.478238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a7e04b75-1cb1-4244-8320-5e00eb197762 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:13.479529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a7e04b75-1cb1-4244-8320-5e00eb197762 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:13.479985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a7e04b75-1cb1-4244-8320-5e00eb197762 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:13.480412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a7e04b75-1cb1-4244-8320-5e00eb197762 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:13.543641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a7e04b75-1cb1-4244-8320-5e00eb197762 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:13.551722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a7e04b75-1cb1-4244-8320-5e00eb197762 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085923 Sep 02 09:59:13.552285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 791/1503] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:13 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:13.612091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c1ca1977-f5fc-4239-8db8-7a645fe59e1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:13.612701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c1ca1977-f5fc-4239-8db8-7a645fe59e1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:13.619120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1ca1977-f5fc-4239-8db8-7a645fe59e1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:13.619600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1ca1977-f5fc-4239-8db8-7a645fe59e1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:13.620035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1ca1977-f5fc-4239-8db8-7a645fe59e1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:13.620717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1ca1977-f5fc-4239-8db8-7a645fe59e1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:13.621168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1ca1977-f5fc-4239-8db8-7a645fe59e1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:13.621590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1ca1977-f5fc-4239-8db8-7a645fe59e1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:13.748943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c1ca1977-f5fc-4239-8db8-7a645fe59e1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:13.757355 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c1ca1977-f5fc-4239-8db8-7a645fe59e1e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148836 Sep 02 09:59:13.757917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 713/1504] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:13 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:14.571737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-efd135c2-a6f5-46b7-ac19-5b73314a785b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:14.572323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-efd135c2-a6f5-46b7-ac19-5b73314a785b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:14.579470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd135c2-a6f5-46b7-ac19-5b73314a785b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:14.579951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd135c2-a6f5-46b7-ac19-5b73314a785b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:14.580388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd135c2-a6f5-46b7-ac19-5b73314a785b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:14.581073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd135c2-a6f5-46b7-ac19-5b73314a785b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:14.581528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd135c2-a6f5-46b7-ac19-5b73314a785b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:14.581953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efd135c2-a6f5-46b7-ac19-5b73314a785b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:14.642493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-efd135c2-a6f5-46b7-ac19-5b73314a785b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:14.650594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-efd135c2-a6f5-46b7-ac19-5b73314a785b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082732 Sep 02 09:59:14.651290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 792/1505] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:14 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:14.778063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-142a9e00-d9e2-4236-90aa-d1e2cb2897b0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:14.778733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-142a9e00-d9e2-4236-90aa-d1e2cb2897b0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:14.785162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-142a9e00-d9e2-4236-90aa-d1e2cb2897b0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:14.785641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-142a9e00-d9e2-4236-90aa-d1e2cb2897b0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:14.786074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-142a9e00-d9e2-4236-90aa-d1e2cb2897b0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:14.786780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-142a9e00-d9e2-4236-90aa-d1e2cb2897b0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:14.787233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-142a9e00-d9e2-4236-90aa-d1e2cb2897b0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:14.787655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-142a9e00-d9e2-4236-90aa-d1e2cb2897b0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:14.915814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-142a9e00-d9e2-4236-90aa-d1e2cb2897b0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:14.924399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-142a9e00-d9e2-4236-90aa-d1e2cb2897b0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150184 Sep 02 09:59:14.924959 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 714/1506] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:14 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:15.670870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-50534732-b750-422f-9f6e-193ae089de1b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:15.671484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-50534732-b750-422f-9f6e-193ae089de1b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:15.677948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50534732-b750-422f-9f6e-193ae089de1b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:15.678443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50534732-b750-422f-9f6e-193ae089de1b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:15.678909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50534732-b750-422f-9f6e-193ae089de1b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:15.679596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50534732-b750-422f-9f6e-193ae089de1b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:15.680048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50534732-b750-422f-9f6e-193ae089de1b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:15.680474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-50534732-b750-422f-9f6e-193ae089de1b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:15.741777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-50534732-b750-422f-9f6e-193ae089de1b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:15.750198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-50534732-b750-422f-9f6e-193ae089de1b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083720 Sep 02 09:59:15.750777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 793/1507] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:15 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:15.945876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4e7104de-a237-442c-bb1c-94a6e36f83fe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:15.946443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4e7104de-a237-442c-bb1c-94a6e36f83fe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:15.952847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e7104de-a237-442c-bb1c-94a6e36f83fe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:15.953329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e7104de-a237-442c-bb1c-94a6e36f83fe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:15.953758 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e7104de-a237-442c-bb1c-94a6e36f83fe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:15.954440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e7104de-a237-442c-bb1c-94a6e36f83fe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:15.954921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e7104de-a237-442c-bb1c-94a6e36f83fe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:15.955347 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e7104de-a237-442c-bb1c-94a6e36f83fe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:16.085685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4e7104de-a237-442c-bb1c-94a6e36f83fe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:16.094316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4e7104de-a237-442c-bb1c-94a6e36f83fe tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152391 Sep 02 09:59:16.094938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 715/1508] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:15 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:16.770618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1d1d6ca4-a8e8-4e1d-a729-5fa624008e2b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:16.771354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1d1d6ca4-a8e8-4e1d-a729-5fa624008e2b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:16.777689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d1d6ca4-a8e8-4e1d-a729-5fa624008e2b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:16.778171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d1d6ca4-a8e8-4e1d-a729-5fa624008e2b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:16.778603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d1d6ca4-a8e8-4e1d-a729-5fa624008e2b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:16.779311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d1d6ca4-a8e8-4e1d-a729-5fa624008e2b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:16.779763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d1d6ca4-a8e8-4e1d-a729-5fa624008e2b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:16.780198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d1d6ca4-a8e8-4e1d-a729-5fa624008e2b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:16.844599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1d1d6ca4-a8e8-4e1d-a729-5fa624008e2b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:16.852856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1d1d6ca4-a8e8-4e1d-a729-5fa624008e2b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086198 Sep 02 09:59:16.853421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 794/1509] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:16 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:17.115448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9e3c14b4-f7c1-44f2-bf06-ae4c8992e13e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:17.116066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9e3c14b4-f7c1-44f2-bf06-ae4c8992e13e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:17.118495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=52 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:17.123247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e3c14b4-f7c1-44f2-bf06-ae4c8992e13e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:17.127325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e3c14b4-f7c1-44f2-bf06-ae4c8992e13e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:17.127325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e3c14b4-f7c1-44f2-bf06-ae4c8992e13e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:17.127325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e3c14b4-f7c1-44f2-bf06-ae4c8992e13e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:17.127325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e3c14b4-f7c1-44f2-bf06-ae4c8992e13e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:17.127869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e3c14b4-f7c1-44f2-bf06-ae4c8992e13e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:17.250954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e3c14b4-f7c1-44f2-bf06-ae4c8992e13e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:17.259398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9e3c14b4-f7c1-44f2-bf06-ae4c8992e13e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147777 Sep 02 09:59:17.260004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 716/1510] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:17 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:17.874278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-52b92f71-a8a9-49a4-8d4f-20b04adda9bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:17.874917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-52b92f71-a8a9-49a4-8d4f-20b04adda9bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:17.881377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52b92f71-a8a9-49a4-8d4f-20b04adda9bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:17.881858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52b92f71-a8a9-49a4-8d4f-20b04adda9bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:17.882543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52b92f71-a8a9-49a4-8d4f-20b04adda9bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:17.883328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52b92f71-a8a9-49a4-8d4f-20b04adda9bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:17.883776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52b92f71-a8a9-49a4-8d4f-20b04adda9bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:17.884198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52b92f71-a8a9-49a4-8d4f-20b04adda9bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:17.945123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-52b92f71-a8a9-49a4-8d4f-20b04adda9bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:17.953165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-52b92f71-a8a9-49a4-8d4f-20b04adda9bc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083694 Sep 02 09:59:17.953725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 795/1511] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:17 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:18.281399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b1b83976-f140-4106-a7f7-617d8f002fd7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:18.281938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b1b83976-f140-4106-a7f7-617d8f002fd7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:18.288364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1b83976-f140-4106-a7f7-617d8f002fd7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:18.288846 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1b83976-f140-4106-a7f7-617d8f002fd7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:18.289286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1b83976-f140-4106-a7f7-617d8f002fd7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:18.289962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1b83976-f140-4106-a7f7-617d8f002fd7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:18.290412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1b83976-f140-4106-a7f7-617d8f002fd7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:18.290864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b1b83976-f140-4106-a7f7-617d8f002fd7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:18.416266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b1b83976-f140-4106-a7f7-617d8f002fd7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:18.424401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b1b83976-f140-4106-a7f7-617d8f002fd7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147034 Sep 02 09:59:18.424969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 717/1512] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:18 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:18.975011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-734c4eef-8491-4b0c-996f-41b6e5152fc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:18.975620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-734c4eef-8491-4b0c-996f-41b6e5152fc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:18.982305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-734c4eef-8491-4b0c-996f-41b6e5152fc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:18.982819 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-734c4eef-8491-4b0c-996f-41b6e5152fc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:18.983303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-734c4eef-8491-4b0c-996f-41b6e5152fc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:18.983938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-734c4eef-8491-4b0c-996f-41b6e5152fc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:18.984391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-734c4eef-8491-4b0c-996f-41b6e5152fc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:18.984814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-734c4eef-8491-4b0c-996f-41b6e5152fc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:19.045775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-734c4eef-8491-4b0c-996f-41b6e5152fc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:19.054079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-734c4eef-8491-4b0c-996f-41b6e5152fc0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083117 Sep 02 09:59:19.054641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 796/1513] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:18 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:19.445287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-05c557d0-c60b-4d9f-a3d4-777677c9bc00 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:19.445899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-05c557d0-c60b-4d9f-a3d4-777677c9bc00 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:19.452306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05c557d0-c60b-4d9f-a3d4-777677c9bc00 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:19.452785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05c557d0-c60b-4d9f-a3d4-777677c9bc00 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:19.453215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05c557d0-c60b-4d9f-a3d4-777677c9bc00 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:19.453895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05c557d0-c60b-4d9f-a3d4-777677c9bc00 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:19.454349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05c557d0-c60b-4d9f-a3d4-777677c9bc00 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:19.454799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-05c557d0-c60b-4d9f-a3d4-777677c9bc00 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:19.583643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-05c557d0-c60b-4d9f-a3d4-777677c9bc00 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:19.592221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-05c557d0-c60b-4d9f-a3d4-777677c9bc00 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150832 Sep 02 09:59:19.592786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 718/1514] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:19 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:20.074382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-09247112-6297-4923-befa-cf2c9f11124d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:20.075011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-09247112-6297-4923-befa-cf2c9f11124d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:20.081419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09247112-6297-4923-befa-cf2c9f11124d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:20.081900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09247112-6297-4923-befa-cf2c9f11124d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:20.082328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09247112-6297-4923-befa-cf2c9f11124d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:20.083041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09247112-6297-4923-befa-cf2c9f11124d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:20.083491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09247112-6297-4923-befa-cf2c9f11124d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:20.083914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09247112-6297-4923-befa-cf2c9f11124d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:20.144517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-09247112-6297-4923-befa-cf2c9f11124d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:20.152560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-09247112-6297-4923-befa-cf2c9f11124d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082099 Sep 02 09:59:20.153119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 797/1515] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:20 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:20.613622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7e1f3401-c738-4dfe-90b8-6a0668b6e439 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:20.614259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7e1f3401-c738-4dfe-90b8-6a0668b6e439 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:20.620604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e1f3401-c738-4dfe-90b8-6a0668b6e439 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:20.621077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e1f3401-c738-4dfe-90b8-6a0668b6e439 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:20.621507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e1f3401-c738-4dfe-90b8-6a0668b6e439 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:20.622179 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e1f3401-c738-4dfe-90b8-6a0668b6e439 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:20.622626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e1f3401-c738-4dfe-90b8-6a0668b6e439 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:20.623065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e1f3401-c738-4dfe-90b8-6a0668b6e439 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:20.748438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7e1f3401-c738-4dfe-90b8-6a0668b6e439 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:20.756551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7e1f3401-c738-4dfe-90b8-6a0668b6e439 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146797 Sep 02 09:59:20.757371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 719/1516] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:20 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:21.172690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7cece994-210a-4865-af80-6dffba37c21d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:21.173305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7cece994-210a-4865-af80-6dffba37c21d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:21.179868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7cece994-210a-4865-af80-6dffba37c21d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:21.180531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7cece994-210a-4865-af80-6dffba37c21d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:21.180972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7cece994-210a-4865-af80-6dffba37c21d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:21.181985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7cece994-210a-4865-af80-6dffba37c21d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:21.183486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7cece994-210a-4865-af80-6dffba37c21d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:21.184168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7cece994-210a-4865-af80-6dffba37c21d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:21.187060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:21.262128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7cece994-210a-4865-af80-6dffba37c21d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:21.270738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7cece994-210a-4865-af80-6dffba37c21d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.101876 Sep 02 09:59:21.288354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 798/1517] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:21 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:21.777896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-692bb486-8c6a-4380-ae38-d99d2d3ac6b6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:21.778453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-692bb486-8c6a-4380-ae38-d99d2d3ac6b6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:21.784916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-692bb486-8c6a-4380-ae38-d99d2d3ac6b6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:21.785395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-692bb486-8c6a-4380-ae38-d99d2d3ac6b6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:21.785832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-692bb486-8c6a-4380-ae38-d99d2d3ac6b6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:21.786516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-692bb486-8c6a-4380-ae38-d99d2d3ac6b6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:21.787007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-692bb486-8c6a-4380-ae38-d99d2d3ac6b6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:21.787434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-692bb486-8c6a-4380-ae38-d99d2d3ac6b6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:21.925811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-692bb486-8c6a-4380-ae38-d99d2d3ac6b6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:21.934313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-692bb486-8c6a-4380-ae38-d99d2d3ac6b6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.160950 Sep 02 09:59:21.934894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 720/1518] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:21 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:22.299691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-448e40ec-9897-4bac-ba3e-b02c236fc4ae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:22.300299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-448e40ec-9897-4bac-ba3e-b02c236fc4ae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:22.306824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-448e40ec-9897-4bac-ba3e-b02c236fc4ae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:22.307302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-448e40ec-9897-4bac-ba3e-b02c236fc4ae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:22.307735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-448e40ec-9897-4bac-ba3e-b02c236fc4ae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:22.308413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-448e40ec-9897-4bac-ba3e-b02c236fc4ae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:22.308864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-448e40ec-9897-4bac-ba3e-b02c236fc4ae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:22.309282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-448e40ec-9897-4bac-ba3e-b02c236fc4ae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:22.369873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-448e40ec-9897-4bac-ba3e-b02c236fc4ae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:22.378052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-448e40ec-9897-4bac-ba3e-b02c236fc4ae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082658 Sep 02 09:59:22.378623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 799/1519] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:22 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:22.955237 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cf9e3606-1505-4263-b3cb-0db087ce5157 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:22.955861 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cf9e3606-1505-4263-b3cb-0db087ce5157 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:22.962252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf9e3606-1505-4263-b3cb-0db087ce5157 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:22.962756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf9e3606-1505-4263-b3cb-0db087ce5157 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:22.963190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf9e3606-1505-4263-b3cb-0db087ce5157 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:22.963864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf9e3606-1505-4263-b3cb-0db087ce5157 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:22.964306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf9e3606-1505-4263-b3cb-0db087ce5157 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:22.964722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf9e3606-1505-4263-b3cb-0db087ce5157 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:23.094293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cf9e3606-1505-4263-b3cb-0db087ce5157 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:23.102425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cf9e3606-1505-4263-b3cb-0db087ce5157 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151023 Sep 02 09:59:23.102959 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 721/1520] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:22 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:23.399561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a4159f57-98f3-4eef-a056-cc3f8870bb31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:23.400144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a4159f57-98f3-4eef-a056-cc3f8870bb31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:23.406981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4159f57-98f3-4eef-a056-cc3f8870bb31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:23.407471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4159f57-98f3-4eef-a056-cc3f8870bb31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:23.407909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4159f57-98f3-4eef-a056-cc3f8870bb31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:23.408589 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4159f57-98f3-4eef-a056-cc3f8870bb31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:23.409041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4159f57-98f3-4eef-a056-cc3f8870bb31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:23.409487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4159f57-98f3-4eef-a056-cc3f8870bb31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:23.469464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a4159f57-98f3-4eef-a056-cc3f8870bb31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:23.477523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a4159f57-98f3-4eef-a056-cc3f8870bb31 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081977 Sep 02 09:59:23.478081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 800/1521] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:23 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:24.124374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1ddd7c4f-5706-42fb-a450-4209d2d03ea6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:24.124977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1ddd7c4f-5706-42fb-a450-4209d2d03ea6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:24.131492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ddd7c4f-5706-42fb-a450-4209d2d03ea6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:24.132222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ddd7c4f-5706-42fb-a450-4209d2d03ea6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:24.132646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ddd7c4f-5706-42fb-a450-4209d2d03ea6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:24.133320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ddd7c4f-5706-42fb-a450-4209d2d03ea6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:24.133763 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ddd7c4f-5706-42fb-a450-4209d2d03ea6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:24.134181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ddd7c4f-5706-42fb-a450-4209d2d03ea6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:24.262804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1ddd7c4f-5706-42fb-a450-4209d2d03ea6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:24.270910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1ddd7c4f-5706-42fb-a450-4209d2d03ea6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150458 Sep 02 09:59:24.271475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 722/1522] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:24 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:24.499227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-27d81a86-d7f8-46a7-a34d-c977b10e5422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:24.499754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-27d81a86-d7f8-46a7-a34d-c977b10e5422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:24.506145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27d81a86-d7f8-46a7-a34d-c977b10e5422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:24.506621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27d81a86-d7f8-46a7-a34d-c977b10e5422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:24.507334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27d81a86-d7f8-46a7-a34d-c977b10e5422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:24.508012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27d81a86-d7f8-46a7-a34d-c977b10e5422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:24.508458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27d81a86-d7f8-46a7-a34d-c977b10e5422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:24.508876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27d81a86-d7f8-46a7-a34d-c977b10e5422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:24.568748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-27d81a86-d7f8-46a7-a34d-c977b10e5422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:24.576834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-27d81a86-d7f8-46a7-a34d-c977b10e5422 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082227 Sep 02 09:59:24.577396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 801/1523] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:24 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:25.291787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6ca3737f-c52c-462d-9349-718c4390a84d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:25.292395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6ca3737f-c52c-462d-9349-718c4390a84d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:25.298859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ca3737f-c52c-462d-9349-718c4390a84d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:25.306874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ca3737f-c52c-462d-9349-718c4390a84d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:25.306874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ca3737f-c52c-462d-9349-718c4390a84d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:25.306874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ca3737f-c52c-462d-9349-718c4390a84d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:25.306874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ca3737f-c52c-462d-9349-718c4390a84d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:25.307246 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ca3737f-c52c-462d-9349-718c4390a84d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:25.315812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:25.427972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6ca3737f-c52c-462d-9349-718c4390a84d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:25.436640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6ca3737f-c52c-462d-9349-718c4390a84d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148733 Sep 02 09:59:25.437714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 723/1524] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:25 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:25.597287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8a1b46ea-4e05-41b8-ac39-606ee3cf4f06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:25.597927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8a1b46ea-4e05-41b8-ac39-606ee3cf4f06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:25.604352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a1b46ea-4e05-41b8-ac39-606ee3cf4f06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:25.604839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a1b46ea-4e05-41b8-ac39-606ee3cf4f06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:25.605272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a1b46ea-4e05-41b8-ac39-606ee3cf4f06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:25.605955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a1b46ea-4e05-41b8-ac39-606ee3cf4f06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:25.606408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a1b46ea-4e05-41b8-ac39-606ee3cf4f06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:25.606863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8a1b46ea-4e05-41b8-ac39-606ee3cf4f06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:25.671965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8a1b46ea-4e05-41b8-ac39-606ee3cf4f06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:25.680111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8a1b46ea-4e05-41b8-ac39-606ee3cf4f06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086768 Sep 02 09:59:25.680675 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 802/1525] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:26.458373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0fa71dc8-087f-4ec9-9bad-2160ed6d4a38 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:26.459011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0fa71dc8-087f-4ec9-9bad-2160ed6d4a38 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:26.465980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fa71dc8-087f-4ec9-9bad-2160ed6d4a38 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:26.466459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fa71dc8-087f-4ec9-9bad-2160ed6d4a38 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:26.466930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fa71dc8-087f-4ec9-9bad-2160ed6d4a38 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:26.467614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fa71dc8-087f-4ec9-9bad-2160ed6d4a38 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:26.468067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fa71dc8-087f-4ec9-9bad-2160ed6d4a38 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:26.468492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0fa71dc8-087f-4ec9-9bad-2160ed6d4a38 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:26.592715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0fa71dc8-087f-4ec9-9bad-2160ed6d4a38 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:26.600773 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0fa71dc8-087f-4ec9-9bad-2160ed6d4a38 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146333 Sep 02 09:59:26.601329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 724/1526] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:26 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:26.700955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ecd5fbe8-3d67-41d6-b68c-11da05b87698 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:26.701562 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ecd5fbe8-3d67-41d6-b68c-11da05b87698 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:26.707895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecd5fbe8-3d67-41d6-b68c-11da05b87698 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:26.708369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecd5fbe8-3d67-41d6-b68c-11da05b87698 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:26.708861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecd5fbe8-3d67-41d6-b68c-11da05b87698 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:26.709476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecd5fbe8-3d67-41d6-b68c-11da05b87698 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:26.709931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecd5fbe8-3d67-41d6-b68c-11da05b87698 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:26.710348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecd5fbe8-3d67-41d6-b68c-11da05b87698 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:26.771633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ecd5fbe8-3d67-41d6-b68c-11da05b87698 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:26.779719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ecd5fbe8-3d67-41d6-b68c-11da05b87698 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082610 Sep 02 09:59:26.780279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 803/1527] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:26 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:27.621820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2c58be0c-6d1f-446d-9f6b-44e7d9809ce0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:27.622435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2c58be0c-6d1f-446d-9f6b-44e7d9809ce0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:27.628973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c58be0c-6d1f-446d-9f6b-44e7d9809ce0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:27.629450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c58be0c-6d1f-446d-9f6b-44e7d9809ce0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:27.629883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c58be0c-6d1f-446d-9f6b-44e7d9809ce0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:27.630562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c58be0c-6d1f-446d-9f6b-44e7d9809ce0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:27.631035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c58be0c-6d1f-446d-9f6b-44e7d9809ce0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:27.631468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c58be0c-6d1f-446d-9f6b-44e7d9809ce0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:27.761555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2c58be0c-6d1f-446d-9f6b-44e7d9809ce0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:27.769610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2c58be0c-6d1f-446d-9f6b-44e7d9809ce0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151660 Sep 02 09:59:27.770169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 725/1528] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:27 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:27.800697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f3340a44-bdf0-45ff-a64b-65df5d9d612f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:27.801316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f3340a44-bdf0-45ff-a64b-65df5d9d612f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:27.808245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3340a44-bdf0-45ff-a64b-65df5d9d612f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:27.808730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3340a44-bdf0-45ff-a64b-65df5d9d612f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:27.809166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3340a44-bdf0-45ff-a64b-65df5d9d612f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:27.809855 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3340a44-bdf0-45ff-a64b-65df5d9d612f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:27.810309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3340a44-bdf0-45ff-a64b-65df5d9d612f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:27.810759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3340a44-bdf0-45ff-a64b-65df5d9d612f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:27.873687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f3340a44-bdf0-45ff-a64b-65df5d9d612f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:27.882043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f3340a44-bdf0-45ff-a64b-65df5d9d612f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085026 Sep 02 09:59:27.882601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 804/1529] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:27 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:28.790283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d86a9781-f127-4a87-8836-97fcb2280a9e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:28.790931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d86a9781-f127-4a87-8836-97fcb2280a9e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:28.797556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d86a9781-f127-4a87-8836-97fcb2280a9e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:28.798042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d86a9781-f127-4a87-8836-97fcb2280a9e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:28.798483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d86a9781-f127-4a87-8836-97fcb2280a9e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:28.799202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d86a9781-f127-4a87-8836-97fcb2280a9e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:28.799682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d86a9781-f127-4a87-8836-97fcb2280a9e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:28.800113 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d86a9781-f127-4a87-8836-97fcb2280a9e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:28.903079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5a3d72e2-95eb-49c7-a805-93153a5cdbb4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:28.909264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5a3d72e2-95eb-49c7-a805-93153a5cdbb4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:28.910739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a3d72e2-95eb-49c7-a805-93153a5cdbb4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:28.911235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a3d72e2-95eb-49c7-a805-93153a5cdbb4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:28.911674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a3d72e2-95eb-49c7-a805-93153a5cdbb4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:28.912375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a3d72e2-95eb-49c7-a805-93153a5cdbb4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:28.912831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a3d72e2-95eb-49c7-a805-93153a5cdbb4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:28.913261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a3d72e2-95eb-49c7-a805-93153a5cdbb4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:28.931986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d86a9781-f127-4a87-8836-97fcb2280a9e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:28.940665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d86a9781-f127-4a87-8836-97fcb2280a9e tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154263 Sep 02 09:59:28.941238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 726/1530] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:28 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:28.978056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5a3d72e2-95eb-49c7-a805-93153a5cdbb4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:28.986773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5a3d72e2-95eb-49c7-a805-93153a5cdbb4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087703 Sep 02 09:59:28.987375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 805/1531] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:28 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:29.961472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c3de6beb-fb04-4d1c-a364-d48f1ced2f37 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:29.962086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c3de6beb-fb04-4d1c-a364-d48f1ced2f37 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:29.969054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3de6beb-fb04-4d1c-a364-d48f1ced2f37 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:29.969540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3de6beb-fb04-4d1c-a364-d48f1ced2f37 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:29.970001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3de6beb-fb04-4d1c-a364-d48f1ced2f37 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:29.970689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3de6beb-fb04-4d1c-a364-d48f1ced2f37 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:29.971166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3de6beb-fb04-4d1c-a364-d48f1ced2f37 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:29.971594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c3de6beb-fb04-4d1c-a364-d48f1ced2f37 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:30.008167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-92c92b9f-88ac-4447-ac30-3ccad5151d83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:30.008780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-92c92b9f-88ac-4447-ac30-3ccad5151d83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:30.015588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92c92b9f-88ac-4447-ac30-3ccad5151d83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:30.016113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92c92b9f-88ac-4447-ac30-3ccad5151d83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:30.016553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92c92b9f-88ac-4447-ac30-3ccad5151d83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:30.017247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92c92b9f-88ac-4447-ac30-3ccad5151d83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:30.017706 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92c92b9f-88ac-4447-ac30-3ccad5151d83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:30.018132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92c92b9f-88ac-4447-ac30-3ccad5151d83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:30.082373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-92c92b9f-88ac-4447-ac30-3ccad5151d83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:30.091036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-92c92b9f-88ac-4447-ac30-3ccad5151d83 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086869 Sep 02 09:59:30.091889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 806/1532] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:30 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:30.102627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c3de6beb-fb04-4d1c-a364-d48f1ced2f37 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:30.111447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c3de6beb-fb04-4d1c-a364-d48f1ced2f37 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153838 Sep 02 09:59:30.112008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 727/1533] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:29 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:31.111659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-62449797-6d7e-4617-b0e5-754034e8a242 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:31.112288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-62449797-6d7e-4617-b0e5-754034e8a242 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:31.118903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62449797-6d7e-4617-b0e5-754034e8a242 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:31.119383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62449797-6d7e-4617-b0e5-754034e8a242 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:31.119813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62449797-6d7e-4617-b0e5-754034e8a242 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:31.121150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62449797-6d7e-4617-b0e5-754034e8a242 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:31.121595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62449797-6d7e-4617-b0e5-754034e8a242 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:31.122017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62449797-6d7e-4617-b0e5-754034e8a242 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:31.132360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-86dc4df3-567b-46d1-80c4-8f353e1a3fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:31.132979 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-86dc4df3-567b-46d1-80c4-8f353e1a3fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:31.139539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86dc4df3-567b-46d1-80c4-8f353e1a3fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:31.140029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86dc4df3-567b-46d1-80c4-8f353e1a3fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:31.140471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86dc4df3-567b-46d1-80c4-8f353e1a3fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:31.141172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86dc4df3-567b-46d1-80c4-8f353e1a3fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:31.141635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86dc4df3-567b-46d1-80c4-8f353e1a3fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:31.142058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86dc4df3-567b-46d1-80c4-8f353e1a3fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:31.184450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-62449797-6d7e-4617-b0e5-754034e8a242 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:31.192730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-62449797-6d7e-4617-b0e5-754034e8a242 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085127 Sep 02 09:59:31.193301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 807/1534] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:31 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:31.270808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-86dc4df3-567b-46d1-80c4-8f353e1a3fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:31.278902 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-86dc4df3-567b-46d1-80c4-8f353e1a3fa1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150589 Sep 02 09:59:31.279466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 728/1535] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:31 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:32.215714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9a90172d-56c6-4a9e-a999-0e898f7d182d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:32.216274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9a90172d-56c6-4a9e-a999-0e898f7d182d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:32.222673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a90172d-56c6-4a9e-a999-0e898f7d182d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:32.223178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a90172d-56c6-4a9e-a999-0e898f7d182d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:32.223607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a90172d-56c6-4a9e-a999-0e898f7d182d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:32.224288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a90172d-56c6-4a9e-a999-0e898f7d182d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:32.224734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a90172d-56c6-4a9e-a999-0e898f7d182d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:32.225156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a90172d-56c6-4a9e-a999-0e898f7d182d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:32.289215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9a90172d-56c6-4a9e-a999-0e898f7d182d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:32.297874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9a90172d-56c6-4a9e-a999-0e898f7d182d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086894 Sep 02 09:59:32.298431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 808/1536] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:32 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:32.300325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9140ed67-0d55-4f19-b74a-92ccfa34cc56 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:32.300945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9140ed67-0d55-4f19-b74a-92ccfa34cc56 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:32.307080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9140ed67-0d55-4f19-b74a-92ccfa34cc56 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:32.307563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9140ed67-0d55-4f19-b74a-92ccfa34cc56 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:32.307999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9140ed67-0d55-4f19-b74a-92ccfa34cc56 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:32.308688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9140ed67-0d55-4f19-b74a-92ccfa34cc56 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:32.309141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9140ed67-0d55-4f19-b74a-92ccfa34cc56 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:32.309567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9140ed67-0d55-4f19-b74a-92ccfa34cc56 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:32.435598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9140ed67-0d55-4f19-b74a-92ccfa34cc56 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:32.443753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9140ed67-0d55-4f19-b74a-92ccfa34cc56 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147398 Sep 02 09:59:32.444398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 729/1537] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:32 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:33.318403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-aecc58ea-e70d-44eb-90c9-8c2b7de6a8f8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:33.318971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-aecc58ea-e70d-44eb-90c9-8c2b7de6a8f8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:33.326333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aecc58ea-e70d-44eb-90c9-8c2b7de6a8f8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:33.326848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aecc58ea-e70d-44eb-90c9-8c2b7de6a8f8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:33.327290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aecc58ea-e70d-44eb-90c9-8c2b7de6a8f8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:33.327986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aecc58ea-e70d-44eb-90c9-8c2b7de6a8f8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:33.328467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aecc58ea-e70d-44eb-90c9-8c2b7de6a8f8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:33.328898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aecc58ea-e70d-44eb-90c9-8c2b7de6a8f8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:33.389437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-aecc58ea-e70d-44eb-90c9-8c2b7de6a8f8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:33.397566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-aecc58ea-e70d-44eb-90c9-8c2b7de6a8f8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083183 Sep 02 09:59:33.398138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 809/1538] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:33 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:33.464428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-68dd75e6-426f-4bda-b04a-e5bd9d8c7b8c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:33.465025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-68dd75e6-426f-4bda-b04a-e5bd9d8c7b8c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:33.471379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68dd75e6-426f-4bda-b04a-e5bd9d8c7b8c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:33.471855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68dd75e6-426f-4bda-b04a-e5bd9d8c7b8c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:33.472286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68dd75e6-426f-4bda-b04a-e5bd9d8c7b8c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:33.472956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68dd75e6-426f-4bda-b04a-e5bd9d8c7b8c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:33.473399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68dd75e6-426f-4bda-b04a-e5bd9d8c7b8c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:33.473814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68dd75e6-426f-4bda-b04a-e5bd9d8c7b8c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:33.603771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-68dd75e6-426f-4bda-b04a-e5bd9d8c7b8c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:33.612437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-68dd75e6-426f-4bda-b04a-e5bd9d8c7b8c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151798 Sep 02 09:59:33.613028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 730/1539] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:33 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:34.418765 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a32ea887-4675-4b05-b0b1-46d7be02ad2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:34.419364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a32ea887-4675-4b05-b0b1-46d7be02ad2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:34.425782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a32ea887-4675-4b05-b0b1-46d7be02ad2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:34.426271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a32ea887-4675-4b05-b0b1-46d7be02ad2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:34.426729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a32ea887-4675-4b05-b0b1-46d7be02ad2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:34.427433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a32ea887-4675-4b05-b0b1-46d7be02ad2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:34.427886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a32ea887-4675-4b05-b0b1-46d7be02ad2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:34.428315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a32ea887-4675-4b05-b0b1-46d7be02ad2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:34.494010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a32ea887-4675-4b05-b0b1-46d7be02ad2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:34.502153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a32ea887-4675-4b05-b0b1-46d7be02ad2d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087955 Sep 02 09:59:34.502734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 810/1540] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:34 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:34.633767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c1783836-2470-4864-ad2c-118ae7e866f1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:34.634411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c1783836-2470-4864-ad2c-118ae7e866f1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:34.640840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1783836-2470-4864-ad2c-118ae7e866f1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:34.641320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1783836-2470-4864-ad2c-118ae7e866f1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:34.641756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1783836-2470-4864-ad2c-118ae7e866f1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:34.642436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1783836-2470-4864-ad2c-118ae7e866f1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:34.642919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1783836-2470-4864-ad2c-118ae7e866f1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:34.643344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1783836-2470-4864-ad2c-118ae7e866f1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:34.768000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c1783836-2470-4864-ad2c-118ae7e866f1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:34.776085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c1783836-2470-4864-ad2c-118ae7e866f1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146542 Sep 02 09:59:34.776648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 731/1541] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:34 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:35.522981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-27b9a36f-5266-4570-93a9-7a6e4631c644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:35.523584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-27b9a36f-5266-4570-93a9-7a6e4631c644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:35.529826 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27b9a36f-5266-4570-93a9-7a6e4631c644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:35.530303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27b9a36f-5266-4570-93a9-7a6e4631c644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:35.530747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27b9a36f-5266-4570-93a9-7a6e4631c644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:35.531431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27b9a36f-5266-4570-93a9-7a6e4631c644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:35.531881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27b9a36f-5266-4570-93a9-7a6e4631c644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:35.532300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27b9a36f-5266-4570-93a9-7a6e4631c644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:35.594772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-27b9a36f-5266-4570-93a9-7a6e4631c644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:35.603057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-27b9a36f-5266-4570-93a9-7a6e4631c644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083901 Sep 02 09:59:35.603618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 811/1542] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:35 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:35.797714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-39545964-5d4c-41a9-a858-a571e1b9769c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:35.798316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-39545964-5d4c-41a9-a858-a571e1b9769c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:35.804836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39545964-5d4c-41a9-a858-a571e1b9769c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:35.805310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39545964-5d4c-41a9-a858-a571e1b9769c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:35.805741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39545964-5d4c-41a9-a858-a571e1b9769c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:35.806442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39545964-5d4c-41a9-a858-a571e1b9769c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:35.806928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39545964-5d4c-41a9-a858-a571e1b9769c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:35.807346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39545964-5d4c-41a9-a858-a571e1b9769c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:35.938195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-39545964-5d4c-41a9-a858-a571e1b9769c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:35.946229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-39545964-5d4c-41a9-a858-a571e1b9769c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152867 Sep 02 09:59:35.946811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 732/1543] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:35 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:36.624253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-55ae2493-dfee-437a-bc59-dc974ac04e74 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:36.624896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-55ae2493-dfee-437a-bc59-dc974ac04e74 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:36.631324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55ae2493-dfee-437a-bc59-dc974ac04e74 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:36.632064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55ae2493-dfee-437a-bc59-dc974ac04e74 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:36.632506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55ae2493-dfee-437a-bc59-dc974ac04e74 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:36.633190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55ae2493-dfee-437a-bc59-dc974ac04e74 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:36.633646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55ae2493-dfee-437a-bc59-dc974ac04e74 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:36.634073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55ae2493-dfee-437a-bc59-dc974ac04e74 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:36.695366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-55ae2493-dfee-437a-bc59-dc974ac04e74 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:36.704132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-55ae2493-dfee-437a-bc59-dc974ac04e74 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083757 Sep 02 09:59:36.704698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 812/1544] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:36 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:36.967204 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-982f39cd-12fb-47be-b63f-fc737a35cb67 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:36.967729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-982f39cd-12fb-47be-b63f-fc737a35cb67 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:36.974094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-982f39cd-12fb-47be-b63f-fc737a35cb67 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:36.974570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-982f39cd-12fb-47be-b63f-fc737a35cb67 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:36.975032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-982f39cd-12fb-47be-b63f-fc737a35cb67 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:36.975736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-982f39cd-12fb-47be-b63f-fc737a35cb67 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:36.976182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-982f39cd-12fb-47be-b63f-fc737a35cb67 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:36.976597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-982f39cd-12fb-47be-b63f-fc737a35cb67 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:37.101814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-982f39cd-12fb-47be-b63f-fc737a35cb67 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:37.110504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-982f39cd-12fb-47be-b63f-fc737a35cb67 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147277 Sep 02 09:59:37.111087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 733/1545] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:36 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:37.724875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8256940c-b861-41fc-acd4-7a98c101abf2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:37.728834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8256940c-b861-41fc-acd4-7a98c101abf2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:37.732340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8256940c-b861-41fc-acd4-7a98c101abf2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:37.732822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8256940c-b861-41fc-acd4-7a98c101abf2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:37.733259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8256940c-b861-41fc-acd4-7a98c101abf2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:37.733944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8256940c-b861-41fc-acd4-7a98c101abf2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:37.734394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8256940c-b861-41fc-acd4-7a98c101abf2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:37.734847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8256940c-b861-41fc-acd4-7a98c101abf2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:37.795512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8256940c-b861-41fc-acd4-7a98c101abf2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:37.803596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8256940c-b861-41fc-acd4-7a98c101abf2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082799 Sep 02 09:59:37.804161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 813/1546] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:37 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:38.132380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dc2b0d03-cc41-4a8d-95c0-5894f3a3b322 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:38.132986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dc2b0d03-cc41-4a8d-95c0-5894f3a3b322 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:38.139934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc2b0d03-cc41-4a8d-95c0-5894f3a3b322 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:38.140412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc2b0d03-cc41-4a8d-95c0-5894f3a3b322 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:38.140844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc2b0d03-cc41-4a8d-95c0-5894f3a3b322 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:38.141519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc2b0d03-cc41-4a8d-95c0-5894f3a3b322 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:38.141968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc2b0d03-cc41-4a8d-95c0-5894f3a3b322 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:38.142387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc2b0d03-cc41-4a8d-95c0-5894f3a3b322 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:38.270258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dc2b0d03-cc41-4a8d-95c0-5894f3a3b322 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:38.278473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dc2b0d03-cc41-4a8d-95c0-5894f3a3b322 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150210 Sep 02 09:59:38.279057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 734/1547] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:38 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:38.824011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bd47a845-148f-4238-a125-03c238c888fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:38.824608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bd47a845-148f-4238-a125-03c238c888fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:38.831100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd47a845-148f-4238-a125-03c238c888fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:38.831584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd47a845-148f-4238-a125-03c238c888fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:38.832019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd47a845-148f-4238-a125-03c238c888fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:38.832703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd47a845-148f-4238-a125-03c238c888fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:38.833151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd47a845-148f-4238-a125-03c238c888fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:38.833574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd47a845-148f-4238-a125-03c238c888fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:38.898506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bd47a845-148f-4238-a125-03c238c888fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:38.900712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:38.907786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bd47a845-148f-4238-a125-03c238c888fc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087626 Sep 02 09:59:38.908350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 814/1548] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:38 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:39.299291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-80bbc6df-a0c0-45de-a4e4-2dc09ddef0dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:39.299901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-80bbc6df-a0c0-45de-a4e4-2dc09ddef0dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:39.306232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80bbc6df-a0c0-45de-a4e4-2dc09ddef0dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:39.306720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80bbc6df-a0c0-45de-a4e4-2dc09ddef0dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:39.307168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80bbc6df-a0c0-45de-a4e4-2dc09ddef0dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:39.307842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80bbc6df-a0c0-45de-a4e4-2dc09ddef0dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:39.308289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80bbc6df-a0c0-45de-a4e4-2dc09ddef0dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:39.308707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-80bbc6df-a0c0-45de-a4e4-2dc09ddef0dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:39.435772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-80bbc6df-a0c0-45de-a4e4-2dc09ddef0dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:39.443894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-80bbc6df-a0c0-45de-a4e4-2dc09ddef0dd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148410 Sep 02 09:59:39.444458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 735/1549] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:39 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:39.928651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e4ca31dd-ec29-4fa6-909f-30d97551364b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:39.929292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e4ca31dd-ec29-4fa6-909f-30d97551364b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:39.936594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ca31dd-ec29-4fa6-909f-30d97551364b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:39.937072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ca31dd-ec29-4fa6-909f-30d97551364b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:39.937506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ca31dd-ec29-4fa6-909f-30d97551364b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:39.938180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ca31dd-ec29-4fa6-909f-30d97551364b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:39.938628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ca31dd-ec29-4fa6-909f-30d97551364b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:39.939070 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4ca31dd-ec29-4fa6-909f-30d97551364b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:39.999110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e4ca31dd-ec29-4fa6-909f-30d97551364b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:40.007302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e4ca31dd-ec29-4fa6-909f-30d97551364b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082536 Sep 02 09:59:40.007863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 815/1550] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:39 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:40.465777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a4d678a1-1582-4b6a-b458-4a381c18eb88 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:40.466388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a4d678a1-1582-4b6a-b458-4a381c18eb88 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:40.472782 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4d678a1-1582-4b6a-b458-4a381c18eb88 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:40.473269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4d678a1-1582-4b6a-b458-4a381c18eb88 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:40.473695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4d678a1-1582-4b6a-b458-4a381c18eb88 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:40.474373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4d678a1-1582-4b6a-b458-4a381c18eb88 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:40.474923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4d678a1-1582-4b6a-b458-4a381c18eb88 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:40.475348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a4d678a1-1582-4b6a-b458-4a381c18eb88 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:40.599574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a4d678a1-1582-4b6a-b458-4a381c18eb88 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:40.608209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a4d678a1-1582-4b6a-b458-4a381c18eb88 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146902 Sep 02 09:59:40.608774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 736/1551] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:40 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:41.027744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-565a571c-2024-45c0-a301-accf5fd22310 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:41.028360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-565a571c-2024-45c0-a301-accf5fd22310 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:41.034861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565a571c-2024-45c0-a301-accf5fd22310 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:41.035345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565a571c-2024-45c0-a301-accf5fd22310 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:41.035782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565a571c-2024-45c0-a301-accf5fd22310 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:41.036465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565a571c-2024-45c0-a301-accf5fd22310 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:41.036919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565a571c-2024-45c0-a301-accf5fd22310 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:41.037346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-565a571c-2024-45c0-a301-accf5fd22310 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:41.098888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-565a571c-2024-45c0-a301-accf5fd22310 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:41.107612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-565a571c-2024-45c0-a301-accf5fd22310 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083713 Sep 02 09:59:41.108173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 816/1552] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:41 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:41.629552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cea1ae0c-2e3b-4ae1-9702-da7018c45899 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:41.630156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cea1ae0c-2e3b-4ae1-9702-da7018c45899 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:41.636760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cea1ae0c-2e3b-4ae1-9702-da7018c45899 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:41.637762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cea1ae0c-2e3b-4ae1-9702-da7018c45899 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:41.638193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cea1ae0c-2e3b-4ae1-9702-da7018c45899 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:41.638908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cea1ae0c-2e3b-4ae1-9702-da7018c45899 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:41.639360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cea1ae0c-2e3b-4ae1-9702-da7018c45899 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:41.639777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cea1ae0c-2e3b-4ae1-9702-da7018c45899 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:41.770284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cea1ae0c-2e3b-4ae1-9702-da7018c45899 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:41.778988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cea1ae0c-2e3b-4ae1-9702-da7018c45899 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153639 Sep 02 09:59:41.779543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 737/1553] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:41 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:42.128514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2c7435c0-fe11-4357-adcc-f44e419cee29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:42.129126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2c7435c0-fe11-4357-adcc-f44e419cee29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:42.131741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=56 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:42.136531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c7435c0-fe11-4357-adcc-f44e419cee29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:42.137042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c7435c0-fe11-4357-adcc-f44e419cee29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:42.138064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c7435c0-fe11-4357-adcc-f44e419cee29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:42.138774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c7435c0-fe11-4357-adcc-f44e419cee29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:42.139222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c7435c0-fe11-4357-adcc-f44e419cee29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:42.139666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c7435c0-fe11-4357-adcc-f44e419cee29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:42.202353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2c7435c0-fe11-4357-adcc-f44e419cee29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:42.210355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2c7435c0-fe11-4357-adcc-f44e419cee29 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085744 Sep 02 09:59:42.210949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 817/1554] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:42 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:42.799581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-66c96c8b-d1ce-4028-9e04-8a74c1357686 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:42.800182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-66c96c8b-d1ce-4028-9e04-8a74c1357686 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:42.806533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-66c96c8b-d1ce-4028-9e04-8a74c1357686 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:42.807040 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-66c96c8b-d1ce-4028-9e04-8a74c1357686 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:42.807473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-66c96c8b-d1ce-4028-9e04-8a74c1357686 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:42.808148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-66c96c8b-d1ce-4028-9e04-8a74c1357686 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:42.808715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-66c96c8b-d1ce-4028-9e04-8a74c1357686 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:42.809140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-66c96c8b-d1ce-4028-9e04-8a74c1357686 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:42.935185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-66c96c8b-d1ce-4028-9e04-8a74c1357686 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:42.943311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-66c96c8b-d1ce-4028-9e04-8a74c1357686 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147757 Sep 02 09:59:42.943881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 738/1555] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:42 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:43.230821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5c85075d-9e32-4de0-9e85-2e1bc378d039 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:43.231466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5c85075d-9e32-4de0-9e85-2e1bc378d039 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:43.237824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c85075d-9e32-4de0-9e85-2e1bc378d039 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:43.238305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c85075d-9e32-4de0-9e85-2e1bc378d039 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:43.238758 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c85075d-9e32-4de0-9e85-2e1bc378d039 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:43.239445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c85075d-9e32-4de0-9e85-2e1bc378d039 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:43.239897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c85075d-9e32-4de0-9e85-2e1bc378d039 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:43.240326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c85075d-9e32-4de0-9e85-2e1bc378d039 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:43.303376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5c85075d-9e32-4de0-9e85-2e1bc378d039 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:43.311443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5c85075d-9e32-4de0-9e85-2e1bc378d039 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084543 Sep 02 09:59:43.312014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 818/1556] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:43 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:43.964059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-163a9f9d-6662-493c-bb91-c8ae4f7c884b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:43.964660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-163a9f9d-6662-493c-bb91-c8ae4f7c884b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:43.971325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-163a9f9d-6662-493c-bb91-c8ae4f7c884b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:43.971805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-163a9f9d-6662-493c-bb91-c8ae4f7c884b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:43.972231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-163a9f9d-6662-493c-bb91-c8ae4f7c884b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:43.972908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-163a9f9d-6662-493c-bb91-c8ae4f7c884b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:43.973356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-163a9f9d-6662-493c-bb91-c8ae4f7c884b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:43.973770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-163a9f9d-6662-493c-bb91-c8ae4f7c884b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:44.101417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-163a9f9d-6662-493c-bb91-c8ae4f7c884b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:44.110228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-163a9f9d-6662-493c-bb91-c8ae4f7c884b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150065 Sep 02 09:59:44.110830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 739/1557] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:43 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:44.444174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e9041932-7b68-4769-9a07-20bb120a348f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:44.444784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e9041932-7b68-4769-9a07-20bb120a348f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:44.451178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9041932-7b68-4769-9a07-20bb120a348f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:44.451652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9041932-7b68-4769-9a07-20bb120a348f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:44.452083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9041932-7b68-4769-9a07-20bb120a348f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:44.452759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9041932-7b68-4769-9a07-20bb120a348f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:44.453205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9041932-7b68-4769-9a07-20bb120a348f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:44.453629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9041932-7b68-4769-9a07-20bb120a348f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:44.514106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e9041932-7b68-4769-9a07-20bb120a348f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:44.522140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e9041932-7b68-4769-9a07-20bb120a348f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.193948 Sep 02 09:59:44.522726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 819/1558] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:44 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:45.132186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c2821409-2168-47bb-be57-a674af8207c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:45.132719 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c2821409-2168-47bb-be57-a674af8207c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:45.139093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2821409-2168-47bb-be57-a674af8207c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:45.139573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2821409-2168-47bb-be57-a674af8207c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:45.140001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2821409-2168-47bb-be57-a674af8207c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:45.140942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2821409-2168-47bb-be57-a674af8207c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:45.141394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2821409-2168-47bb-be57-a674af8207c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:45.141813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2821409-2168-47bb-be57-a674af8207c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:45.145670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:45.269864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c2821409-2168-47bb-be57-a674af8207c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:45.278588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c2821409-2168-47bb-be57-a674af8207c2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149958 Sep 02 09:59:45.279184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 740/1559] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:45 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:45.543005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7e5d2bd6-6760-4d7a-8a53-24b44322c8e8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:45.543585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7e5d2bd6-6760-4d7a-8a53-24b44322c8e8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:45.549958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5d2bd6-6760-4d7a-8a53-24b44322c8e8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:45.550441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5d2bd6-6760-4d7a-8a53-24b44322c8e8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:45.550907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5d2bd6-6760-4d7a-8a53-24b44322c8e8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:45.551590 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5d2bd6-6760-4d7a-8a53-24b44322c8e8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:45.552042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5d2bd6-6760-4d7a-8a53-24b44322c8e8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:45.552465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5d2bd6-6760-4d7a-8a53-24b44322c8e8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:45.612726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7e5d2bd6-6760-4d7a-8a53-24b44322c8e8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:45.620719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7e5d2bd6-6760-4d7a-8a53-24b44322c8e8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081715 Sep 02 09:59:45.621292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 820/1560] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:45 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:46.299964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-535897ac-3aa4-4350-9732-aa463eefb370 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:46.300485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-535897ac-3aa4-4350-9732-aa463eefb370 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:46.306972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-535897ac-3aa4-4350-9732-aa463eefb370 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:46.307449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-535897ac-3aa4-4350-9732-aa463eefb370 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:46.307881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-535897ac-3aa4-4350-9732-aa463eefb370 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:46.308558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-535897ac-3aa4-4350-9732-aa463eefb370 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:46.309647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-535897ac-3aa4-4350-9732-aa463eefb370 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:46.310066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-535897ac-3aa4-4350-9732-aa463eefb370 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:46.437844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-535897ac-3aa4-4350-9732-aa463eefb370 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:46.445985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-535897ac-3aa4-4350-9732-aa463eefb370 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150020 Sep 02 09:59:46.446549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 741/1561] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:46 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:46.641603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a4a38fa9-5bef-4cc9-be62-c2b4888389d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:46.642218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a4a38fa9-5bef-4cc9-be62-c2b4888389d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:46.648764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4a38fa9-5bef-4cc9-be62-c2b4888389d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:46.649249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4a38fa9-5bef-4cc9-be62-c2b4888389d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:46.649704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4a38fa9-5bef-4cc9-be62-c2b4888389d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:46.650387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4a38fa9-5bef-4cc9-be62-c2b4888389d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:46.650905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4a38fa9-5bef-4cc9-be62-c2b4888389d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:46.651328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a4a38fa9-5bef-4cc9-be62-c2b4888389d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:46.711560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a4a38fa9-5bef-4cc9-be62-c2b4888389d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:46.719953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a4a38fa9-5bef-4cc9-be62-c2b4888389d7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082325 Sep 02 09:59:46.720508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 821/1562] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:46 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:47.466990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4e714442-9b35-484f-b0e5-480fc0f9a054 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:47.467628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4e714442-9b35-484f-b0e5-480fc0f9a054 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:47.469943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=52 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:47.474515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e714442-9b35-484f-b0e5-480fc0f9a054 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:47.475025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e714442-9b35-484f-b0e5-480fc0f9a054 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:47.475458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e714442-9b35-484f-b0e5-480fc0f9a054 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:47.476135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e714442-9b35-484f-b0e5-480fc0f9a054 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:47.476576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e714442-9b35-484f-b0e5-480fc0f9a054 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:47.477023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e714442-9b35-484f-b0e5-480fc0f9a054 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:47.604187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4e714442-9b35-484f-b0e5-480fc0f9a054 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:47.612772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4e714442-9b35-484f-b0e5-480fc0f9a054 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149638 Sep 02 09:59:47.613338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 742/1563] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:47 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:47.740361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bc5c326c-31b2-446b-9c13-b99d01f2a401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:47.740905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bc5c326c-31b2-446b-9c13-b99d01f2a401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:47.749743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc5c326c-31b2-446b-9c13-b99d01f2a401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:47.750223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc5c326c-31b2-446b-9c13-b99d01f2a401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:47.750655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc5c326c-31b2-446b-9c13-b99d01f2a401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:47.751365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc5c326c-31b2-446b-9c13-b99d01f2a401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:47.751815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc5c326c-31b2-446b-9c13-b99d01f2a401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:47.752233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bc5c326c-31b2-446b-9c13-b99d01f2a401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:47.816084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bc5c326c-31b2-446b-9c13-b99d01f2a401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:47.824186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bc5c326c-31b2-446b-9c13-b99d01f2a401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087786 Sep 02 09:59:47.824801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 822/1564] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:47 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:48.634945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d6e86d2e-fd53-4e47-ac63-7ec7f95c730d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:48.635536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d6e86d2e-fd53-4e47-ac63-7ec7f95c730d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:48.642498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6e86d2e-fd53-4e47-ac63-7ec7f95c730d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:48.642986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6e86d2e-fd53-4e47-ac63-7ec7f95c730d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:48.643413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6e86d2e-fd53-4e47-ac63-7ec7f95c730d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:48.644138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6e86d2e-fd53-4e47-ac63-7ec7f95c730d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:48.644582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6e86d2e-fd53-4e47-ac63-7ec7f95c730d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:48.644999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d6e86d2e-fd53-4e47-ac63-7ec7f95c730d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:48.769988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d6e86d2e-fd53-4e47-ac63-7ec7f95c730d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:48.778080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d6e86d2e-fd53-4e47-ac63-7ec7f95c730d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147337 Sep 02 09:59:48.778637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 743/1565] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:48 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:48.844700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-24304562-b1a4-4279-9d94-33258e0c6506 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:48.845705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-24304562-b1a4-4279-9d94-33258e0c6506 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:48.851756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24304562-b1a4-4279-9d94-33258e0c6506 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:48.852247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24304562-b1a4-4279-9d94-33258e0c6506 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:48.852688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24304562-b1a4-4279-9d94-33258e0c6506 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:48.853384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24304562-b1a4-4279-9d94-33258e0c6506 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:48.853847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24304562-b1a4-4279-9d94-33258e0c6506 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:48.854279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24304562-b1a4-4279-9d94-33258e0c6506 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:48.916832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-24304562-b1a4-4279-9d94-33258e0c6506 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:48.925127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-24304562-b1a4-4279-9d94-33258e0c6506 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084329 Sep 02 09:59:48.925698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 823/1566] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:48 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:49.799237 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-02530707-4a4a-44a2-8ed2-fc1df1560fc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:49.799847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-02530707-4a4a-44a2-8ed2-fc1df1560fc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:49.806273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02530707-4a4a-44a2-8ed2-fc1df1560fc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:49.807748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02530707-4a4a-44a2-8ed2-fc1df1560fc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:49.807748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02530707-4a4a-44a2-8ed2-fc1df1560fc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:49.808041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02530707-4a4a-44a2-8ed2-fc1df1560fc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:49.808388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02530707-4a4a-44a2-8ed2-fc1df1560fc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:49.809381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-02530707-4a4a-44a2-8ed2-fc1df1560fc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:49.942146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-02530707-4a4a-44a2-8ed2-fc1df1560fc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:49.945406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a68361d3-b75c-4311-bf13-da4e63e06222 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:49.946025 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a68361d3-b75c-4311-bf13-da4e63e06222 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:49.950549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-02530707-4a4a-44a2-8ed2-fc1df1560fc8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.155113 Sep 02 09:59:49.951146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 744/1567] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:49 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:49.952468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a68361d3-b75c-4311-bf13-da4e63e06222 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:49.952957 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a68361d3-b75c-4311-bf13-da4e63e06222 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:49.953395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a68361d3-b75c-4311-bf13-da4e63e06222 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:49.954091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a68361d3-b75c-4311-bf13-da4e63e06222 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:49.954543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a68361d3-b75c-4311-bf13-da4e63e06222 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:49.954997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a68361d3-b75c-4311-bf13-da4e63e06222 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:50.017986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a68361d3-b75c-4311-bf13-da4e63e06222 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:50.026077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a68361d3-b75c-4311-bf13-da4e63e06222 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084517 Sep 02 09:59:50.026645 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 824/1568] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:49 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:50.972225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ac0d0057-339c-4131-9239-086564c30b1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:50.972865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ac0d0057-339c-4131-9239-086564c30b1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:50.979385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac0d0057-339c-4131-9239-086564c30b1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:50.979868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac0d0057-339c-4131-9239-086564c30b1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:50.980312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac0d0057-339c-4131-9239-086564c30b1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:50.980993 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac0d0057-339c-4131-9239-086564c30b1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:50.981445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac0d0057-339c-4131-9239-086564c30b1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:50.981869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ac0d0057-339c-4131-9239-086564c30b1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:51.046511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9e7a0aa3-d7ea-4595-b4e0-1329ce1b95ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:51.047133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9e7a0aa3-d7ea-4595-b4e0-1329ce1b95ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:51.053275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e7a0aa3-d7ea-4595-b4e0-1329ce1b95ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:51.053762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e7a0aa3-d7ea-4595-b4e0-1329ce1b95ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:51.054198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e7a0aa3-d7ea-4595-b4e0-1329ce1b95ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:51.054927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e7a0aa3-d7ea-4595-b4e0-1329ce1b95ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:51.055379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e7a0aa3-d7ea-4595-b4e0-1329ce1b95ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:51.055803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9e7a0aa3-d7ea-4595-b4e0-1329ce1b95ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:51.110351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ac0d0057-339c-4131-9239-086564c30b1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:51.118983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ac0d0057-339c-4131-9239-086564c30b1c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150420 Sep 02 09:59:51.119936 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9e7a0aa3-d7ea-4595-b4e0-1329ce1b95ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:51.123354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 745/1569] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:50 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:51.128519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9e7a0aa3-d7ea-4595-b4e0-1329ce1b95ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085903 Sep 02 09:59:51.129071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 825/1570] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:51 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:52.140299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a84e947c-0746-41b5-8fd4-0251600bbc21 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:52.140903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a84e947c-0746-41b5-8fd4-0251600bbc21 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:52.147347 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84e947c-0746-41b5-8fd4-0251600bbc21 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:52.147827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84e947c-0746-41b5-8fd4-0251600bbc21 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:52.148252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84e947c-0746-41b5-8fd4-0251600bbc21 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:52.148934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84e947c-0746-41b5-8fd4-0251600bbc21 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:52.149176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8bed525f-2697-48e5-9456-490b85b2df05 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:52.149600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84e947c-0746-41b5-8fd4-0251600bbc21 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:52.149782 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84e947c-0746-41b5-8fd4-0251600bbc21 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:52.149890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8bed525f-2697-48e5-9456-490b85b2df05 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:52.156751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8bed525f-2697-48e5-9456-490b85b2df05 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:52.158104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8bed525f-2697-48e5-9456-490b85b2df05 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:52.158104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8bed525f-2697-48e5-9456-490b85b2df05 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:52.158332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8bed525f-2697-48e5-9456-490b85b2df05 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:52.158803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8bed525f-2697-48e5-9456-490b85b2df05 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:52.159227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8bed525f-2697-48e5-9456-490b85b2df05 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:52.226755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8bed525f-2697-48e5-9456-490b85b2df05 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:52.235449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8bed525f-2697-48e5-9456-490b85b2df05 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.089998 Sep 02 09:59:52.236027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 826/1571] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:52 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:52.283767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a84e947c-0746-41b5-8fd4-0251600bbc21 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:52.291881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a84e947c-0746-41b5-8fd4-0251600bbc21 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.155918 Sep 02 09:59:52.292445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 746/1572] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:52 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:53.255468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-48aed981-588b-4c1e-9783-d0917af4989d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:53.256347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-48aed981-588b-4c1e-9783-d0917af4989d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:53.263401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48aed981-588b-4c1e-9783-d0917af4989d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:53.263888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48aed981-588b-4c1e-9783-d0917af4989d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:53.264333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48aed981-588b-4c1e-9783-d0917af4989d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:53.265022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48aed981-588b-4c1e-9783-d0917af4989d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:53.265479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48aed981-588b-4c1e-9783-d0917af4989d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:53.265903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-48aed981-588b-4c1e-9783-d0917af4989d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:53.313275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0c97548c-a8f4-4e08-b72d-90aef1aeb745 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:53.317395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0c97548c-a8f4-4e08-b72d-90aef1aeb745 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:53.320332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c97548c-a8f4-4e08-b72d-90aef1aeb745 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:53.320815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c97548c-a8f4-4e08-b72d-90aef1aeb745 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:53.321245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c97548c-a8f4-4e08-b72d-90aef1aeb745 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:53.322052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c97548c-a8f4-4e08-b72d-90aef1aeb745 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:53.322501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c97548c-a8f4-4e08-b72d-90aef1aeb745 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:53.322950 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c97548c-a8f4-4e08-b72d-90aef1aeb745 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:53.326961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-48aed981-588b-4c1e-9783-d0917af4989d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:53.335154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-48aed981-588b-4c1e-9783-d0917af4989d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083652 Sep 02 09:59:53.335723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 827/1573] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:53 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:53.447263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0c97548c-a8f4-4e08-b72d-90aef1aeb745 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:53.456034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0c97548c-a8f4-4e08-b72d-90aef1aeb745 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147189 Sep 02 09:59:53.456589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 747/1574] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:53 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:54.355717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b1ecc550-4436-4f07-a34d-c315cedfe015 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:54.356319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b1ecc550-4436-4f07-a34d-c315cedfe015 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:54.362919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1ecc550-4436-4f07-a34d-c315cedfe015 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:54.363395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1ecc550-4436-4f07-a34d-c315cedfe015 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:54.363823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1ecc550-4436-4f07-a34d-c315cedfe015 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:54.364500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1ecc550-4436-4f07-a34d-c315cedfe015 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:54.364944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1ecc550-4436-4f07-a34d-c315cedfe015 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:54.365365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1ecc550-4436-4f07-a34d-c315cedfe015 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:54.425970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b1ecc550-4436-4f07-a34d-c315cedfe015 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:54.434673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b1ecc550-4436-4f07-a34d-c315cedfe015 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082311 Sep 02 09:59:54.435041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 828/1575] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:54 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:54.476685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-236ea5ca-7ea6-42b8-a3ec-25294e2a602f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:54.477303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-236ea5ca-7ea6-42b8-a3ec-25294e2a602f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:54.483703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-236ea5ca-7ea6-42b8-a3ec-25294e2a602f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:54.484185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-236ea5ca-7ea6-42b8-a3ec-25294e2a602f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:54.484623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-236ea5ca-7ea6-42b8-a3ec-25294e2a602f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:54.485310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-236ea5ca-7ea6-42b8-a3ec-25294e2a602f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:54.485764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-236ea5ca-7ea6-42b8-a3ec-25294e2a602f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:54.486189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-236ea5ca-7ea6-42b8-a3ec-25294e2a602f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:54.611565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-236ea5ca-7ea6-42b8-a3ec-25294e2a602f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:54.619766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-236ea5ca-7ea6-42b8-a3ec-25294e2a602f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146917 Sep 02 09:59:54.620336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 748/1576] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:54 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:55.454967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-305cc270-b8c3-4f6f-b03d-ed8cf6003d6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:55.455617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-305cc270-b8c3-4f6f-b03d-ed8cf6003d6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:55.462021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-305cc270-b8c3-4f6f-b03d-ed8cf6003d6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:55.463529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-305cc270-b8c3-4f6f-b03d-ed8cf6003d6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:55.463529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-305cc270-b8c3-4f6f-b03d-ed8cf6003d6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:55.463763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-305cc270-b8c3-4f6f-b03d-ed8cf6003d6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:55.464063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-305cc270-b8c3-4f6f-b03d-ed8cf6003d6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:55.464486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-305cc270-b8c3-4f6f-b03d-ed8cf6003d6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:55.524785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-305cc270-b8c3-4f6f-b03d-ed8cf6003d6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:55.533405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-305cc270-b8c3-4f6f-b03d-ed8cf6003d6b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082377 Sep 02 09:59:55.533972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 829/1577] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:55 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:55.641069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-63e69bd9-e398-4486-923e-3e84c21fdec9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:55.641674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-63e69bd9-e398-4486-923e-3e84c21fdec9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:55.648110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63e69bd9-e398-4486-923e-3e84c21fdec9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:55.648586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63e69bd9-e398-4486-923e-3e84c21fdec9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:55.649014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63e69bd9-e398-4486-923e-3e84c21fdec9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:55.649688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63e69bd9-e398-4486-923e-3e84c21fdec9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:55.650134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63e69bd9-e398-4486-923e-3e84c21fdec9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:55.650555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-63e69bd9-e398-4486-923e-3e84c21fdec9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:55.782063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-63e69bd9-e398-4486-923e-3e84c21fdec9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:55.790150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-63e69bd9-e398-4486-923e-3e84c21fdec9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152914 Sep 02 09:59:55.790724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 749/1578] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:55 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:56.554536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-694481d8-e890-411c-82e0-1673bb97dd5e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:56.555204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-694481d8-e890-411c-82e0-1673bb97dd5e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:56.561633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-694481d8-e890-411c-82e0-1673bb97dd5e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:56.562123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-694481d8-e890-411c-82e0-1673bb97dd5e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:56.562560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-694481d8-e890-411c-82e0-1673bb97dd5e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:56.563270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-694481d8-e890-411c-82e0-1673bb97dd5e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:56.563725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-694481d8-e890-411c-82e0-1673bb97dd5e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:56.564149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-694481d8-e890-411c-82e0-1673bb97dd5e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:56.629248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-694481d8-e890-411c-82e0-1673bb97dd5e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:56.638062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-694481d8-e890-411c-82e0-1673bb97dd5e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087425 Sep 02 09:59:56.638622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 830/1579] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:56 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:56.811206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cdb3fdae-3d26-46c6-bc1a-f1ad35f4482c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:56.811747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cdb3fdae-3d26-46c6-bc1a-f1ad35f4482c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:56.817901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cdb3fdae-3d26-46c6-bc1a-f1ad35f4482c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:56.818377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cdb3fdae-3d26-46c6-bc1a-f1ad35f4482c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:56.818830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cdb3fdae-3d26-46c6-bc1a-f1ad35f4482c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:56.819505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cdb3fdae-3d26-46c6-bc1a-f1ad35f4482c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:56.819968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cdb3fdae-3d26-46c6-bc1a-f1ad35f4482c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:56.820385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cdb3fdae-3d26-46c6-bc1a-f1ad35f4482c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:56.949742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cdb3fdae-3d26-46c6-bc1a-f1ad35f4482c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:56.957946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cdb3fdae-3d26-46c6-bc1a-f1ad35f4482c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150645 Sep 02 09:59:56.958503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 750/1580] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:56 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:57.659142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5ea49c36-a799-4701-ba47-9aedc5648eae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:57.659750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5ea49c36-a799-4701-ba47-9aedc5648eae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:57.666051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ea49c36-a799-4701-ba47-9aedc5648eae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:57.666531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ea49c36-a799-4701-ba47-9aedc5648eae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:57.667040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ea49c36-a799-4701-ba47-9aedc5648eae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:57.667702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ea49c36-a799-4701-ba47-9aedc5648eae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:57.668814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ea49c36-a799-4701-ba47-9aedc5648eae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:57.669235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ea49c36-a799-4701-ba47-9aedc5648eae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:57.683630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 09:59:57.728873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ea49c36-a799-4701-ba47-9aedc5648eae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:57.737422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5ea49c36-a799-4701-ba47-9aedc5648eae tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082331 Sep 02 09:59:57.737974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 831/1581] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:57 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:57.978811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7daefc81-da65-44ef-a179-e564858ddb8a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:57.979347 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7daefc81-da65-44ef-a179-e564858ddb8a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:57.986353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daefc81-da65-44ef-a179-e564858ddb8a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:57.986862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daefc81-da65-44ef-a179-e564858ddb8a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:57.987296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daefc81-da65-44ef-a179-e564858ddb8a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:57.987971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daefc81-da65-44ef-a179-e564858ddb8a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:57.988416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daefc81-da65-44ef-a179-e564858ddb8a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:57.988835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7daefc81-da65-44ef-a179-e564858ddb8a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:58.117063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7daefc81-da65-44ef-a179-e564858ddb8a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:58.126317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7daefc81-da65-44ef-a179-e564858ddb8a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151480 Sep 02 09:59:58.126926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 751/1582] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:57 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 09:59:58.757535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7f168975-dc9f-49a1-b282-5552f92410ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:58.758153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7f168975-dc9f-49a1-b282-5552f92410ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:58.765180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f168975-dc9f-49a1-b282-5552f92410ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:58.765666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f168975-dc9f-49a1-b282-5552f92410ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:58.766109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f168975-dc9f-49a1-b282-5552f92410ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:58.766827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f168975-dc9f-49a1-b282-5552f92410ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:58.767287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f168975-dc9f-49a1-b282-5552f92410ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:58.767716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7f168975-dc9f-49a1-b282-5552f92410ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:58.830512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7f168975-dc9f-49a1-b282-5552f92410ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:58.838610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7f168975-dc9f-49a1-b282-5552f92410ff tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085259 Sep 02 09:59:58.839212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 832/1583] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:58 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:59.148123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8ebe9255-863b-4cf6-8041-b38f14046f79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:59.148728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8ebe9255-863b-4cf6-8041-b38f14046f79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:59.155698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ebe9255-863b-4cf6-8041-b38f14046f79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:59.156176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ebe9255-863b-4cf6-8041-b38f14046f79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:59.156603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ebe9255-863b-4cf6-8041-b38f14046f79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:59.157275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ebe9255-863b-4cf6-8041-b38f14046f79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:59.157720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ebe9255-863b-4cf6-8041-b38f14046f79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:59.158135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ebe9255-863b-4cf6-8041-b38f14046f79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:59.283177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ebe9255-863b-4cf6-8041-b38f14046f79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:59.291259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8ebe9255-863b-4cf6-8041-b38f14046f79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146990 Sep 02 09:59:59.291824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 752/1584] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:59 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 09:59:59.859493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-18d469db-f6e2-473a-ba28-7bf400714a48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 09:59:59.860105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-18d469db-f6e2-473a-ba28-7bf400714a48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 09:59:59.866447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18d469db-f6e2-473a-ba28-7bf400714a48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:59.866961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18d469db-f6e2-473a-ba28-7bf400714a48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:59.867395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18d469db-f6e2-473a-ba28-7bf400714a48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:59.868072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18d469db-f6e2-473a-ba28-7bf400714a48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 09:59:59.868519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18d469db-f6e2-473a-ba28-7bf400714a48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 09:59:59.868939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18d469db-f6e2-473a-ba28-7bf400714a48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 09:59:59.930400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-18d469db-f6e2-473a-ba28-7bf400714a48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 09:59:59.938774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-18d469db-f6e2-473a-ba28-7bf400714a48 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083600 Sep 02 09:59:59.939360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 833/1585] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 09:59:59 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:00.320328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3dec724f-8321-4581-b942-e2454b20b3bd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:00.320328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3dec724f-8321-4581-b942-e2454b20b3bd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:00.320328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dec724f-8321-4581-b942-e2454b20b3bd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:00.320328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dec724f-8321-4581-b942-e2454b20b3bd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:00.321288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dec724f-8321-4581-b942-e2454b20b3bd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:00.321288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dec724f-8321-4581-b942-e2454b20b3bd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:00.321733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dec724f-8321-4581-b942-e2454b20b3bd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:00.322150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3dec724f-8321-4581-b942-e2454b20b3bd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:00.446514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3dec724f-8321-4581-b942-e2454b20b3bd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:00.455195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3dec724f-8321-4581-b942-e2454b20b3bd tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146520 Sep 02 10:00:00.459916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 753/1586] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:00 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:00.959564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4991a2a4-9207-4b5e-8544-82f22caf1abd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:00.960152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4991a2a4-9207-4b5e-8544-82f22caf1abd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:00.966476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4991a2a4-9207-4b5e-8544-82f22caf1abd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:00.966988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4991a2a4-9207-4b5e-8544-82f22caf1abd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:00.967429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4991a2a4-9207-4b5e-8544-82f22caf1abd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:00.968108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4991a2a4-9207-4b5e-8544-82f22caf1abd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:00.968555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4991a2a4-9207-4b5e-8544-82f22caf1abd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:00.968976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4991a2a4-9207-4b5e-8544-82f22caf1abd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:01.032338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4991a2a4-9207-4b5e-8544-82f22caf1abd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:01.040476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4991a2a4-9207-4b5e-8544-82f22caf1abd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084788 Sep 02 10:00:01.041040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 834/1587] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:00 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:01.477172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8d334997-2452-4915-b433-159637bdcbf4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:01.477787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8d334997-2452-4915-b433-159637bdcbf4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:01.484892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d334997-2452-4915-b433-159637bdcbf4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:01.485380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d334997-2452-4915-b433-159637bdcbf4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:01.485816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d334997-2452-4915-b433-159637bdcbf4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:01.486500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d334997-2452-4915-b433-159637bdcbf4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:01.486983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d334997-2452-4915-b433-159637bdcbf4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:01.487413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d334997-2452-4915-b433-159637bdcbf4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:01.617454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8d334997-2452-4915-b433-159637bdcbf4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:01.625596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8d334997-2452-4915-b433-159637bdcbf4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152326 Sep 02 10:00:01.626156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 754/1588] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:01 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:02.062159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-40a09d90-c79f-448a-a2fe-ab8b84ab4c36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:02.062815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-40a09d90-c79f-448a-a2fe-ab8b84ab4c36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:02.069296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40a09d90-c79f-448a-a2fe-ab8b84ab4c36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:02.069785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40a09d90-c79f-448a-a2fe-ab8b84ab4c36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:02.070226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40a09d90-c79f-448a-a2fe-ab8b84ab4c36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:02.070958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40a09d90-c79f-448a-a2fe-ab8b84ab4c36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:02.071456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40a09d90-c79f-448a-a2fe-ab8b84ab4c36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:02.071888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40a09d90-c79f-448a-a2fe-ab8b84ab4c36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:02.144950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-40a09d90-c79f-448a-a2fe-ab8b84ab4c36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:02.153674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-40a09d90-c79f-448a-a2fe-ab8b84ab4c36 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.096025 Sep 02 10:00:02.154250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 835/1589] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:02 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:02.646800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-28b33062-3f2e-45bf-9304-8eb68ec6b2f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:02.647393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-28b33062-3f2e-45bf-9304-8eb68ec6b2f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:02.654359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28b33062-3f2e-45bf-9304-8eb68ec6b2f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:02.654869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28b33062-3f2e-45bf-9304-8eb68ec6b2f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:02.655310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28b33062-3f2e-45bf-9304-8eb68ec6b2f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:02.655990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28b33062-3f2e-45bf-9304-8eb68ec6b2f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:02.656439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28b33062-3f2e-45bf-9304-8eb68ec6b2f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:02.656861 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28b33062-3f2e-45bf-9304-8eb68ec6b2f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:02.780689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-28b33062-3f2e-45bf-9304-8eb68ec6b2f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:02.788764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-28b33062-3f2e-45bf-9304-8eb68ec6b2f3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.145832 Sep 02 10:00:02.789327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 755/1590] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:02 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:03.174130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0149c924-215d-48e3-a9f5-a08fae47f005 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:03.174755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0149c924-215d-48e3-a9f5-a08fae47f005 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:03.180868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0149c924-215d-48e3-a9f5-a08fae47f005 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:03.181345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0149c924-215d-48e3-a9f5-a08fae47f005 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:03.181777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0149c924-215d-48e3-a9f5-a08fae47f005 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:03.182455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0149c924-215d-48e3-a9f5-a08fae47f005 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:03.182932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0149c924-215d-48e3-a9f5-a08fae47f005 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:03.183848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0149c924-215d-48e3-a9f5-a08fae47f005 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:03.245091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0149c924-215d-48e3-a9f5-a08fae47f005 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:03.253508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0149c924-215d-48e3-a9f5-a08fae47f005 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083206 Sep 02 10:00:03.254064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 836/1591] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:03 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:03.809527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-996033bd-6223-427a-b503-e3fc1f48e81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:03.810121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-996033bd-6223-427a-b503-e3fc1f48e81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:03.816580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996033bd-6223-427a-b503-e3fc1f48e81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:03.817054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996033bd-6223-427a-b503-e3fc1f48e81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:03.817487 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996033bd-6223-427a-b503-e3fc1f48e81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:03.818161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996033bd-6223-427a-b503-e3fc1f48e81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:03.818606 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996033bd-6223-427a-b503-e3fc1f48e81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:03.819046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996033bd-6223-427a-b503-e3fc1f48e81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:03.949317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-996033bd-6223-427a-b503-e3fc1f48e81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:03.951492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:03.957960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-996033bd-6223-427a-b503-e3fc1f48e81b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152322 Sep 02 10:00:03.958525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 756/1592] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:03 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:04.274872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4d61a2f6-0004-444e-b8ee-c6fdd2f08630 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:04.275487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4d61a2f6-0004-444e-b8ee-c6fdd2f08630 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:04.282526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d61a2f6-0004-444e-b8ee-c6fdd2f08630 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:04.283052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d61a2f6-0004-444e-b8ee-c6fdd2f08630 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:04.283492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d61a2f6-0004-444e-b8ee-c6fdd2f08630 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:04.284183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d61a2f6-0004-444e-b8ee-c6fdd2f08630 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:04.284654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d61a2f6-0004-444e-b8ee-c6fdd2f08630 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:04.285066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d61a2f6-0004-444e-b8ee-c6fdd2f08630 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:04.347926 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4d61a2f6-0004-444e-b8ee-c6fdd2f08630 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:04.356214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4d61a2f6-0004-444e-b8ee-c6fdd2f08630 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085271 Sep 02 10:00:04.356796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 837/1593] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:04 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:04.986544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b6910f37-c5bf-4ba5-9471-5c6225e01038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:04.987231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b6910f37-c5bf-4ba5-9471-5c6225e01038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:04.993673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6910f37-c5bf-4ba5-9471-5c6225e01038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:04.994139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6910f37-c5bf-4ba5-9471-5c6225e01038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:04.994564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6910f37-c5bf-4ba5-9471-5c6225e01038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:04.995263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6910f37-c5bf-4ba5-9471-5c6225e01038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:04.996356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6910f37-c5bf-4ba5-9471-5c6225e01038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:04.996778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6910f37-c5bf-4ba5-9471-5c6225e01038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:05.125730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b6910f37-c5bf-4ba5-9471-5c6225e01038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:05.134194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b6910f37-c5bf-4ba5-9471-5c6225e01038 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151860 Sep 02 10:00:05.134773 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 757/1594] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:04 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:05.377309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9c0d7fb1-88fb-458c-9cce-d322f0f331ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:05.377925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9c0d7fb1-88fb-458c-9cce-d322f0f331ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:05.384850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c0d7fb1-88fb-458c-9cce-d322f0f331ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:05.385337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c0d7fb1-88fb-458c-9cce-d322f0f331ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:05.385776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c0d7fb1-88fb-458c-9cce-d322f0f331ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:05.386462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c0d7fb1-88fb-458c-9cce-d322f0f331ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:05.386951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c0d7fb1-88fb-458c-9cce-d322f0f331ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:05.387459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c0d7fb1-88fb-458c-9cce-d322f0f331ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:05.448067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9c0d7fb1-88fb-458c-9cce-d322f0f331ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:05.456283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9c0d7fb1-88fb-458c-9cce-d322f0f331ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082954 Sep 02 10:00:05.456847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 838/1595] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:05 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:06.156185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8fb484e0-a163-4cd5-952c-6dc213624ac5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:06.156706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8fb484e0-a163-4cd5-952c-6dc213624ac5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:06.163186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fb484e0-a163-4cd5-952c-6dc213624ac5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:06.163663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fb484e0-a163-4cd5-952c-6dc213624ac5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:06.164093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fb484e0-a163-4cd5-952c-6dc213624ac5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:06.164766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fb484e0-a163-4cd5-952c-6dc213624ac5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:06.165212 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fb484e0-a163-4cd5-952c-6dc213624ac5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:06.165629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fb484e0-a163-4cd5-952c-6dc213624ac5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:06.295031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8fb484e0-a163-4cd5-952c-6dc213624ac5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:06.303159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8fb484e0-a163-4cd5-952c-6dc213624ac5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151578 Sep 02 10:00:06.303722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 758/1596] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:06 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:06.477698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a23de5d8-7699-4882-8428-7b8d133638d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:06.478241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a23de5d8-7699-4882-8428-7b8d133638d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:06.484684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a23de5d8-7699-4882-8428-7b8d133638d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:06.485175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a23de5d8-7699-4882-8428-7b8d133638d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:06.485612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a23de5d8-7699-4882-8428-7b8d133638d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:06.486298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a23de5d8-7699-4882-8428-7b8d133638d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:06.486775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a23de5d8-7699-4882-8428-7b8d133638d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:06.487210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a23de5d8-7699-4882-8428-7b8d133638d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:06.547427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a23de5d8-7699-4882-8428-7b8d133638d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:06.555495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a23de5d8-7699-4882-8428-7b8d133638d4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081711 Sep 02 10:00:06.556069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 839/1597] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:06 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:07.323652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8247b324-f0fd-4cf8-929e-ae22b5a13e08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:07.324258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8247b324-f0fd-4cf8-929e-ae22b5a13e08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:07.330596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8247b324-f0fd-4cf8-929e-ae22b5a13e08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:07.331098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8247b324-f0fd-4cf8-929e-ae22b5a13e08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:07.331527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8247b324-f0fd-4cf8-929e-ae22b5a13e08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:07.332199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8247b324-f0fd-4cf8-929e-ae22b5a13e08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:07.332645 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8247b324-f0fd-4cf8-929e-ae22b5a13e08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:07.333063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8247b324-f0fd-4cf8-929e-ae22b5a13e08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:07.456969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8247b324-f0fd-4cf8-929e-ae22b5a13e08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:07.465475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8247b324-f0fd-4cf8-929e-ae22b5a13e08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.145645 Sep 02 10:00:07.466032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 759/1598] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:07 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:07.577142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c897209e-a702-499b-8c8f-5eaf5d4d539a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:07.578127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c897209e-a702-499b-8c8f-5eaf5d4d539a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:07.585519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c897209e-a702-499b-8c8f-5eaf5d4d539a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:07.586034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c897209e-a702-499b-8c8f-5eaf5d4d539a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:07.586463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c897209e-a702-499b-8c8f-5eaf5d4d539a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:07.587190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c897209e-a702-499b-8c8f-5eaf5d4d539a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:07.587648 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c897209e-a702-499b-8c8f-5eaf5d4d539a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:07.588077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c897209e-a702-499b-8c8f-5eaf5d4d539a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:07.648680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c897209e-a702-499b-8c8f-5eaf5d4d539a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:07.657326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c897209e-a702-499b-8c8f-5eaf5d4d539a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084798 Sep 02 10:00:07.657903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 840/1599] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:07 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:08.485784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e8164a7d-daa2-4e93-ab0d-4ae1bc45b191 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:08.486420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e8164a7d-daa2-4e93-ab0d-4ae1bc45b191 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:08.492850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8164a7d-daa2-4e93-ab0d-4ae1bc45b191 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:08.493327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8164a7d-daa2-4e93-ab0d-4ae1bc45b191 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:08.493759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8164a7d-daa2-4e93-ab0d-4ae1bc45b191 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:08.494438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8164a7d-daa2-4e93-ab0d-4ae1bc45b191 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:08.494911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8164a7d-daa2-4e93-ab0d-4ae1bc45b191 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:08.495332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8164a7d-daa2-4e93-ab0d-4ae1bc45b191 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:08.620324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e8164a7d-daa2-4e93-ab0d-4ae1bc45b191 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:08.629089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e8164a7d-daa2-4e93-ab0d-4ae1bc45b191 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147313 Sep 02 10:00:08.629660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 760/1600] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:08 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:08.678617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-aa3bddc1-1ebe-4f54-a170-eab04782a42e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:08.679263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-aa3bddc1-1ebe-4f54-a170-eab04782a42e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:08.686385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa3bddc1-1ebe-4f54-a170-eab04782a42e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:08.686855 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa3bddc1-1ebe-4f54-a170-eab04782a42e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:08.687281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa3bddc1-1ebe-4f54-a170-eab04782a42e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:08.687968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa3bddc1-1ebe-4f54-a170-eab04782a42e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:08.688425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa3bddc1-1ebe-4f54-a170-eab04782a42e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:08.688851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aa3bddc1-1ebe-4f54-a170-eab04782a42e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:08.751494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-aa3bddc1-1ebe-4f54-a170-eab04782a42e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:08.759845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-aa3bddc1-1ebe-4f54-a170-eab04782a42e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085130 Sep 02 10:00:08.760407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 841/1601] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:08 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:09.650026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f4cb3c20-83e6-4750-9d5e-eb8571cacbd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:09.650643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f4cb3c20-83e6-4750-9d5e-eb8571cacbd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:09.657694 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb3c20-83e6-4750-9d5e-eb8571cacbd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:09.658174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb3c20-83e6-4750-9d5e-eb8571cacbd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:09.658607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb3c20-83e6-4750-9d5e-eb8571cacbd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:09.659329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb3c20-83e6-4750-9d5e-eb8571cacbd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:09.659780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb3c20-83e6-4750-9d5e-eb8571cacbd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:09.660201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f4cb3c20-83e6-4750-9d5e-eb8571cacbd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:09.780773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ccc1a350-2ff0-4689-b6a4-3ed98a288646 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:09.781475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ccc1a350-2ff0-4689-b6a4-3ed98a288646 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:09.787753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc1a350-2ff0-4689-b6a4-3ed98a288646 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:09.788326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc1a350-2ff0-4689-b6a4-3ed98a288646 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:09.788666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc1a350-2ff0-4689-b6a4-3ed98a288646 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:09.789366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc1a350-2ff0-4689-b6a4-3ed98a288646 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:09.789816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc1a350-2ff0-4689-b6a4-3ed98a288646 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:09.790241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccc1a350-2ff0-4689-b6a4-3ed98a288646 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:09.790734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f4cb3c20-83e6-4750-9d5e-eb8571cacbd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:09.799638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f4cb3c20-83e6-4750-9d5e-eb8571cacbd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153528 Sep 02 10:00:09.800200 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 761/1602] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:09 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:09.850674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ccc1a350-2ff0-4689-b6a4-3ed98a288646 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:09.859540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ccc1a350-2ff0-4689-b6a4-3ed98a288646 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083098 Sep 02 10:00:09.860103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 842/1603] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:09 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:10.820622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b4fa1cbf-2204-4906-94cf-284176e43fc0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:10.821219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b4fa1cbf-2204-4906-94cf-284176e43fc0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:10.827546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4fa1cbf-2204-4906-94cf-284176e43fc0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:10.828021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4fa1cbf-2204-4906-94cf-284176e43fc0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:10.828445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4fa1cbf-2204-4906-94cf-284176e43fc0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:10.829118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4fa1cbf-2204-4906-94cf-284176e43fc0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:10.829562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4fa1cbf-2204-4906-94cf-284176e43fc0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:10.829976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4fa1cbf-2204-4906-94cf-284176e43fc0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:10.880251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3d8b395f-facb-4d18-8d44-435023d0ecea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:10.881105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3d8b395f-facb-4d18-8d44-435023d0ecea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:10.887483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d8b395f-facb-4d18-8d44-435023d0ecea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:10.887968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d8b395f-facb-4d18-8d44-435023d0ecea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:10.888402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d8b395f-facb-4d18-8d44-435023d0ecea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:10.889086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d8b395f-facb-4d18-8d44-435023d0ecea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:10.889533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d8b395f-facb-4d18-8d44-435023d0ecea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:10.889954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3d8b395f-facb-4d18-8d44-435023d0ecea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:10.953352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3d8b395f-facb-4d18-8d44-435023d0ecea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:10.958218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b4fa1cbf-2204-4906-94cf-284176e43fc0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:10.962551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3d8b395f-facb-4d18-8d44-435023d0ecea tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085348 Sep 02 10:00:10.962551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 843/1604] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:10 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:10.966483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b4fa1cbf-2204-4906-94cf-284176e43fc0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149647 Sep 02 10:00:10.967073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 762/1605] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:10 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:11.982685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5c700802-2fb0-4ea7-bf6c-6483408b9dee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:11.983318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5c700802-2fb0-4ea7-bf6c-6483408b9dee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:11.987341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ecc6910e-5256-43eb-bd5b-69fef7c6ef92 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:11.988020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ecc6910e-5256-43eb-bd5b-69fef7c6ef92 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:11.989688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c700802-2fb0-4ea7-bf6c-6483408b9dee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:11.990180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c700802-2fb0-4ea7-bf6c-6483408b9dee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:11.990615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c700802-2fb0-4ea7-bf6c-6483408b9dee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:11.991336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c700802-2fb0-4ea7-bf6c-6483408b9dee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:11.991790 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c700802-2fb0-4ea7-bf6c-6483408b9dee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:11.992214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c700802-2fb0-4ea7-bf6c-6483408b9dee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:11.994336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ecc6910e-5256-43eb-bd5b-69fef7c6ef92 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:11.994911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ecc6910e-5256-43eb-bd5b-69fef7c6ef92 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:11.995882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ecc6910e-5256-43eb-bd5b-69fef7c6ef92 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:11.996579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ecc6910e-5256-43eb-bd5b-69fef7c6ef92 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:11.997009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ecc6910e-5256-43eb-bd5b-69fef7c6ef92 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:11.997425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ecc6910e-5256-43eb-bd5b-69fef7c6ef92 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:12.138452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ecc6910e-5256-43eb-bd5b-69fef7c6ef92 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:12.147007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ecc6910e-5256-43eb-bd5b-69fef7c6ef92 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.163555 Sep 02 10:00:12.147673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 763/1606] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:11 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:12.201334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5c700802-2fb0-4ea7-bf6c-6483408b9dee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:12.209383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5c700802-2fb0-4ea7-bf6c-6483408b9dee tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.230723 Sep 02 10:00:12.209948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 844/1607] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:11 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:13.168041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cfc58de8-6e96-4fe5-ad1f-91c33cb35fb1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:13.168593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cfc58de8-6e96-4fe5-ad1f-91c33cb35fb1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:13.174987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cfc58de8-6e96-4fe5-ad1f-91c33cb35fb1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:13.175467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cfc58de8-6e96-4fe5-ad1f-91c33cb35fb1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:13.175902 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cfc58de8-6e96-4fe5-ad1f-91c33cb35fb1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:13.176584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cfc58de8-6e96-4fe5-ad1f-91c33cb35fb1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:13.177041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cfc58de8-6e96-4fe5-ad1f-91c33cb35fb1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:13.177463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cfc58de8-6e96-4fe5-ad1f-91c33cb35fb1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:13.229986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-164f4dee-0901-4046-a295-d727f429471e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:13.230603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-164f4dee-0901-4046-a295-d727f429471e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:13.232912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=56 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:13.237624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-164f4dee-0901-4046-a295-d727f429471e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:13.238113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-164f4dee-0901-4046-a295-d727f429471e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:13.238555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-164f4dee-0901-4046-a295-d727f429471e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:13.239279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-164f4dee-0901-4046-a295-d727f429471e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:13.239740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-164f4dee-0901-4046-a295-d727f429471e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:13.240167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-164f4dee-0901-4046-a295-d727f429471e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:13.304187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cfc58de8-6e96-4fe5-ad1f-91c33cb35fb1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:13.304648 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-164f4dee-0901-4046-a295-d727f429471e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:13.312677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-164f4dee-0901-4046-a295-d727f429471e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086544 Sep 02 10:00:13.312874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cfc58de8-6e96-4fe5-ad1f-91c33cb35fb1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148703 Sep 02 10:00:13.313235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 845/1608] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:13 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:13.313405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 764/1609] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:13 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:14.334004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-570a91d3-24ea-4ba9-aeb5-262a12c9e7c4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:14.334524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9f73a2f8-b6a6-4c11-8496-0344838a6210 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:14.334939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-570a91d3-24ea-4ba9-aeb5-262a12c9e7c4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:14.335047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9f73a2f8-b6a6-4c11-8496-0344838a6210 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:14.341511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f73a2f8-b6a6-4c11-8496-0344838a6210 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:14.341651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570a91d3-24ea-4ba9-aeb5-262a12c9e7c4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:14.341991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f73a2f8-b6a6-4c11-8496-0344838a6210 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:14.342121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570a91d3-24ea-4ba9-aeb5-262a12c9e7c4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:14.342427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f73a2f8-b6a6-4c11-8496-0344838a6210 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:14.342540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570a91d3-24ea-4ba9-aeb5-262a12c9e7c4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:14.343143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f73a2f8-b6a6-4c11-8496-0344838a6210 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:14.343253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570a91d3-24ea-4ba9-aeb5-262a12c9e7c4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:14.343589 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570a91d3-24ea-4ba9-aeb5-262a12c9e7c4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:14.343728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f73a2f8-b6a6-4c11-8496-0344838a6210 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:14.344006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-570a91d3-24ea-4ba9-aeb5-262a12c9e7c4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:14.344113 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f73a2f8-b6a6-4c11-8496-0344838a6210 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:14.404916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9f73a2f8-b6a6-4c11-8496-0344838a6210 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:14.413075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9f73a2f8-b6a6-4c11-8496-0344838a6210 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083035 Sep 02 10:00:14.413649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 765/1610] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:14 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:14.470733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-570a91d3-24ea-4ba9-aeb5-262a12c9e7c4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:14.479071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-570a91d3-24ea-4ba9-aeb5-262a12c9e7c4 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149004 Sep 02 10:00:14.479632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 846/1611] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:14 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:15.433675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-093cd215-0bc8-4198-93cb-60fa8943e87d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:15.434287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-093cd215-0bc8-4198-93cb-60fa8943e87d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:15.440668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-093cd215-0bc8-4198-93cb-60fa8943e87d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:15.441158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-093cd215-0bc8-4198-93cb-60fa8943e87d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:15.441593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-093cd215-0bc8-4198-93cb-60fa8943e87d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:15.442276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-093cd215-0bc8-4198-93cb-60fa8943e87d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:15.442747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-093cd215-0bc8-4198-93cb-60fa8943e87d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:15.443176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-093cd215-0bc8-4198-93cb-60fa8943e87d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:15.499770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2309a881-8595-4c05-b8df-19de0db40e22 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:15.500411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2309a881-8595-4c05-b8df-19de0db40e22 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:15.506853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-093cd215-0bc8-4198-93cb-60fa8943e87d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:15.507023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2309a881-8595-4c05-b8df-19de0db40e22 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:15.507432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2309a881-8595-4c05-b8df-19de0db40e22 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:15.507873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2309a881-8595-4c05-b8df-19de0db40e22 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:15.508574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2309a881-8595-4c05-b8df-19de0db40e22 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:15.509027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2309a881-8595-4c05-b8df-19de0db40e22 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:15.509455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2309a881-8595-4c05-b8df-19de0db40e22 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:15.515610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-093cd215-0bc8-4198-93cb-60fa8943e87d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085762 Sep 02 10:00:15.516165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 766/1612] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:15 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:15.638415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2309a881-8595-4c05-b8df-19de0db40e22 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:15.646546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2309a881-8595-4c05-b8df-19de0db40e22 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150685 Sep 02 10:00:15.647154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 847/1613] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:15 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:16.536992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b550101a-b81e-4908-9971-2815aefd275a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:16.537572 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b550101a-b81e-4908-9971-2815aefd275a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:16.544057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b550101a-b81e-4908-9971-2815aefd275a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:16.544530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b550101a-b81e-4908-9971-2815aefd275a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:16.544954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b550101a-b81e-4908-9971-2815aefd275a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:16.545822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b550101a-b81e-4908-9971-2815aefd275a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:16.546268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b550101a-b81e-4908-9971-2815aefd275a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:16.546684 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b550101a-b81e-4908-9971-2815aefd275a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:16.608903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b550101a-b81e-4908-9971-2815aefd275a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:16.616810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b550101a-b81e-4908-9971-2815aefd275a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083710 Sep 02 10:00:16.617365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 767/1614] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:16 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:16.668407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5ebb6ad3-aa41-41f0-ab5d-8d2d212b5643 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:16.669022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5ebb6ad3-aa41-41f0-ab5d-8d2d212b5643 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:16.675374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ebb6ad3-aa41-41f0-ab5d-8d2d212b5643 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:16.675858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ebb6ad3-aa41-41f0-ab5d-8d2d212b5643 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:16.676295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ebb6ad3-aa41-41f0-ab5d-8d2d212b5643 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:16.676985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ebb6ad3-aa41-41f0-ab5d-8d2d212b5643 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:16.677436 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ebb6ad3-aa41-41f0-ab5d-8d2d212b5643 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:16.677872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ebb6ad3-aa41-41f0-ab5d-8d2d212b5643 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:16.681735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:16.807632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ebb6ad3-aa41-41f0-ab5d-8d2d212b5643 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:16.816467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5ebb6ad3-aa41-41f0-ab5d-8d2d212b5643 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151959 Sep 02 10:00:16.817036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 848/1615] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:16 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:17.638177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b4bdea80-a759-499a-a6f1-3db029bc45c5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:17.638818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b4bdea80-a759-499a-a6f1-3db029bc45c5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:17.641208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=52 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:17.645896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4bdea80-a759-499a-a6f1-3db029bc45c5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:17.646380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4bdea80-a759-499a-a6f1-3db029bc45c5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:17.646851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4bdea80-a759-499a-a6f1-3db029bc45c5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:17.647544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4bdea80-a759-499a-a6f1-3db029bc45c5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:17.648000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4bdea80-a759-499a-a6f1-3db029bc45c5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:17.648429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b4bdea80-a759-499a-a6f1-3db029bc45c5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:17.709262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b4bdea80-a759-499a-a6f1-3db029bc45c5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:17.717666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b4bdea80-a759-499a-a6f1-3db029bc45c5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083346 Sep 02 10:00:17.718240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 768/1616] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:17 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:17.836903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b2ad5177-6498-4e19-b508-c2e8e574fc0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:17.837514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b2ad5177-6498-4e19-b508-c2e8e574fc0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:17.844009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2ad5177-6498-4e19-b508-c2e8e574fc0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:17.844493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2ad5177-6498-4e19-b508-c2e8e574fc0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:17.844924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2ad5177-6498-4e19-b508-c2e8e574fc0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:17.845934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2ad5177-6498-4e19-b508-c2e8e574fc0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:17.846058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2ad5177-6498-4e19-b508-c2e8e574fc0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:17.846440 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2ad5177-6498-4e19-b508-c2e8e574fc0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:18.022578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b2ad5177-6498-4e19-b508-c2e8e574fc0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:18.032237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b2ad5177-6498-4e19-b508-c2e8e574fc0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.199058 Sep 02 10:00:18.032886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 849/1617] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:17 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:18.738467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-08b233f0-56df-49fc-b1ee-a69b0cafc5cb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:18.739038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-08b233f0-56df-49fc-b1ee-a69b0cafc5cb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:18.745898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b233f0-56df-49fc-b1ee-a69b0cafc5cb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:18.746379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b233f0-56df-49fc-b1ee-a69b0cafc5cb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:18.746847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b233f0-56df-49fc-b1ee-a69b0cafc5cb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:18.747531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b233f0-56df-49fc-b1ee-a69b0cafc5cb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:18.747977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b233f0-56df-49fc-b1ee-a69b0cafc5cb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:18.748405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-08b233f0-56df-49fc-b1ee-a69b0cafc5cb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:18.809004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-08b233f0-56df-49fc-b1ee-a69b0cafc5cb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:18.817034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-08b233f0-56df-49fc-b1ee-a69b0cafc5cb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082525 Sep 02 10:00:18.817600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 769/1618] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:18 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:19.054129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-186ed1ec-a426-474c-9818-8c5c38b3cdee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:19.054657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-186ed1ec-a426-474c-9818-8c5c38b3cdee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:19.061712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186ed1ec-a426-474c-9818-8c5c38b3cdee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:19.062193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186ed1ec-a426-474c-9818-8c5c38b3cdee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:19.062628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186ed1ec-a426-474c-9818-8c5c38b3cdee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:19.063351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186ed1ec-a426-474c-9818-8c5c38b3cdee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:19.063803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186ed1ec-a426-474c-9818-8c5c38b3cdee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:19.064227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186ed1ec-a426-474c-9818-8c5c38b3cdee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:19.201513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-186ed1ec-a426-474c-9818-8c5c38b3cdee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:19.209621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-186ed1ec-a426-474c-9818-8c5c38b3cdee tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.159473 Sep 02 10:00:19.210176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 850/1619] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:19 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:19.837386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9a6d83a0-bc75-4e56-bf77-a34a842c4df3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:19.837996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9a6d83a0-bc75-4e56-bf77-a34a842c4df3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:19.845229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a6d83a0-bc75-4e56-bf77-a34a842c4df3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:19.846197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a6d83a0-bc75-4e56-bf77-a34a842c4df3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:19.846197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a6d83a0-bc75-4e56-bf77-a34a842c4df3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:19.846884 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a6d83a0-bc75-4e56-bf77-a34a842c4df3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:19.847343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a6d83a0-bc75-4e56-bf77-a34a842c4df3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:19.847768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a6d83a0-bc75-4e56-bf77-a34a842c4df3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:19.912131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9a6d83a0-bc75-4e56-bf77-a34a842c4df3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:19.920378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9a6d83a0-bc75-4e56-bf77-a34a842c4df3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086895 Sep 02 10:00:19.920938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 770/1620] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:19 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:20.230160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cf4aeff3-3342-46fe-a89f-878b4f3dd95c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:20.230792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cf4aeff3-3342-46fe-a89f-878b4f3dd95c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:20.237154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf4aeff3-3342-46fe-a89f-878b4f3dd95c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:20.237643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf4aeff3-3342-46fe-a89f-878b4f3dd95c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:20.238080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf4aeff3-3342-46fe-a89f-878b4f3dd95c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:20.238793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf4aeff3-3342-46fe-a89f-878b4f3dd95c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:20.239248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf4aeff3-3342-46fe-a89f-878b4f3dd95c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:20.239674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf4aeff3-3342-46fe-a89f-878b4f3dd95c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:20.366951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cf4aeff3-3342-46fe-a89f-878b4f3dd95c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:20.375117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cf4aeff3-3342-46fe-a89f-878b4f3dd95c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149499 Sep 02 10:00:20.375676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 851/1621] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:20 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:20.941111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dd772c70-ec47-491b-a311-1bfae54b8f40 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:20.941728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dd772c70-ec47-491b-a311-1bfae54b8f40 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:20.948912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd772c70-ec47-491b-a311-1bfae54b8f40 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:20.949426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd772c70-ec47-491b-a311-1bfae54b8f40 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:20.949865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd772c70-ec47-491b-a311-1bfae54b8f40 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:20.950554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd772c70-ec47-491b-a311-1bfae54b8f40 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:20.951056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd772c70-ec47-491b-a311-1bfae54b8f40 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:20.951484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd772c70-ec47-491b-a311-1bfae54b8f40 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:21.069224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dd772c70-ec47-491b-a311-1bfae54b8f40 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:21.072186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dd772c70-ec47-491b-a311-1bfae54b8f40 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.135090 Sep 02 10:00:21.072752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 771/1622] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:20 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:21.396064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e263ff6d-a6cd-4cd6-b94e-3dceae98f4ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:21.396672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e263ff6d-a6cd-4cd6-b94e-3dceae98f4ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:21.403064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e263ff6d-a6cd-4cd6-b94e-3dceae98f4ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:21.403550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e263ff6d-a6cd-4cd6-b94e-3dceae98f4ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:21.403984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e263ff6d-a6cd-4cd6-b94e-3dceae98f4ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:21.404693 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e263ff6d-a6cd-4cd6-b94e-3dceae98f4ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:21.405143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e263ff6d-a6cd-4cd6-b94e-3dceae98f4ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:21.405569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e263ff6d-a6cd-4cd6-b94e-3dceae98f4ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:21.529713 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e263ff6d-a6cd-4cd6-b94e-3dceae98f4ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:21.537834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e263ff6d-a6cd-4cd6-b94e-3dceae98f4ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.145687 Sep 02 10:00:21.538401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 852/1623] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:21 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:22.093473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-60dd4d17-de56-4c93-9587-94d85f8f3a2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:22.094079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-60dd4d17-de56-4c93-9587-94d85f8f3a2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:22.100507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60dd4d17-de56-4c93-9587-94d85f8f3a2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:22.100930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60dd4d17-de56-4c93-9587-94d85f8f3a2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:22.101361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60dd4d17-de56-4c93-9587-94d85f8f3a2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:22.102037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60dd4d17-de56-4c93-9587-94d85f8f3a2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:22.102482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60dd4d17-de56-4c93-9587-94d85f8f3a2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:22.102936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60dd4d17-de56-4c93-9587-94d85f8f3a2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:22.162788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-60dd4d17-de56-4c93-9587-94d85f8f3a2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:22.171358 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-60dd4d17-de56-4c93-9587-94d85f8f3a2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081797 Sep 02 10:00:22.171913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 772/1624] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:22 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:22.559293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-36c2f194-2589-4ca7-9b6c-a155f7e1b04c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:22.559819 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-36c2f194-2589-4ca7-9b6c-a155f7e1b04c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:22.566158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36c2f194-2589-4ca7-9b6c-a155f7e1b04c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:22.566645 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36c2f194-2589-4ca7-9b6c-a155f7e1b04c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:22.567126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36c2f194-2589-4ca7-9b6c-a155f7e1b04c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:22.567816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36c2f194-2589-4ca7-9b6c-a155f7e1b04c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:22.568270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36c2f194-2589-4ca7-9b6c-a155f7e1b04c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:22.568694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-36c2f194-2589-4ca7-9b6c-a155f7e1b04c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:22.700261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-36c2f194-2589-4ca7-9b6c-a155f7e1b04c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:22.708658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-36c2f194-2589-4ca7-9b6c-a155f7e1b04c tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153396 Sep 02 10:00:22.709249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 853/1625] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:22 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:23.192560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7327b123-936a-4ba8-90ed-f930c6b519b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:23.193168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7327b123-936a-4ba8-90ed-f930c6b519b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:23.200211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7327b123-936a-4ba8-90ed-f930c6b519b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:23.200690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7327b123-936a-4ba8-90ed-f930c6b519b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:23.201117 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7327b123-936a-4ba8-90ed-f930c6b519b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:23.201794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7327b123-936a-4ba8-90ed-f930c6b519b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:23.202239 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7327b123-936a-4ba8-90ed-f930c6b519b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:23.202656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7327b123-936a-4ba8-90ed-f930c6b519b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:23.216939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:23.267051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7327b123-936a-4ba8-90ed-f930c6b519b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:23.275458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7327b123-936a-4ba8-90ed-f930c6b519b4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086920 Sep 02 10:00:23.276031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 773/1626] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:23 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:23.730102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a34debe1-7786-4cdd-9a7d-24099fc14e18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:23.731245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a34debe1-7786-4cdd-9a7d-24099fc14e18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:23.737715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a34debe1-7786-4cdd-9a7d-24099fc14e18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:23.738194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a34debe1-7786-4cdd-9a7d-24099fc14e18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:23.738627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a34debe1-7786-4cdd-9a7d-24099fc14e18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:23.739357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a34debe1-7786-4cdd-9a7d-24099fc14e18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:23.739810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a34debe1-7786-4cdd-9a7d-24099fc14e18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:23.740236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a34debe1-7786-4cdd-9a7d-24099fc14e18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:23.866980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a34debe1-7786-4cdd-9a7d-24099fc14e18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:23.875998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a34debe1-7786-4cdd-9a7d-24099fc14e18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149850 Sep 02 10:00:23.876559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 854/1627] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:23 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:24.296257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9002a813-1f24-46ad-8791-3141dd38e644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:24.296843 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9002a813-1f24-46ad-8791-3141dd38e644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:24.303215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9002a813-1f24-46ad-8791-3141dd38e644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:24.303695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9002a813-1f24-46ad-8791-3141dd38e644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:24.304124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9002a813-1f24-46ad-8791-3141dd38e644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:24.304805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9002a813-1f24-46ad-8791-3141dd38e644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:24.305251 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9002a813-1f24-46ad-8791-3141dd38e644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:24.305668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9002a813-1f24-46ad-8791-3141dd38e644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:24.371202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9002a813-1f24-46ad-8791-3141dd38e644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:24.379358 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9002a813-1f24-46ad-8791-3141dd38e644 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087036 Sep 02 10:00:24.379923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 774/1628] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:24 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:24.897159 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-170be0c3-9281-469f-9873-666c7538e48f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:24.897780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-170be0c3-9281-469f-9873-666c7538e48f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:24.904786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-170be0c3-9281-469f-9873-666c7538e48f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:24.905334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-170be0c3-9281-469f-9873-666c7538e48f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:24.905815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-170be0c3-9281-469f-9873-666c7538e48f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:24.906511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-170be0c3-9281-469f-9873-666c7538e48f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:24.907023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-170be0c3-9281-469f-9873-666c7538e48f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:24.907451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-170be0c3-9281-469f-9873-666c7538e48f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:25.039354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-170be0c3-9281-469f-9873-666c7538e48f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:25.047429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-170be0c3-9281-469f-9873-666c7538e48f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154257 Sep 02 10:00:25.047999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 855/1629] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:24 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:25.400659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-60a753dd-e7e4-4d3b-bb1f-1d3587d4e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:25.401269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-60a753dd-e7e4-4d3b-bb1f-1d3587d4e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:25.407766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60a753dd-e7e4-4d3b-bb1f-1d3587d4e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:25.408256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60a753dd-e7e4-4d3b-bb1f-1d3587d4e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:25.408690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60a753dd-e7e4-4d3b-bb1f-1d3587d4e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:25.409375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60a753dd-e7e4-4d3b-bb1f-1d3587d4e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:25.409830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60a753dd-e7e4-4d3b-bb1f-1d3587d4e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:25.410255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60a753dd-e7e4-4d3b-bb1f-1d3587d4e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:25.470972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-60a753dd-e7e4-4d3b-bb1f-1d3587d4e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:25.479131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-60a753dd-e7e4-4d3b-bb1f-1d3587d4e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082296 Sep 02 10:00:25.479704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 775/1630] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:26.068170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a8dbeaa1-c403-4887-b3b9-f7114eabcba0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:26.068777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a8dbeaa1-c403-4887-b3b9-f7114eabcba0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:26.075416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8dbeaa1-c403-4887-b3b9-f7114eabcba0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:26.075920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8dbeaa1-c403-4887-b3b9-f7114eabcba0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:26.076350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8dbeaa1-c403-4887-b3b9-f7114eabcba0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:26.077028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8dbeaa1-c403-4887-b3b9-f7114eabcba0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:26.077474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8dbeaa1-c403-4887-b3b9-f7114eabcba0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:26.077896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8dbeaa1-c403-4887-b3b9-f7114eabcba0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:26.205827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a8dbeaa1-c403-4887-b3b9-f7114eabcba0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:26.213860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a8dbeaa1-c403-4887-b3b9-f7114eabcba0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149530 Sep 02 10:00:26.214422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 856/1631] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:26 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:26.499226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ee5ef1ea-05a0-4b79-9868-eb8e7a70aa2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:26.499789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ee5ef1ea-05a0-4b79-9868-eb8e7a70aa2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:26.506433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee5ef1ea-05a0-4b79-9868-eb8e7a70aa2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:26.506949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee5ef1ea-05a0-4b79-9868-eb8e7a70aa2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:26.507386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee5ef1ea-05a0-4b79-9868-eb8e7a70aa2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:26.508067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee5ef1ea-05a0-4b79-9868-eb8e7a70aa2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:26.508519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee5ef1ea-05a0-4b79-9868-eb8e7a70aa2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:26.508943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee5ef1ea-05a0-4b79-9868-eb8e7a70aa2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:26.568646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ee5ef1ea-05a0-4b79-9868-eb8e7a70aa2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:26.571025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:00:26.571172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f (ip 10.222.0.57) !!! Sep 02 10:00:26.572182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:00:26.572330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f (ip 10.222.0.57) !!! Sep 02 10:00:26.573168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:00:26.573280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f (ip 10.222.0.57) !!! Sep 02 10:00:26.583485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ee5ef1ea-05a0-4b79-9868-eb8e7a70aa2e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.088225 Sep 02 10:00:26.584039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 776/1632] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:26 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:27.235502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b952973d-df15-4df9-8db8-48f5fea422d7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:27.236024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b952973d-df15-4df9-8db8-48f5fea422d7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:27.242349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b952973d-df15-4df9-8db8-48f5fea422d7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:27.242867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b952973d-df15-4df9-8db8-48f5fea422d7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:27.243304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b952973d-df15-4df9-8db8-48f5fea422d7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:27.243986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b952973d-df15-4df9-8db8-48f5fea422d7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:27.244442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b952973d-df15-4df9-8db8-48f5fea422d7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:27.244869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b952973d-df15-4df9-8db8-48f5fea422d7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:27.373550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b952973d-df15-4df9-8db8-48f5fea422d7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:27.381952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b952973d-df15-4df9-8db8-48f5fea422d7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150387 Sep 02 10:00:27.382511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 857/1633] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:27 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:27.606126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4b15eda5-82fb-4a97-87a9-a67f375967a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:27.606791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4b15eda5-82fb-4a97-87a9-a67f375967a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:27.615605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b15eda5-82fb-4a97-87a9-a67f375967a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:27.616093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b15eda5-82fb-4a97-87a9-a67f375967a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:27.616530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b15eda5-82fb-4a97-87a9-a67f375967a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:27.617217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b15eda5-82fb-4a97-87a9-a67f375967a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:27.617671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b15eda5-82fb-4a97-87a9-a67f375967a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:27.618093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b15eda5-82fb-4a97-87a9-a67f375967a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:27.679330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4b15eda5-82fb-4a97-87a9-a67f375967a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:27.687533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4b15eda5-82fb-4a97-87a9-a67f375967a4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086780 Sep 02 10:00:27.688101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 777/1634] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:27 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:28.403086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-40e28820-0872-4801-8117-97328bf7a1a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:28.403698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-40e28820-0872-4801-8117-97328bf7a1a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:28.410023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40e28820-0872-4801-8117-97328bf7a1a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:28.414235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40e28820-0872-4801-8117-97328bf7a1a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:28.414235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40e28820-0872-4801-8117-97328bf7a1a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:28.414235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40e28820-0872-4801-8117-97328bf7a1a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:28.414235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40e28820-0872-4801-8117-97328bf7a1a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:28.414661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40e28820-0872-4801-8117-97328bf7a1a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:28.538031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-40e28820-0872-4801-8117-97328bf7a1a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:28.546038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-40e28820-0872-4801-8117-97328bf7a1a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146937 Sep 02 10:00:28.546596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 858/1635] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:28 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:28.708287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fe8d964b-5473-410c-9c5c-a2cc801a5aed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:28.708855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fe8d964b-5473-410c-9c5c-a2cc801a5aed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:28.715212 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe8d964b-5473-410c-9c5c-a2cc801a5aed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:28.715698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe8d964b-5473-410c-9c5c-a2cc801a5aed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:28.716130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe8d964b-5473-410c-9c5c-a2cc801a5aed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:28.716816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe8d964b-5473-410c-9c5c-a2cc801a5aed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:28.717267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe8d964b-5473-410c-9c5c-a2cc801a5aed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:28.717686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe8d964b-5473-410c-9c5c-a2cc801a5aed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:28.780806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fe8d964b-5473-410c-9c5c-a2cc801a5aed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:28.789157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fe8d964b-5473-410c-9c5c-a2cc801a5aed tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084889 Sep 02 10:00:28.789722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 778/1636] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:28 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:29.566924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7e5f98d1-fe5d-42b2-9804-6198b46b0635 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:29.567516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7e5f98d1-fe5d-42b2-9804-6198b46b0635 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:29.573853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5f98d1-fe5d-42b2-9804-6198b46b0635 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:29.574341 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5f98d1-fe5d-42b2-9804-6198b46b0635 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:29.574802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5f98d1-fe5d-42b2-9804-6198b46b0635 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:29.575484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5f98d1-fe5d-42b2-9804-6198b46b0635 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:29.575936 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5f98d1-fe5d-42b2-9804-6198b46b0635 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:29.576868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e5f98d1-fe5d-42b2-9804-6198b46b0635 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:29.702906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7e5f98d1-fe5d-42b2-9804-6198b46b0635 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:29.711016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7e5f98d1-fe5d-42b2-9804-6198b46b0635 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148016 Sep 02 10:00:29.711611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 859/1637] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:29 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:29.810068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1402fcf3-7800-4f99-82ce-a6782b9062e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:29.811197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1402fcf3-7800-4f99-82ce-a6782b9062e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:29.817920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1402fcf3-7800-4f99-82ce-a6782b9062e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:29.818348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1402fcf3-7800-4f99-82ce-a6782b9062e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:29.818812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1402fcf3-7800-4f99-82ce-a6782b9062e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:29.819499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1402fcf3-7800-4f99-82ce-a6782b9062e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:29.819974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1402fcf3-7800-4f99-82ce-a6782b9062e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:29.820403 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1402fcf3-7800-4f99-82ce-a6782b9062e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:29.884047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1402fcf3-7800-4f99-82ce-a6782b9062e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:29.892944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1402fcf3-7800-4f99-82ce-a6782b9062e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086801 Sep 02 10:00:29.893500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 779/1638] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:29 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:30.732136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-da26d4d9-8c0d-463b-a0f4-cebf5c638e0a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:30.733335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-da26d4d9-8c0d-463b-a0f4-cebf5c638e0a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:30.735249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:00:30.735379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 10:00:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b (ip 10.222.0.57) !!! Sep 02 10:00:30.736561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:00:30.736692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 10:00:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b (ip 10.222.0.57) !!! Sep 02 10:00:30.748507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da26d4d9-8c0d-463b-a0f4-cebf5c638e0a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:30.748989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da26d4d9-8c0d-463b-a0f4-cebf5c638e0a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:30.749426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da26d4d9-8c0d-463b-a0f4-cebf5c638e0a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:30.750106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da26d4d9-8c0d-463b-a0f4-cebf5c638e0a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:30.750551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da26d4d9-8c0d-463b-a0f4-cebf5c638e0a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:30.751003 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da26d4d9-8c0d-463b-a0f4-cebf5c638e0a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:30.882003 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-da26d4d9-8c0d-463b-a0f4-cebf5c638e0a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:30.890124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-da26d4d9-8c0d-463b-a0f4-cebf5c638e0a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.161821 Sep 02 10:00:30.890684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 860/1639] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:30 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:30.912969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c38b273f-45fc-4304-9e30-6df6a69841f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:30.913564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c38b273f-45fc-4304-9e30-6df6a69841f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:30.920035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c38b273f-45fc-4304-9e30-6df6a69841f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:30.921125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c38b273f-45fc-4304-9e30-6df6a69841f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:30.921578 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c38b273f-45fc-4304-9e30-6df6a69841f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:30.922280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c38b273f-45fc-4304-9e30-6df6a69841f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:30.922759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c38b273f-45fc-4304-9e30-6df6a69841f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:30.923182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c38b273f-45fc-4304-9e30-6df6a69841f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:30.982781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c38b273f-45fc-4304-9e30-6df6a69841f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:30.990793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c38b273f-45fc-4304-9e30-6df6a69841f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081678 Sep 02 10:00:30.991360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 780/1640] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:30 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:31.911020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-736e4bc9-f2bb-4d1d-9e15-f1eb71efa381 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:31.911626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-736e4bc9-f2bb-4d1d-9e15-f1eb71efa381 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:31.917983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-736e4bc9-f2bb-4d1d-9e15-f1eb71efa381 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:31.918455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-736e4bc9-f2bb-4d1d-9e15-f1eb71efa381 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:31.918927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-736e4bc9-f2bb-4d1d-9e15-f1eb71efa381 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:31.919606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-736e4bc9-f2bb-4d1d-9e15-f1eb71efa381 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:31.920550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-736e4bc9-f2bb-4d1d-9e15-f1eb71efa381 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:31.920969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-736e4bc9-f2bb-4d1d-9e15-f1eb71efa381 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:32.011618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1cf6e0a5-2e12-4389-8d41-475d2fa54296 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:32.012319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1cf6e0a5-2e12-4389-8d41-475d2fa54296 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:32.018491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf6e0a5-2e12-4389-8d41-475d2fa54296 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:32.019090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf6e0a5-2e12-4389-8d41-475d2fa54296 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:32.019601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf6e0a5-2e12-4389-8d41-475d2fa54296 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:32.020302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf6e0a5-2e12-4389-8d41-475d2fa54296 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:32.020757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf6e0a5-2e12-4389-8d41-475d2fa54296 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:32.021180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1cf6e0a5-2e12-4389-8d41-475d2fa54296 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:32.048539 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-736e4bc9-f2bb-4d1d-9e15-f1eb71efa381 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:32.056779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-736e4bc9-f2bb-4d1d-9e15-f1eb71efa381 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149680 Sep 02 10:00:32.057346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 861/1641] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:31 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:32.082431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1cf6e0a5-2e12-4389-8d41-475d2fa54296 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:32.090599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1cf6e0a5-2e12-4389-8d41-475d2fa54296 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082918 Sep 02 10:00:32.091191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 781/1642] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:32 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:33.078101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-656de142-4782-40fa-b963-0463518886e7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:33.078734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-656de142-4782-40fa-b963-0463518886e7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:33.085171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-656de142-4782-40fa-b963-0463518886e7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:33.085663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-656de142-4782-40fa-b963-0463518886e7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:33.086102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-656de142-4782-40fa-b963-0463518886e7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:33.086818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-656de142-4782-40fa-b963-0463518886e7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:33.087275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-656de142-4782-40fa-b963-0463518886e7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:33.087696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-656de142-4782-40fa-b963-0463518886e7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:33.111006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-da9bd1e9-f56d-4f56-ba3b-27b3e667c755 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:33.111556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-da9bd1e9-f56d-4f56-ba3b-27b3e667c755 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:33.117956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da9bd1e9-f56d-4f56-ba3b-27b3e667c755 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:33.118446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da9bd1e9-f56d-4f56-ba3b-27b3e667c755 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:33.118924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da9bd1e9-f56d-4f56-ba3b-27b3e667c755 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:33.119660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da9bd1e9-f56d-4f56-ba3b-27b3e667c755 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:33.120127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da9bd1e9-f56d-4f56-ba3b-27b3e667c755 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:33.120562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da9bd1e9-f56d-4f56-ba3b-27b3e667c755 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:33.186504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da9bd1e9-f56d-4f56-ba3b-27b3e667c755 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:33.194740 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-da9bd1e9-f56d-4f56-ba3b-27b3e667c755 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087700 Sep 02 10:00:33.195310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 782/1643] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:33 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:33.219410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-656de142-4782-40fa-b963-0463518886e7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:33.227550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-656de142-4782-40fa-b963-0463518886e7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154012 Sep 02 10:00:33.228112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 862/1644] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:33 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:34.215781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-696a97d3-7ee2-4968-8fc6-35ff0dc4c06b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:34.216341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-696a97d3-7ee2-4968-8fc6-35ff0dc4c06b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:34.223371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696a97d3-7ee2-4968-8fc6-35ff0dc4c06b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:34.223862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696a97d3-7ee2-4968-8fc6-35ff0dc4c06b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:34.224301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696a97d3-7ee2-4968-8fc6-35ff0dc4c06b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:34.224990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696a97d3-7ee2-4968-8fc6-35ff0dc4c06b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:34.225447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696a97d3-7ee2-4968-8fc6-35ff0dc4c06b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:34.225875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-696a97d3-7ee2-4968-8fc6-35ff0dc4c06b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:34.248842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a48e6544-4f54-4ea1-bc38-3ad0798b3f0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:34.249544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a48e6544-4f54-4ea1-bc38-3ad0798b3f0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:34.256215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a48e6544-4f54-4ea1-bc38-3ad0798b3f0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:34.256702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a48e6544-4f54-4ea1-bc38-3ad0798b3f0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:34.257138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a48e6544-4f54-4ea1-bc38-3ad0798b3f0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:34.258377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a48e6544-4f54-4ea1-bc38-3ad0798b3f0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:34.258857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a48e6544-4f54-4ea1-bc38-3ad0798b3f0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:34.259287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a48e6544-4f54-4ea1-bc38-3ad0798b3f0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:34.286540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-696a97d3-7ee2-4968-8fc6-35ff0dc4c06b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:34.294902 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-696a97d3-7ee2-4968-8fc6-35ff0dc4c06b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083018 Sep 02 10:00:34.295474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 783/1645] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:34 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:34.387300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a48e6544-4f54-4ea1-bc38-3ad0798b3f0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:34.396078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a48e6544-4f54-4ea1-bc38-3ad0798b3f0b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151078 Sep 02 10:00:34.396641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 863/1646] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:34 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:00:35.315467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-337bc750-7d18-4b36-bf04-1ed5f85ebd0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:35.316095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-337bc750-7d18-4b36-bf04-1ed5f85ebd0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:35.322380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337bc750-7d18-4b36-bf04-1ed5f85ebd0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:35.322963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337bc750-7d18-4b36-bf04-1ed5f85ebd0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:35.323401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337bc750-7d18-4b36-bf04-1ed5f85ebd0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:35.324081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337bc750-7d18-4b36-bf04-1ed5f85ebd0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:35.324532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337bc750-7d18-4b36-bf04-1ed5f85ebd0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:35.324954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-337bc750-7d18-4b36-bf04-1ed5f85ebd0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:35.388076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-337bc750-7d18-4b36-bf04-1ed5f85ebd0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:35.396365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-337bc750-7d18-4b36-bf04-1ed5f85ebd0b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084907 Sep 02 10:00:35.396927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 784/1647] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:35 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:35.416728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-52923775-db16-42b6-8bad-4a31d39fc59f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:35.417335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-52923775-db16-42b6-8bad-4a31d39fc59f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:35.424372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52923775-db16-42b6-8bad-4a31d39fc59f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:35.424853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52923775-db16-42b6-8bad-4a31d39fc59f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:35.425285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52923775-db16-42b6-8bad-4a31d39fc59f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:35.425966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52923775-db16-42b6-8bad-4a31d39fc59f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:35.426411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52923775-db16-42b6-8bad-4a31d39fc59f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:35.426911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-52923775-db16-42b6-8bad-4a31d39fc59f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:35.558247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-52923775-db16-42b6-8bad-4a31d39fc59f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:35.560553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:35.570346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-52923775-db16-42b6-8bad-4a31d39fc59f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154421 Sep 02 10:00:35.570346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 864/1648] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:35 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:36.423078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0896e07c-d95e-497f-a90a-42e34e4e5ad4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:36.423681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0896e07c-d95e-497f-a90a-42e34e4e5ad4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:36.430784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0896e07c-d95e-497f-a90a-42e34e4e5ad4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:36.431266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0896e07c-d95e-497f-a90a-42e34e4e5ad4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:36.431696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0896e07c-d95e-497f-a90a-42e34e4e5ad4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:36.432377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0896e07c-d95e-497f-a90a-42e34e4e5ad4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:36.432829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0896e07c-d95e-497f-a90a-42e34e4e5ad4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:36.433244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0896e07c-d95e-497f-a90a-42e34e4e5ad4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:36.493322 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0896e07c-d95e-497f-a90a-42e34e4e5ad4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:36.502029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0896e07c-d95e-497f-a90a-42e34e4e5ad4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083321 Sep 02 10:00:36.502591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 785/1649] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:36 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:36.588709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-79bf29a3-d544-4d61-828d-fd72e1997a03 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:36.589318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-79bf29a3-d544-4d61-828d-fd72e1997a03 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:36.596699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79bf29a3-d544-4d61-828d-fd72e1997a03 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:36.597173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79bf29a3-d544-4d61-828d-fd72e1997a03 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:36.597603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79bf29a3-d544-4d61-828d-fd72e1997a03 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:36.598277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79bf29a3-d544-4d61-828d-fd72e1997a03 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:36.598741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79bf29a3-d544-4d61-828d-fd72e1997a03 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:36.599166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-79bf29a3-d544-4d61-828d-fd72e1997a03 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:36.727365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-79bf29a3-d544-4d61-828d-fd72e1997a03 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:36.735975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-79bf29a3-d544-4d61-828d-fd72e1997a03 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151113 Sep 02 10:00:36.736536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 865/1650] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:36 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:37.522592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ca8d6a44-ab4c-4b54-88f5-5e050f9b0af3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:37.523249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ca8d6a44-ab4c-4b54-88f5-5e050f9b0af3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:37.529595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca8d6a44-ab4c-4b54-88f5-5e050f9b0af3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:37.530075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca8d6a44-ab4c-4b54-88f5-5e050f9b0af3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:37.530505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca8d6a44-ab4c-4b54-88f5-5e050f9b0af3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:37.531217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca8d6a44-ab4c-4b54-88f5-5e050f9b0af3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:37.531664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca8d6a44-ab4c-4b54-88f5-5e050f9b0af3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:37.532091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca8d6a44-ab4c-4b54-88f5-5e050f9b0af3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:37.596247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ca8d6a44-ab4c-4b54-88f5-5e050f9b0af3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:37.604336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ca8d6a44-ab4c-4b54-88f5-5e050f9b0af3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085593 Sep 02 10:00:37.604903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 786/1651] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:37 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:37.757382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7c14eb33-9077-442a-8cb9-ae820d5cde18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:37.761347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7c14eb33-9077-442a-8cb9-ae820d5cde18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:37.763934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c14eb33-9077-442a-8cb9-ae820d5cde18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:37.764414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c14eb33-9077-442a-8cb9-ae820d5cde18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:37.764850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c14eb33-9077-442a-8cb9-ae820d5cde18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:37.765535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c14eb33-9077-442a-8cb9-ae820d5cde18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:37.765994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c14eb33-9077-442a-8cb9-ae820d5cde18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:37.766418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c14eb33-9077-442a-8cb9-ae820d5cde18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:37.892762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7c14eb33-9077-442a-8cb9-ae820d5cde18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:37.901008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7c14eb33-9077-442a-8cb9-ae820d5cde18 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147885 Sep 02 10:00:37.901561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 866/1652] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:37 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:38.624334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-28166143-46d7-4f0a-81d4-14a6720a7cb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:38.624924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-28166143-46d7-4f0a-81d4-14a6720a7cb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:38.631648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28166143-46d7-4f0a-81d4-14a6720a7cb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:38.632122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28166143-46d7-4f0a-81d4-14a6720a7cb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:38.632552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28166143-46d7-4f0a-81d4-14a6720a7cb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:38.633238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28166143-46d7-4f0a-81d4-14a6720a7cb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:38.633674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28166143-46d7-4f0a-81d4-14a6720a7cb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:38.634118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-28166143-46d7-4f0a-81d4-14a6720a7cb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:38.693249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-28166143-46d7-4f0a-81d4-14a6720a7cb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:38.701732 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-28166143-46d7-4f0a-81d4-14a6720a7cb5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.080824 Sep 02 10:00:38.702296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 787/1653] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:38 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:38.921745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7e71f31a-bdcb-44ee-bd9d-bbdb9c53767b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:38.922264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7e71f31a-bdcb-44ee-bd9d-bbdb9c53767b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:38.928626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e71f31a-bdcb-44ee-bd9d-bbdb9c53767b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:38.929103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e71f31a-bdcb-44ee-bd9d-bbdb9c53767b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:38.929534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e71f31a-bdcb-44ee-bd9d-bbdb9c53767b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:38.930211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e71f31a-bdcb-44ee-bd9d-bbdb9c53767b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:38.930653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e71f31a-bdcb-44ee-bd9d-bbdb9c53767b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:38.931099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e71f31a-bdcb-44ee-bd9d-bbdb9c53767b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:39.064574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7e71f31a-bdcb-44ee-bd9d-bbdb9c53767b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:39.072750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7e71f31a-bdcb-44ee-bd9d-bbdb9c53767b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154914 Sep 02 10:00:39.073304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 867/1654] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:38 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:39.722351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cd742540-f432-4117-8d61-b47e57746e6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:39.722919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cd742540-f432-4117-8d61-b47e57746e6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:39.729242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd742540-f432-4117-8d61-b47e57746e6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:39.729720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd742540-f432-4117-8d61-b47e57746e6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:39.730153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd742540-f432-4117-8d61-b47e57746e6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:39.730873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd742540-f432-4117-8d61-b47e57746e6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:39.731324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd742540-f432-4117-8d61-b47e57746e6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:39.731744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd742540-f432-4117-8d61-b47e57746e6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:39.796757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cd742540-f432-4117-8d61-b47e57746e6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:39.804933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cd742540-f432-4117-8d61-b47e57746e6f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087019 Sep 02 10:00:39.805498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 788/1655] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:39 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:40.094055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-93cdee9e-868b-43a4-8cd0-301ef1442400 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:40.094740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-93cdee9e-868b-43a4-8cd0-301ef1442400 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:40.101210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93cdee9e-868b-43a4-8cd0-301ef1442400 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:40.101692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93cdee9e-868b-43a4-8cd0-301ef1442400 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:40.102133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93cdee9e-868b-43a4-8cd0-301ef1442400 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:40.102843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93cdee9e-868b-43a4-8cd0-301ef1442400 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:40.103300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93cdee9e-868b-43a4-8cd0-301ef1442400 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:40.103723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93cdee9e-868b-43a4-8cd0-301ef1442400 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:40.229070 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-93cdee9e-868b-43a4-8cd0-301ef1442400 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:40.237379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-93cdee9e-868b-43a4-8cd0-301ef1442400 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147836 Sep 02 10:00:40.237943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 868/1656] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:40 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:40.825601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6a07a9a5-326c-4dfd-8abd-bdebd4d4aaba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:40.826206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6a07a9a5-326c-4dfd-8abd-bdebd4d4aaba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:40.832710 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a07a9a5-326c-4dfd-8abd-bdebd4d4aaba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:40.833183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a07a9a5-326c-4dfd-8abd-bdebd4d4aaba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:40.833613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a07a9a5-326c-4dfd-8abd-bdebd4d4aaba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:40.834291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a07a9a5-326c-4dfd-8abd-bdebd4d4aaba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:40.834761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a07a9a5-326c-4dfd-8abd-bdebd4d4aaba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:40.835182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a07a9a5-326c-4dfd-8abd-bdebd4d4aaba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:40.896265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6a07a9a5-326c-4dfd-8abd-bdebd4d4aaba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:40.904707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6a07a9a5-326c-4dfd-8abd-bdebd4d4aaba tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083012 Sep 02 10:00:40.905268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 789/1657] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:40 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:41.258280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-67893f60-69e7-40ae-9dd1-c8656621a9f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:41.258935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-67893f60-69e7-40ae-9dd1-c8656621a9f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:41.265295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67893f60-69e7-40ae-9dd1-c8656621a9f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:41.265781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67893f60-69e7-40ae-9dd1-c8656621a9f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:41.266220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67893f60-69e7-40ae-9dd1-c8656621a9f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:41.266940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67893f60-69e7-40ae-9dd1-c8656621a9f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:41.267401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67893f60-69e7-40ae-9dd1-c8656621a9f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:41.267827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67893f60-69e7-40ae-9dd1-c8656621a9f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:41.396184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67893f60-69e7-40ae-9dd1-c8656621a9f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:41.404288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-67893f60-69e7-40ae-9dd1-c8656621a9f6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150166 Sep 02 10:00:41.404848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 869/1658] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:41 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:41.925061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-52cc302e-7cf1-4873-9b25-f149148baba0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:41.925703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-52cc302e-7cf1-4873-9b25-f149148baba0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:41.932132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52cc302e-7cf1-4873-9b25-f149148baba0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:41.932617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52cc302e-7cf1-4873-9b25-f149148baba0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:41.933051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52cc302e-7cf1-4873-9b25-f149148baba0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:41.933736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52cc302e-7cf1-4873-9b25-f149148baba0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:41.934187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52cc302e-7cf1-4873-9b25-f149148baba0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:41.934611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52cc302e-7cf1-4873-9b25-f149148baba0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:41.937646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:41.999641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-52cc302e-7cf1-4873-9b25-f149148baba0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:42.007939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-52cc302e-7cf1-4873-9b25-f149148baba0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086746 Sep 02 10:00:42.008522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 790/1659] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:41 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:42.425523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-92896b65-b6ff-4a73-888b-9cf1791ac80d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:42.426179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-92896b65-b6ff-4a73-888b-9cf1791ac80d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:42.432720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92896b65-b6ff-4a73-888b-9cf1791ac80d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:42.433203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92896b65-b6ff-4a73-888b-9cf1791ac80d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:42.433649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92896b65-b6ff-4a73-888b-9cf1791ac80d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:42.434386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92896b65-b6ff-4a73-888b-9cf1791ac80d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:42.434885 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92896b65-b6ff-4a73-888b-9cf1791ac80d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:42.435316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-92896b65-b6ff-4a73-888b-9cf1791ac80d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:42.562925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-92896b65-b6ff-4a73-888b-9cf1791ac80d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:42.571362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-92896b65-b6ff-4a73-888b-9cf1791ac80d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.149797 Sep 02 10:00:42.571932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 870/1660] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:42 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:43.029241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-833af16e-6bbf-490d-9774-be965a623a47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:43.029854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-833af16e-6bbf-490d-9774-be965a623a47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:43.036811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-833af16e-6bbf-490d-9774-be965a623a47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:43.037289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-833af16e-6bbf-490d-9774-be965a623a47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:43.037716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-833af16e-6bbf-490d-9774-be965a623a47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:43.038389 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-833af16e-6bbf-490d-9774-be965a623a47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:43.038866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-833af16e-6bbf-490d-9774-be965a623a47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:43.039286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-833af16e-6bbf-490d-9774-be965a623a47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:43.099603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-833af16e-6bbf-490d-9774-be965a623a47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:43.107659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-833af16e-6bbf-490d-9774-be965a623a47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082303 Sep 02 10:00:43.108220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 791/1661] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:43 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:43.593055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0155a7dd-74df-4b03-a61e-72cce6d970fc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:43.593636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0155a7dd-74df-4b03-a61e-72cce6d970fc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:43.595970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=52 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:43.600587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0155a7dd-74df-4b03-a61e-72cce6d970fc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:43.601062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0155a7dd-74df-4b03-a61e-72cce6d970fc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:43.601494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0155a7dd-74df-4b03-a61e-72cce6d970fc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:43.602173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0155a7dd-74df-4b03-a61e-72cce6d970fc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:43.602619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0155a7dd-74df-4b03-a61e-72cce6d970fc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:43.603065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0155a7dd-74df-4b03-a61e-72cce6d970fc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:43.728877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0155a7dd-74df-4b03-a61e-72cce6d970fc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:43.737659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0155a7dd-74df-4b03-a61e-72cce6d970fc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148530 Sep 02 10:00:43.738216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 871/1662] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:43 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:44.127534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b77ed6fb-3e36-4611-90c4-bc1cd40685d1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:44.128080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b77ed6fb-3e36-4611-90c4-bc1cd40685d1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:44.134821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b77ed6fb-3e36-4611-90c4-bc1cd40685d1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:44.135302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b77ed6fb-3e36-4611-90c4-bc1cd40685d1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:44.135771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b77ed6fb-3e36-4611-90c4-bc1cd40685d1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:44.136456 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b77ed6fb-3e36-4611-90c4-bc1cd40685d1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:44.136908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b77ed6fb-3e36-4611-90c4-bc1cd40685d1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:44.137332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b77ed6fb-3e36-4611-90c4-bc1cd40685d1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:44.196584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b77ed6fb-3e36-4611-90c4-bc1cd40685d1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:44.204682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b77ed6fb-3e36-4611-90c4-bc1cd40685d1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081084 Sep 02 10:00:44.205246 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 792/1663] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:44 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:44.759530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-27193ae7-f3f0-4451-b4d1-b1fdbd7832e9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:44.760138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-27193ae7-f3f0-4451-b4d1-b1fdbd7832e9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:44.766985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27193ae7-f3f0-4451-b4d1-b1fdbd7832e9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:44.767465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27193ae7-f3f0-4451-b4d1-b1fdbd7832e9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:44.767894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27193ae7-f3f0-4451-b4d1-b1fdbd7832e9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:44.768570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27193ae7-f3f0-4451-b4d1-b1fdbd7832e9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:44.769015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27193ae7-f3f0-4451-b4d1-b1fdbd7832e9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:44.769433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27193ae7-f3f0-4451-b4d1-b1fdbd7832e9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:44.897694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-27193ae7-f3f0-4451-b4d1-b1fdbd7832e9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:44.905723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-27193ae7-f3f0-4451-b4d1-b1fdbd7832e9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150045 Sep 02 10:00:44.906279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 872/1664] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:44 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:45.225183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e8742415-dd20-41c6-82bd-233cc78a8a71 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:45.225796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e8742415-dd20-41c6-82bd-233cc78a8a71 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:45.232407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8742415-dd20-41c6-82bd-233cc78a8a71 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:45.232913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8742415-dd20-41c6-82bd-233cc78a8a71 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:45.233821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8742415-dd20-41c6-82bd-233cc78a8a71 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:45.234506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8742415-dd20-41c6-82bd-233cc78a8a71 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:45.235007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8742415-dd20-41c6-82bd-233cc78a8a71 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:45.235427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8742415-dd20-41c6-82bd-233cc78a8a71 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:45.296822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e8742415-dd20-41c6-82bd-233cc78a8a71 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:45.304758 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e8742415-dd20-41c6-82bd-233cc78a8a71 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083488 Sep 02 10:00:45.305313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 793/1665] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:45 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:45.926668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ef528ed3-c765-4686-8d60-128552fcb3d9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:45.927315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ef528ed3-c765-4686-8d60-128552fcb3d9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:45.933780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef528ed3-c765-4686-8d60-128552fcb3d9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:45.934259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef528ed3-c765-4686-8d60-128552fcb3d9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:45.934694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef528ed3-c765-4686-8d60-128552fcb3d9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:45.935395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef528ed3-c765-4686-8d60-128552fcb3d9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:45.935867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef528ed3-c765-4686-8d60-128552fcb3d9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:45.936290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef528ed3-c765-4686-8d60-128552fcb3d9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:46.063643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ef528ed3-c765-4686-8d60-128552fcb3d9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:46.071656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ef528ed3-c765-4686-8d60-128552fcb3d9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148923 Sep 02 10:00:46.072212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 873/1666] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:45 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:46.325903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-016606a5-e084-4951-841a-cdc3ad719403 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:46.326414 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-016606a5-e084-4951-841a-cdc3ad719403 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:46.333399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-016606a5-e084-4951-841a-cdc3ad719403 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:46.333885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-016606a5-e084-4951-841a-cdc3ad719403 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:46.334315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-016606a5-e084-4951-841a-cdc3ad719403 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:46.335028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-016606a5-e084-4951-841a-cdc3ad719403 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:46.335479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-016606a5-e084-4951-841a-cdc3ad719403 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:46.335900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-016606a5-e084-4951-841a-cdc3ad719403 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:46.398754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-016606a5-e084-4951-841a-cdc3ad719403 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:46.406931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-016606a5-e084-4951-841a-cdc3ad719403 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084912 Sep 02 10:00:46.407485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 794/1667] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:46 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:47.093160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3a8ba75f-407f-465c-910a-c77d64ddc8a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:47.093720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3a8ba75f-407f-465c-910a-c77d64ddc8a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:47.100125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a8ba75f-407f-465c-910a-c77d64ddc8a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:47.100604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a8ba75f-407f-465c-910a-c77d64ddc8a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:47.101067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a8ba75f-407f-465c-910a-c77d64ddc8a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:47.101746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a8ba75f-407f-465c-910a-c77d64ddc8a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:47.102191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a8ba75f-407f-465c-910a-c77d64ddc8a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:47.102608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a8ba75f-407f-465c-910a-c77d64ddc8a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:47.231389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3a8ba75f-407f-465c-910a-c77d64ddc8a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:47.240067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3a8ba75f-407f-465c-910a-c77d64ddc8a7 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151366 Sep 02 10:00:47.240624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 874/1668] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:47 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:47.427419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-79a410cd-86f5-4d3c-b44f-f0e0156d2946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:47.427984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-79a410cd-86f5-4d3c-b44f-f0e0156d2946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:47.434293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79a410cd-86f5-4d3c-b44f-f0e0156d2946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:47.434800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79a410cd-86f5-4d3c-b44f-f0e0156d2946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:47.435233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79a410cd-86f5-4d3c-b44f-f0e0156d2946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:47.435905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79a410cd-86f5-4d3c-b44f-f0e0156d2946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:47.436356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79a410cd-86f5-4d3c-b44f-f0e0156d2946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:47.436779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79a410cd-86f5-4d3c-b44f-f0e0156d2946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:47.496250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-79a410cd-86f5-4d3c-b44f-f0e0156d2946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:47.504309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-79a410cd-86f5-4d3c-b44f-f0e0156d2946 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.080818 Sep 02 10:00:47.505119 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 795/1669] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:47 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:48.260955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ec1e26b8-46ae-43bc-af98-3d0d259d85a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:48.261499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ec1e26b8-46ae-43bc-af98-3d0d259d85a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:48.267911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ec1e26b8-46ae-43bc-af98-3d0d259d85a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:48.268391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ec1e26b8-46ae-43bc-af98-3d0d259d85a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:48.268827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ec1e26b8-46ae-43bc-af98-3d0d259d85a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:48.269511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ec1e26b8-46ae-43bc-af98-3d0d259d85a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:48.269965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ec1e26b8-46ae-43bc-af98-3d0d259d85a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:48.270389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ec1e26b8-46ae-43bc-af98-3d0d259d85a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:48.395335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ec1e26b8-46ae-43bc-af98-3d0d259d85a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:48.403793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ec1e26b8-46ae-43bc-af98-3d0d259d85a6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.146817 Sep 02 10:00:48.404416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 875/1670] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:48 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:48.525055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8cb18a68-788b-467e-b702-c425ac03a351 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:48.525580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8cb18a68-788b-467e-b702-c425ac03a351 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:48.527905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=56 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:48.533173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cb18a68-788b-467e-b702-c425ac03a351 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:48.533652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cb18a68-788b-467e-b702-c425ac03a351 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:48.534095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cb18a68-788b-467e-b702-c425ac03a351 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:48.534784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cb18a68-788b-467e-b702-c425ac03a351 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:48.535236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cb18a68-788b-467e-b702-c425ac03a351 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:48.540295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8cb18a68-788b-467e-b702-c425ac03a351 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:48.595811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8cb18a68-788b-467e-b702-c425ac03a351 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:48.603799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8cb18a68-788b-467e-b702-c425ac03a351 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082694 Sep 02 10:00:48.604361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 796/1671] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:48 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:49.424182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-db05d822-bb83-4c3a-b725-e4d956b9bf08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:49.424789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-db05d822-bb83-4c3a-b725-e4d956b9bf08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:49.431235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db05d822-bb83-4c3a-b725-e4d956b9bf08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:49.431718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db05d822-bb83-4c3a-b725-e4d956b9bf08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:49.432157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db05d822-bb83-4c3a-b725-e4d956b9bf08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:49.432848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db05d822-bb83-4c3a-b725-e4d956b9bf08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:49.433301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db05d822-bb83-4c3a-b725-e4d956b9bf08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:49.433727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db05d822-bb83-4c3a-b725-e4d956b9bf08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:49.559676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-db05d822-bb83-4c3a-b725-e4d956b9bf08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:49.568210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-db05d822-bb83-4c3a-b725-e4d956b9bf08 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147919 Sep 02 10:00:49.568783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 876/1672] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:49 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:49.624872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-83f3d9a4-154c-48aa-81e4-9b76d3a9f05a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:49.626125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-83f3d9a4-154c-48aa-81e4-9b76d3a9f05a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:49.632868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83f3d9a4-154c-48aa-81e4-9b76d3a9f05a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:49.633348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83f3d9a4-154c-48aa-81e4-9b76d3a9f05a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:49.633780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83f3d9a4-154c-48aa-81e4-9b76d3a9f05a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:49.634458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83f3d9a4-154c-48aa-81e4-9b76d3a9f05a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:49.634948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83f3d9a4-154c-48aa-81e4-9b76d3a9f05a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:49.635370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83f3d9a4-154c-48aa-81e4-9b76d3a9f05a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:49.696364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-83f3d9a4-154c-48aa-81e4-9b76d3a9f05a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:49.704646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-83f3d9a4-154c-48aa-81e4-9b76d3a9f05a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083639 Sep 02 10:00:49.705240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 797/1673] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:49 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:50.589759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9a275393-df00-4f55-8fab-58292a36a216 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:50.590374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9a275393-df00-4f55-8fab-58292a36a216 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:50.596991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a275393-df00-4f55-8fab-58292a36a216 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:50.597715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a275393-df00-4f55-8fab-58292a36a216 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:50.598163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a275393-df00-4f55-8fab-58292a36a216 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:50.598890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a275393-df00-4f55-8fab-58292a36a216 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:50.599341 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a275393-df00-4f55-8fab-58292a36a216 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:50.599764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a275393-df00-4f55-8fab-58292a36a216 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:50.725768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-77277360-cc14-44ba-949b-d660f3228f09 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:50.726389 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-77277360-cc14-44ba-949b-d660f3228f09 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:50.733208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77277360-cc14-44ba-949b-d660f3228f09 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:50.733699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77277360-cc14-44ba-949b-d660f3228f09 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:50.734150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77277360-cc14-44ba-949b-d660f3228f09 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:50.735372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77277360-cc14-44ba-949b-d660f3228f09 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:50.735828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77277360-cc14-44ba-949b-d660f3228f09 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:50.736268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77277360-cc14-44ba-949b-d660f3228f09 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:50.804085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-77277360-cc14-44ba-949b-d660f3228f09 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:50.813216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-77277360-cc14-44ba-949b-d660f3228f09 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.091346 Sep 02 10:00:50.813813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 798/1674] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:50 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:50.962943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9a275393-df00-4f55-8fab-58292a36a216 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:50.971535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9a275393-df00-4f55-8fab-58292a36a216 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.385798 Sep 02 10:00:50.972094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 877/1675] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:50 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:51.834695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-68652282-c437-4a01-83ed-f7681cb19df2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:51.835313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-68652282-c437-4a01-83ed-f7681cb19df2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:51.841808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68652282-c437-4a01-83ed-f7681cb19df2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:51.842244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68652282-c437-4a01-83ed-f7681cb19df2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:51.842677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68652282-c437-4a01-83ed-f7681cb19df2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:51.843394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68652282-c437-4a01-83ed-f7681cb19df2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:51.843849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68652282-c437-4a01-83ed-f7681cb19df2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:51.844758 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-68652282-c437-4a01-83ed-f7681cb19df2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:51.910225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-68652282-c437-4a01-83ed-f7681cb19df2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:51.918622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-68652282-c437-4a01-83ed-f7681cb19df2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087807 Sep 02 10:00:51.919222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 799/1676] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:51 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:51.992879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b1603ec2-f898-412a-8e0a-aaec26f6a93f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:51.993486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b1603ec2-f898-412a-8e0a-aaec26f6a93f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:51.999905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1603ec2-f898-412a-8e0a-aaec26f6a93f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:52.001035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1603ec2-f898-412a-8e0a-aaec26f6a93f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:52.001035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1603ec2-f898-412a-8e0a-aaec26f6a93f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:52.001534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1603ec2-f898-412a-8e0a-aaec26f6a93f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:52.001980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1603ec2-f898-412a-8e0a-aaec26f6a93f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:52.002406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b1603ec2-f898-412a-8e0a-aaec26f6a93f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:52.129252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b1603ec2-f898-412a-8e0a-aaec26f6a93f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:52.137650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b1603ec2-f898-412a-8e0a-aaec26f6a93f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148629 Sep 02 10:00:52.138207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 878/1677] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:51 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:52.940201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-df250d2e-a75c-42fd-87eb-64be365135ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:52.940807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-df250d2e-a75c-42fd-87eb-64be365135ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:52.947190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df250d2e-a75c-42fd-87eb-64be365135ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:52.947669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df250d2e-a75c-42fd-87eb-64be365135ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:52.948105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df250d2e-a75c-42fd-87eb-64be365135ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:52.948782 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df250d2e-a75c-42fd-87eb-64be365135ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:52.949230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df250d2e-a75c-42fd-87eb-64be365135ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:52.949648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df250d2e-a75c-42fd-87eb-64be365135ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:53.010784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-df250d2e-a75c-42fd-87eb-64be365135ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:53.018964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-df250d2e-a75c-42fd-87eb-64be365135ef tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083133 Sep 02 10:00:53.019517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 800/1678] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:52 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:53.159580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c7287b68-d950-4644-8a85-36fe9928da3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:53.160117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c7287b68-d950-4644-8a85-36fe9928da3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:53.166582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7287b68-d950-4644-8a85-36fe9928da3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:53.167102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7287b68-d950-4644-8a85-36fe9928da3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:53.167540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7287b68-d950-4644-8a85-36fe9928da3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:53.168235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7287b68-d950-4644-8a85-36fe9928da3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:53.168689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7287b68-d950-4644-8a85-36fe9928da3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:53.169118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7287b68-d950-4644-8a85-36fe9928da3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:53.298665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c7287b68-d950-4644-8a85-36fe9928da3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:53.306950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c7287b68-d950-4644-8a85-36fe9928da3d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151871 Sep 02 10:00:53.307514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 879/1679] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:53 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:54.040001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ba34c545-fbc9-479a-b25f-5d70f9b30efe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:54.040577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ba34c545-fbc9-479a-b25f-5d70f9b30efe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:54.047108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba34c545-fbc9-479a-b25f-5d70f9b30efe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:54.047597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba34c545-fbc9-479a-b25f-5d70f9b30efe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:54.048034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba34c545-fbc9-479a-b25f-5d70f9b30efe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:54.048720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba34c545-fbc9-479a-b25f-5d70f9b30efe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:54.049211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba34c545-fbc9-479a-b25f-5d70f9b30efe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:54.049638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba34c545-fbc9-479a-b25f-5d70f9b30efe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:54.109929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ba34c545-fbc9-479a-b25f-5d70f9b30efe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:54.118029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ba34c545-fbc9-479a-b25f-5d70f9b30efe tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081966 Sep 02 10:00:54.118595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 801/1680] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:54 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:54.327696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-478229c8-c3d6-4090-9508-8aa2b99c6c20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:54.328300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-478229c8-c3d6-4090-9508-8aa2b99c6c20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:54.335605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-478229c8-c3d6-4090-9508-8aa2b99c6c20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:54.336083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-478229c8-c3d6-4090-9508-8aa2b99c6c20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:54.336512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-478229c8-c3d6-4090-9508-8aa2b99c6c20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:54.337195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-478229c8-c3d6-4090-9508-8aa2b99c6c20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:54.337639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-478229c8-c3d6-4090-9508-8aa2b99c6c20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:54.338057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-478229c8-c3d6-4090-9508-8aa2b99c6c20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:54.466063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-478229c8-c3d6-4090-9508-8aa2b99c6c20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:54.474543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-478229c8-c3d6-4090-9508-8aa2b99c6c20 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150446 Sep 02 10:00:54.475218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 880/1681] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:54 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:55.139176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d5915dbd-07b4-48e5-b58e-fce0e960577f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:55.139785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d5915dbd-07b4-48e5-b58e-fce0e960577f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:55.146617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5915dbd-07b4-48e5-b58e-fce0e960577f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:55.147130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5915dbd-07b4-48e5-b58e-fce0e960577f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:55.147562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5915dbd-07b4-48e5-b58e-fce0e960577f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:55.148239 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5915dbd-07b4-48e5-b58e-fce0e960577f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:55.148686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5915dbd-07b4-48e5-b58e-fce0e960577f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:55.149104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d5915dbd-07b4-48e5-b58e-fce0e960577f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:55.210933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d5915dbd-07b4-48e5-b58e-fce0e960577f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:55.219584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d5915dbd-07b4-48e5-b58e-fce0e960577f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083549 Sep 02 10:00:55.220142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 802/1682] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:55 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:55.499120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a5cda5a5-a860-4913-9361-60419e0c7148 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:55.499689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a5cda5a5-a860-4913-9361-60419e0c7148 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:55.506226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5cda5a5-a860-4913-9361-60419e0c7148 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:55.510797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5cda5a5-a860-4913-9361-60419e0c7148 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:55.510797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5cda5a5-a860-4913-9361-60419e0c7148 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:55.510797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5cda5a5-a860-4913-9361-60419e0c7148 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:55.510797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5cda5a5-a860-4913-9361-60419e0c7148 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:55.511220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5cda5a5-a860-4913-9361-60419e0c7148 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:55.523293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:55.638030 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a5cda5a5-a860-4913-9361-60419e0c7148 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:55.646630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a5cda5a5-a860-4913-9361-60419e0c7148 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151458 Sep 02 10:00:55.647373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 881/1683] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:55 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:56.239662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-971aba9b-c90f-4eb3-a49b-e06061592ea4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:56.240177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-971aba9b-c90f-4eb3-a49b-e06061592ea4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:56.246608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-971aba9b-c90f-4eb3-a49b-e06061592ea4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:56.247120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-971aba9b-c90f-4eb3-a49b-e06061592ea4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:56.247549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-971aba9b-c90f-4eb3-a49b-e06061592ea4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:56.248225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-971aba9b-c90f-4eb3-a49b-e06061592ea4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:56.248676 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-971aba9b-c90f-4eb3-a49b-e06061592ea4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:56.249115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-971aba9b-c90f-4eb3-a49b-e06061592ea4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:56.309149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-971aba9b-c90f-4eb3-a49b-e06061592ea4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:56.317611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-971aba9b-c90f-4eb3-a49b-e06061592ea4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081913 Sep 02 10:00:56.318167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 803/1684] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:56 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:56.668091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c673d156-dc4c-4ce2-876d-8d4c13cbead2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:56.668702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c673d156-dc4c-4ce2-876d-8d4c13cbead2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:56.675648 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c673d156-dc4c-4ce2-876d-8d4c13cbead2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:56.676129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c673d156-dc4c-4ce2-876d-8d4c13cbead2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:56.676565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c673d156-dc4c-4ce2-876d-8d4c13cbead2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:56.677251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c673d156-dc4c-4ce2-876d-8d4c13cbead2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:56.677720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c673d156-dc4c-4ce2-876d-8d4c13cbead2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:56.678122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c673d156-dc4c-4ce2-876d-8d4c13cbead2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:56.807680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c673d156-dc4c-4ce2-876d-8d4c13cbead2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:56.815774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c673d156-dc4c-4ce2-876d-8d4c13cbead2 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151670 Sep 02 10:00:56.816343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 882/1685] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:56 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:57.337607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aec90d67-d6ba-4f14-9258-72577824d473 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:57.338214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aec90d67-d6ba-4f14-9258-72577824d473 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:57.345455 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec90d67-d6ba-4f14-9258-72577824d473 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:57.345934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec90d67-d6ba-4f14-9258-72577824d473 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:57.346367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec90d67-d6ba-4f14-9258-72577824d473 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:57.347082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec90d67-d6ba-4f14-9258-72577824d473 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:57.347534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec90d67-d6ba-4f14-9258-72577824d473 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:57.347955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aec90d67-d6ba-4f14-9258-72577824d473 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:57.407599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-aec90d67-d6ba-4f14-9258-72577824d473 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:57.415585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aec90d67-d6ba-4f14-9258-72577824d473 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081868 Sep 02 10:00:57.416158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 804/1686] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:57 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:57.835888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1551029f-cf91-4326-830d-1b70f65f9efb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:57.836495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1551029f-cf91-4326-830d-1b70f65f9efb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:57.843036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1551029f-cf91-4326-830d-1b70f65f9efb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:57.843519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1551029f-cf91-4326-830d-1b70f65f9efb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:57.843953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1551029f-cf91-4326-830d-1b70f65f9efb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:57.844639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1551029f-cf91-4326-830d-1b70f65f9efb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:57.845085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1551029f-cf91-4326-830d-1b70f65f9efb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:57.845485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1551029f-cf91-4326-830d-1b70f65f9efb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:57.972755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1551029f-cf91-4326-830d-1b70f65f9efb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:57.980752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1551029f-cf91-4326-830d-1b70f65f9efb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148746 Sep 02 10:00:57.981311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 883/1687] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:57 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:58.436182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b9f24f32-e029-4186-9ee4-47b6cdfa3044 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:58.436824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b9f24f32-e029-4186-9ee4-47b6cdfa3044 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:58.443912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9f24f32-e029-4186-9ee4-47b6cdfa3044 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:58.444390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9f24f32-e029-4186-9ee4-47b6cdfa3044 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:58.444822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9f24f32-e029-4186-9ee4-47b6cdfa3044 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:58.445499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9f24f32-e029-4186-9ee4-47b6cdfa3044 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:58.445950 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9f24f32-e029-4186-9ee4-47b6cdfa3044 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:58.446363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9f24f32-e029-4186-9ee4-47b6cdfa3044 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:58.506435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b9f24f32-e029-4186-9ee4-47b6cdfa3044 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:58.514505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b9f24f32-e029-4186-9ee4-47b6cdfa3044 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082165 Sep 02 10:00:58.515093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 805/1688] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:58 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:59.003002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8c782f86-4355-45b7-bc8d-318d0e0b94a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:59.003641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8c782f86-4355-45b7-bc8d-318d0e0b94a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:59.010604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c782f86-4355-45b7-bc8d-318d0e0b94a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:59.011145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c782f86-4355-45b7-bc8d-318d0e0b94a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:59.011615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c782f86-4355-45b7-bc8d-318d0e0b94a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:59.012298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c782f86-4355-45b7-bc8d-318d0e0b94a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:59.012753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c782f86-4355-45b7-bc8d-318d0e0b94a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:59.013176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c782f86-4355-45b7-bc8d-318d0e0b94a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:59.144188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8c782f86-4355-45b7-bc8d-318d0e0b94a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:59.152440 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8c782f86-4355-45b7-bc8d-318d0e0b94a3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.154105 Sep 02 10:00:59.156956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 884/1689] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:58 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:00:59.536021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e06da378-7d27-4ed5-9485-a795a9614f7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:00:59.536555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e06da378-7d27-4ed5-9485-a795a9614f7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:00:59.542899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06da378-7d27-4ed5-9485-a795a9614f7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:59.543377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06da378-7d27-4ed5-9485-a795a9614f7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:59.543804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06da378-7d27-4ed5-9485-a795a9614f7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:59.544476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06da378-7d27-4ed5-9485-a795a9614f7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:00:59.544921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06da378-7d27-4ed5-9485-a795a9614f7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:00:59.545339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06da378-7d27-4ed5-9485-a795a9614f7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:00:59.611710 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e06da378-7d27-4ed5-9485-a795a9614f7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:00:59.613883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:00:59.620267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e06da378-7d27-4ed5-9485-a795a9614f7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.088812 Sep 02 10:00:59.620826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 806/1690] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:00:59 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:00.174053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4cb78571-19f4-4881-a5cc-2d37bad2c057 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:00.174606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4cb78571-19f4-4881-a5cc-2d37bad2c057 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:00.181231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cb78571-19f4-4881-a5cc-2d37bad2c057 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:00.181588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cb78571-19f4-4881-a5cc-2d37bad2c057 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:00.182028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cb78571-19f4-4881-a5cc-2d37bad2c057 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:00.182736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cb78571-19f4-4881-a5cc-2d37bad2c057 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:00.183194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cb78571-19f4-4881-a5cc-2d37bad2c057 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:00.183619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cb78571-19f4-4881-a5cc-2d37bad2c057 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:00.313367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4cb78571-19f4-4881-a5cc-2d37bad2c057 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:00.321644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4cb78571-19f4-4881-a5cc-2d37bad2c057 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152117 Sep 02 10:01:00.322416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 885/1691] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:00 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:00.651331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bdc52fee-6b1d-4d06-8a49-ed562386c3a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:00.651940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bdc52fee-6b1d-4d06-8a49-ed562386c3a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:00.659485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bdc52fee-6b1d-4d06-8a49-ed562386c3a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:00.659963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bdc52fee-6b1d-4d06-8a49-ed562386c3a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:00.660390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bdc52fee-6b1d-4d06-8a49-ed562386c3a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:00.661064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bdc52fee-6b1d-4d06-8a49-ed562386c3a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:00.661511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bdc52fee-6b1d-4d06-8a49-ed562386c3a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:00.661929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bdc52fee-6b1d-4d06-8a49-ed562386c3a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:00.965029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bdc52fee-6b1d-4d06-8a49-ed562386c3a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:00.973867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bdc52fee-6b1d-4d06-8a49-ed562386c3a9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.326415 Sep 02 10:01:00.974437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 807/1692] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:00 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:01.342585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-baef800a-27f6-4c2a-a764-1df597b90a5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:01.343145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-baef800a-27f6-4c2a-a764-1df597b90a5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:01.349526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baef800a-27f6-4c2a-a764-1df597b90a5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:01.350028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baef800a-27f6-4c2a-a764-1df597b90a5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:01.350455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baef800a-27f6-4c2a-a764-1df597b90a5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:01.351168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baef800a-27f6-4c2a-a764-1df597b90a5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:01.351627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baef800a-27f6-4c2a-a764-1df597b90a5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:01.352055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-baef800a-27f6-4c2a-a764-1df597b90a5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:01.481018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-baef800a-27f6-4c2a-a764-1df597b90a5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:01.489302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-baef800a-27f6-4c2a-a764-1df597b90a5a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150598 Sep 02 10:01:01.489871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 886/1693] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:01 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:01.994840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-766383bb-fb95-44f1-9785-681c53f8eae8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:01.995451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-766383bb-fb95-44f1-9785-681c53f8eae8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:02.002331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-766383bb-fb95-44f1-9785-681c53f8eae8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:02.002847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-766383bb-fb95-44f1-9785-681c53f8eae8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:02.003286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-766383bb-fb95-44f1-9785-681c53f8eae8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:02.003968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-766383bb-fb95-44f1-9785-681c53f8eae8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:02.004679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-766383bb-fb95-44f1-9785-681c53f8eae8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:02.005128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-766383bb-fb95-44f1-9785-681c53f8eae8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:02.064651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-766383bb-fb95-44f1-9785-681c53f8eae8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:02.072705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-766383bb-fb95-44f1-9785-681c53f8eae8 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081947 Sep 02 10:01:02.073258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 808/1694] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:01 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:02.511010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7ed9fe09-19ed-4f7f-afe5-fb30619bd3ff tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:02.511629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7ed9fe09-19ed-4f7f-afe5-fb30619bd3ff tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:02.518629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ed9fe09-19ed-4f7f-afe5-fb30619bd3ff tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:02.519147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ed9fe09-19ed-4f7f-afe5-fb30619bd3ff tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:02.519582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ed9fe09-19ed-4f7f-afe5-fb30619bd3ff tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:02.520269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ed9fe09-19ed-4f7f-afe5-fb30619bd3ff tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:02.520721 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ed9fe09-19ed-4f7f-afe5-fb30619bd3ff tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:02.521147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ed9fe09-19ed-4f7f-afe5-fb30619bd3ff tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:02.646244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7ed9fe09-19ed-4f7f-afe5-fb30619bd3ff tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:02.654325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7ed9fe09-19ed-4f7f-afe5-fb30619bd3ff tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147319 Sep 02 10:01:02.654911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 887/1695] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:02 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:03.093199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-69e2a135-abc0-4e16-a48d-c09b4a28d8f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:03.093814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-69e2a135-abc0-4e16-a48d-c09b4a28d8f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:03.099883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69e2a135-abc0-4e16-a48d-c09b4a28d8f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:03.100363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69e2a135-abc0-4e16-a48d-c09b4a28d8f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:03.100854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69e2a135-abc0-4e16-a48d-c09b4a28d8f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:03.101539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69e2a135-abc0-4e16-a48d-c09b4a28d8f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:03.102042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69e2a135-abc0-4e16-a48d-c09b4a28d8f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:03.102464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-69e2a135-abc0-4e16-a48d-c09b4a28d8f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:03.163982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-69e2a135-abc0-4e16-a48d-c09b4a28d8f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:03.172680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-69e2a135-abc0-4e16-a48d-c09b4a28d8f5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083333 Sep 02 10:01:03.173257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 809/1696] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:03 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:03.675779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-70dfebbb-bac8-46d1-8b53-a8ce44849468 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:03.676367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-70dfebbb-bac8-46d1-8b53-a8ce44849468 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:03.682776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70dfebbb-bac8-46d1-8b53-a8ce44849468 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:03.683251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70dfebbb-bac8-46d1-8b53-a8ce44849468 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:03.683680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70dfebbb-bac8-46d1-8b53-a8ce44849468 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:03.684351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70dfebbb-bac8-46d1-8b53-a8ce44849468 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:03.684793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70dfebbb-bac8-46d1-8b53-a8ce44849468 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:03.685211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-70dfebbb-bac8-46d1-8b53-a8ce44849468 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:03.815327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-70dfebbb-bac8-46d1-8b53-a8ce44849468 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:03.824714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-70dfebbb-bac8-46d1-8b53-a8ce44849468 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153394 Sep 02 10:01:03.825283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 888/1697] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:03 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:04.193225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ef9f6ca8-dbd9-4424-a9b6-8bf4972d0495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:04.193850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ef9f6ca8-dbd9-4424-a9b6-8bf4972d0495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:04.200719 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9f6ca8-dbd9-4424-a9b6-8bf4972d0495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:04.201209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9f6ca8-dbd9-4424-a9b6-8bf4972d0495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:04.201650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9f6ca8-dbd9-4424-a9b6-8bf4972d0495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:04.202343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9f6ca8-dbd9-4424-a9b6-8bf4972d0495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:04.203339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9f6ca8-dbd9-4424-a9b6-8bf4972d0495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:04.203780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef9f6ca8-dbd9-4424-a9b6-8bf4972d0495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:04.263823 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ef9f6ca8-dbd9-4424-a9b6-8bf4972d0495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:04.272671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ef9f6ca8-dbd9-4424-a9b6-8bf4972d0495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083329 Sep 02 10:01:04.273242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 810/1698] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:04 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:04.845455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-54f1fcd2-4eef-440b-9648-7737c1d4826f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:04.846103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-54f1fcd2-4eef-440b-9648-7737c1d4826f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:04.852462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f1fcd2-4eef-440b-9648-7737c1d4826f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:04.852935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f1fcd2-4eef-440b-9648-7737c1d4826f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:04.853365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f1fcd2-4eef-440b-9648-7737c1d4826f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:04.854041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f1fcd2-4eef-440b-9648-7737c1d4826f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:04.854487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f1fcd2-4eef-440b-9648-7737c1d4826f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:04.854942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f1fcd2-4eef-440b-9648-7737c1d4826f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:04.984723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-54f1fcd2-4eef-440b-9648-7737c1d4826f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:04.992749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-54f1fcd2-4eef-440b-9648-7737c1d4826f tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151203 Sep 02 10:01:04.993289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 889/1699] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:04 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:05.292543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a6cfaa5a-98e1-4cc1-ba09-29ea0f358232 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:05.293155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a6cfaa5a-98e1-4cc1-ba09-29ea0f358232 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:05.300312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6cfaa5a-98e1-4cc1-ba09-29ea0f358232 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:05.300803 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6cfaa5a-98e1-4cc1-ba09-29ea0f358232 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:05.301241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6cfaa5a-98e1-4cc1-ba09-29ea0f358232 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:05.301926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6cfaa5a-98e1-4cc1-ba09-29ea0f358232 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:05.302381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6cfaa5a-98e1-4cc1-ba09-29ea0f358232 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:05.302838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a6cfaa5a-98e1-4cc1-ba09-29ea0f358232 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:05.364729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a6cfaa5a-98e1-4cc1-ba09-29ea0f358232 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:05.372973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a6cfaa5a-98e1-4cc1-ba09-29ea0f358232 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084306 Sep 02 10:01:05.373539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 811/1700] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:05 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:06.014491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-38e93799-df9f-433b-ad29-4eb9e3edf31a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:06.015147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-38e93799-df9f-433b-ad29-4eb9e3edf31a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:06.022037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38e93799-df9f-433b-ad29-4eb9e3edf31a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:06.022519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38e93799-df9f-433b-ad29-4eb9e3edf31a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:06.022992 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38e93799-df9f-433b-ad29-4eb9e3edf31a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:06.023672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38e93799-df9f-433b-ad29-4eb9e3edf31a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:06.024116 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38e93799-df9f-433b-ad29-4eb9e3edf31a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:06.024534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38e93799-df9f-433b-ad29-4eb9e3edf31a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:06.153152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-38e93799-df9f-433b-ad29-4eb9e3edf31a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:06.161902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-38e93799-df9f-433b-ad29-4eb9e3edf31a tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151371 Sep 02 10:01:06.162475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 890/1701] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:06 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:06.393804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7c19157f-8044-4f27-9476-00214af3347e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:06.394345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7c19157f-8044-4f27-9476-00214af3347e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:06.400718 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c19157f-8044-4f27-9476-00214af3347e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:06.401189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c19157f-8044-4f27-9476-00214af3347e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:06.401618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c19157f-8044-4f27-9476-00214af3347e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:06.402298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c19157f-8044-4f27-9476-00214af3347e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:06.402766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c19157f-8044-4f27-9476-00214af3347e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:06.403188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c19157f-8044-4f27-9476-00214af3347e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:06.464634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7c19157f-8044-4f27-9476-00214af3347e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:06.472814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7c19157f-8044-4f27-9476-00214af3347e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082997 Sep 02 10:01:06.473383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 812/1702] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:06 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:07.183190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bb33350a-07f4-4ab5-a1a9-b15ef47bccd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:07.183802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bb33350a-07f4-4ab5-a1a9-b15ef47bccd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:07.190196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb33350a-07f4-4ab5-a1a9-b15ef47bccd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:07.190679 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb33350a-07f4-4ab5-a1a9-b15ef47bccd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:07.191147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb33350a-07f4-4ab5-a1a9-b15ef47bccd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:07.191831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb33350a-07f4-4ab5-a1a9-b15ef47bccd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:07.192280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb33350a-07f4-4ab5-a1a9-b15ef47bccd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:07.192704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb33350a-07f4-4ab5-a1a9-b15ef47bccd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:07.319155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bb33350a-07f4-4ab5-a1a9-b15ef47bccd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:07.327209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bb33350a-07f4-4ab5-a1a9-b15ef47bccd1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147838 Sep 02 10:01:07.328365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 891/1703] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:07 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:07.494006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-35092959-1402-4d38-becc-13fa827ba65a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:07.494533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-35092959-1402-4d38-becc-13fa827ba65a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:07.501374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35092959-1402-4d38-becc-13fa827ba65a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:07.501852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35092959-1402-4d38-becc-13fa827ba65a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:07.502280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35092959-1402-4d38-becc-13fa827ba65a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:07.502991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35092959-1402-4d38-becc-13fa827ba65a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:07.503446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35092959-1402-4d38-becc-13fa827ba65a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:07.504122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-35092959-1402-4d38-becc-13fa827ba65a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:07.565133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-35092959-1402-4d38-becc-13fa827ba65a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:07.573213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-35092959-1402-4d38-becc-13fa827ba65a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083168 Sep 02 10:01:07.573776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 813/1704] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:07 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:08.349228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-318eee0f-0a5f-48de-a2b3-c6290c8975ca tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:08.349833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-318eee0f-0a5f-48de-a2b3-c6290c8975ca tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:08.355889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-318eee0f-0a5f-48de-a2b3-c6290c8975ca tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:08.356379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-318eee0f-0a5f-48de-a2b3-c6290c8975ca tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:08.356817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-318eee0f-0a5f-48de-a2b3-c6290c8975ca tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:08.357505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-318eee0f-0a5f-48de-a2b3-c6290c8975ca tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:08.357967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-318eee0f-0a5f-48de-a2b3-c6290c8975ca tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:08.358421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-318eee0f-0a5f-48de-a2b3-c6290c8975ca tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:08.484996 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-318eee0f-0a5f-48de-a2b3-c6290c8975ca tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:08.493190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-318eee0f-0a5f-48de-a2b3-c6290c8975ca tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148102 Sep 02 10:01:08.495016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 892/1705] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:08 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:08.594828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cb2e41ed-d7e4-4540-9055-025dd494cb64 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:08.595440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cb2e41ed-d7e4-4540-9055-025dd494cb64 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:08.601905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb2e41ed-d7e4-4540-9055-025dd494cb64 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:08.602326 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb2e41ed-d7e4-4540-9055-025dd494cb64 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:08.602779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb2e41ed-d7e4-4540-9055-025dd494cb64 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:08.603463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb2e41ed-d7e4-4540-9055-025dd494cb64 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:08.603917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb2e41ed-d7e4-4540-9055-025dd494cb64 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:08.604339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb2e41ed-d7e4-4540-9055-025dd494cb64 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:08.665055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cb2e41ed-d7e4-4540-9055-025dd494cb64 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:08.673569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cb2e41ed-d7e4-4540-9055-025dd494cb64 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083225 Sep 02 10:01:08.674152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 814/1706] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:08 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:09.514291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ebf0e754-a0e5-405b-88c0-0206e4a37aea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:09.514908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ebf0e754-a0e5-405b-88c0-0206e4a37aea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:09.521875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebf0e754-a0e5-405b-88c0-0206e4a37aea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:09.522355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebf0e754-a0e5-405b-88c0-0206e4a37aea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:09.522822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebf0e754-a0e5-405b-88c0-0206e4a37aea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:09.523511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebf0e754-a0e5-405b-88c0-0206e4a37aea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:09.523964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebf0e754-a0e5-405b-88c0-0206e4a37aea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:09.524385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebf0e754-a0e5-405b-88c0-0206e4a37aea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:09.653925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ebf0e754-a0e5-405b-88c0-0206e4a37aea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:09.662028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ebf0e754-a0e5-405b-88c0-0206e4a37aea tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.151672 Sep 02 10:01:09.662580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 893/1707] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:09 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:09.693627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bb7e3285-882b-4aa0-be5a-27897c5df329 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:09.694235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bb7e3285-882b-4aa0-be5a-27897c5df329 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:09.700674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb7e3285-882b-4aa0-be5a-27897c5df329 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:09.701151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb7e3285-882b-4aa0-be5a-27897c5df329 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:09.701583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb7e3285-882b-4aa0-be5a-27897c5df329 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:09.702268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb7e3285-882b-4aa0-be5a-27897c5df329 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:09.703422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb7e3285-882b-4aa0-be5a-27897c5df329 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:09.703848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb7e3285-882b-4aa0-be5a-27897c5df329 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:09.766194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb7e3285-882b-4aa0-be5a-27897c5df329 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:09.774168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bb7e3285-882b-4aa0-be5a-27897c5df329 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084342 Sep 02 10:01:09.774739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 815/1708] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:09 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:10.682643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-20db85e4-4349-4371-8dd7-d93f445c6599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:10.683279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-20db85e4-4349-4371-8dd7-d93f445c6599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:10.689745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20db85e4-4349-4371-8dd7-d93f445c6599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:10.690229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20db85e4-4349-4371-8dd7-d93f445c6599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:10.690667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20db85e4-4349-4371-8dd7-d93f445c6599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:10.691381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20db85e4-4349-4371-8dd7-d93f445c6599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:10.691836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20db85e4-4349-4371-8dd7-d93f445c6599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:10.692262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20db85e4-4349-4371-8dd7-d93f445c6599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:10.794314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ad97683e-c82e-4080-a28d-ab892a0682bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:10.794953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ad97683e-c82e-4080-a28d-ab892a0682bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:10.801407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad97683e-c82e-4080-a28d-ab892a0682bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:10.801887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad97683e-c82e-4080-a28d-ab892a0682bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:10.802321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad97683e-c82e-4080-a28d-ab892a0682bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:10.803043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad97683e-c82e-4080-a28d-ab892a0682bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:10.803493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad97683e-c82e-4080-a28d-ab892a0682bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:10.803915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ad97683e-c82e-4080-a28d-ab892a0682bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:10.820048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-20db85e4-4349-4371-8dd7-d93f445c6599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:10.828676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-20db85e4-4349-4371-8dd7-d93f445c6599 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.150019 Sep 02 10:01:10.829254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 894/1709] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:10 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:10.868690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ad97683e-c82e-4080-a28d-ab892a0682bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:10.877066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ad97683e-c82e-4080-a28d-ab892a0682bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086498 Sep 02 10:01:10.877627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 816/1710] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:10 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:01:11.849992 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fbf0824f-e186-491c-b212-18c4f0d132ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:11.850609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fbf0824f-e186-491c-b212-18c4f0d132ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:11.857144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf0824f-e186-491c-b212-18c4f0d132ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:11.857628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf0824f-e186-491c-b212-18c4f0d132ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:11.858107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf0824f-e186-491c-b212-18c4f0d132ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:11.859453 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf0824f-e186-491c-b212-18c4f0d132ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:11.859913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf0824f-e186-491c-b212-18c4f0d132ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:11.860338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbf0824f-e186-491c-b212-18c4f0d132ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:11.897350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d8caf7c7-cf2e-4a5e-b290-1e93dd550267 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:11.897958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d8caf7c7-cf2e-4a5e-b290-1e93dd550267 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:11.904399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8caf7c7-cf2e-4a5e-b290-1e93dd550267 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:11.904947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8caf7c7-cf2e-4a5e-b290-1e93dd550267 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:11.905307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8caf7c7-cf2e-4a5e-b290-1e93dd550267 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:11.906503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8caf7c7-cf2e-4a5e-b290-1e93dd550267 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:11.906979 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8caf7c7-cf2e-4a5e-b290-1e93dd550267 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:11.907385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8caf7c7-cf2e-4a5e-b290-1e93dd550267 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:11.967592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d8caf7c7-cf2e-4a5e-b290-1e93dd550267 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:11.976211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d8caf7c7-cf2e-4a5e-b290-1e93dd550267 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082757 Sep 02 10:01:11.976777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 817/1711] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:11 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:01:11.993169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fbf0824f-e186-491c-b212-18c4f0d132ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:12.001273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fbf0824f-e186-491c-b212-18c4f0d132ec tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.155115 Sep 02 10:01:12.001827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 895/1712] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:11 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:12.997442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f8632e85-6dab-4154-934e-e77f314da71b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:12.998048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f8632e85-6dab-4154-934e-e77f314da71b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:13.005391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8632e85-6dab-4154-934e-e77f314da71b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:13.005869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8632e85-6dab-4154-934e-e77f314da71b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:13.006303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8632e85-6dab-4154-934e-e77f314da71b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:13.007013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8632e85-6dab-4154-934e-e77f314da71b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:13.007470 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8632e85-6dab-4154-934e-e77f314da71b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:13.007894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8632e85-6dab-4154-934e-e77f314da71b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:13.021351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c37cf1b6-c887-4ec6-a10c-c855ca88aed8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:13.022102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c37cf1b6-c887-4ec6-a10c-c855ca88aed8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:13.028662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c37cf1b6-c887-4ec6-a10c-c855ca88aed8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:13.029151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c37cf1b6-c887-4ec6-a10c-c855ca88aed8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:13.029592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c37cf1b6-c887-4ec6-a10c-c855ca88aed8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:13.030287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c37cf1b6-c887-4ec6-a10c-c855ca88aed8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:13.030764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c37cf1b6-c887-4ec6-a10c-c855ca88aed8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:13.031195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c37cf1b6-c887-4ec6-a10c-c855ca88aed8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:13.069202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f8632e85-6dab-4154-934e-e77f314da71b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:13.077522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f8632e85-6dab-4154-934e-e77f314da71b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083874 Sep 02 10:01:13.078348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 818/1713] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:12 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:13.165647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c37cf1b6-c887-4ec6-a10c-c855ca88aed8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:13.174295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c37cf1b6-c887-4ec6-a10c-c855ca88aed8 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.156764 Sep 02 10:01:13.174897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 896/1714] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:13 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:01:14.097467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e8726ab5-accb-4c89-9b71-c20ed918194b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:14.098009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e8726ab5-accb-4c89-9b71-c20ed918194b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:14.104477 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8726ab5-accb-4c89-9b71-c20ed918194b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:14.104968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8726ab5-accb-4c89-9b71-c20ed918194b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:14.105411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8726ab5-accb-4c89-9b71-c20ed918194b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:14.106104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8726ab5-accb-4c89-9b71-c20ed918194b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:14.106565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8726ab5-accb-4c89-9b71-c20ed918194b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:14.107027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e8726ab5-accb-4c89-9b71-c20ed918194b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:14.171829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e8726ab5-accb-4c89-9b71-c20ed918194b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:14.180121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e8726ab5-accb-4c89-9b71-c20ed918194b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086559 Sep 02 10:01:14.180688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 819/1715] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:14 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:14.195596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e781e10d-26fe-4539-aa31-0a9deed57c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:14.196204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e781e10d-26fe-4539-aa31-0a9deed57c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:14.198501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=52 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:01:14.203760 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e781e10d-26fe-4539-aa31-0a9deed57c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:14.204244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e781e10d-26fe-4539-aa31-0a9deed57c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:14.204681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e781e10d-26fe-4539-aa31-0a9deed57c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:14.205365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e781e10d-26fe-4539-aa31-0a9deed57c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:14.205817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e781e10d-26fe-4539-aa31-0a9deed57c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:14.206237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e781e10d-26fe-4539-aa31-0a9deed57c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:14.336384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e781e10d-26fe-4539-aa31-0a9deed57c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:14.344999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e781e10d-26fe-4539-aa31-0a9deed57c0d tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.153255 Sep 02 10:01:14.345566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 897/1716] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:14 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:15.201315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d62685f-0eab-4c78-8166-e40554f3011d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:15.201869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5d62685f-0eab-4c78-8166-e40554f3011d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:15.208301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d62685f-0eab-4c78-8166-e40554f3011d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:15.208788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d62685f-0eab-4c78-8166-e40554f3011d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:15.209221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d62685f-0eab-4c78-8166-e40554f3011d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:15.209906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d62685f-0eab-4c78-8166-e40554f3011d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:15.210364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d62685f-0eab-4c78-8166-e40554f3011d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:15.210822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d62685f-0eab-4c78-8166-e40554f3011d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:15.270532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5d62685f-0eab-4c78-8166-e40554f3011d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:15.278565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5d62685f-0eab-4c78-8166-e40554f3011d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081245 Sep 02 10:01:15.279157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 820/1717] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:15 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:01:15.365744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2bdfd69c-0432-4624-b1b1-06f3c0624e79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:15.366384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2bdfd69c-0432-4624-b1b1-06f3c0624e79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:15.372752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bdfd69c-0432-4624-b1b1-06f3c0624e79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:15.373235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bdfd69c-0432-4624-b1b1-06f3c0624e79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:15.373671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bdfd69c-0432-4624-b1b1-06f3c0624e79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:15.375013 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bdfd69c-0432-4624-b1b1-06f3c0624e79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:15.375466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bdfd69c-0432-4624-b1b1-06f3c0624e79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:15.375897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2bdfd69c-0432-4624-b1b1-06f3c0624e79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:15.380050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:01:15.502260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2bdfd69c-0432-4624-b1b1-06f3c0624e79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:15.510730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2bdfd69c-0432-4624-b1b1-06f3c0624e79 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.148870 Sep 02 10:01:15.511346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 898/1718] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:15 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:16.299299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3bce5ce8-2867-420a-8080-0d1b21d22106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:16.299824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3bce5ce8-2867-420a-8080-0d1b21d22106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:16.306081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce5ce8-2867-420a-8080-0d1b21d22106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:16.306562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce5ce8-2867-420a-8080-0d1b21d22106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:16.307028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce5ce8-2867-420a-8080-0d1b21d22106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:16.307712 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce5ce8-2867-420a-8080-0d1b21d22106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:16.308162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce5ce8-2867-420a-8080-0d1b21d22106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:16.308582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3bce5ce8-2867-420a-8080-0d1b21d22106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:16.369066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3bce5ce8-2867-420a-8080-0d1b21d22106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:16.377544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3bce5ce8-2867-420a-8080-0d1b21d22106 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082182 Sep 02 10:01:16.378115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 821/1719] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:16 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:16.531533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4c9a6946-3359-47e5-a4dc-5f804e97c2bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:16.532143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4c9a6946-3359-47e5-a4dc-5f804e97c2bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:16.538468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9a6946-3359-47e5-a4dc-5f804e97c2bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:16.538988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9a6946-3359-47e5-a4dc-5f804e97c2bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:16.539421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9a6946-3359-47e5-a4dc-5f804e97c2bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:16.540101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9a6946-3359-47e5-a4dc-5f804e97c2bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:16.540552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9a6946-3359-47e5-a4dc-5f804e97c2bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:16.540976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c9a6946-3359-47e5-a4dc-5f804e97c2bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:16.667048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4c9a6946-3359-47e5-a4dc-5f804e97c2bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:16.675662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4c9a6946-3359-47e5-a4dc-5f804e97c2bc tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.147984 Sep 02 10:01:16.676223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 899/1720] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:16 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:17.399101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b760a343-3e28-4e21-9c0b-3cb7c130e7b5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:17.399699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b760a343-3e28-4e21-9c0b-3cb7c130e7b5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:17.406890 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b760a343-3e28-4e21-9c0b-3cb7c130e7b5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:17.407372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b760a343-3e28-4e21-9c0b-3cb7c130e7b5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:17.407813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b760a343-3e28-4e21-9c0b-3cb7c130e7b5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:17.408496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b760a343-3e28-4e21-9c0b-3cb7c130e7b5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:17.408948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b760a343-3e28-4e21-9c0b-3cb7c130e7b5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:17.409369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b760a343-3e28-4e21-9c0b-3cb7c130e7b5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:17.468939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b760a343-3e28-4e21-9c0b-3cb7c130e7b5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:17.477349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b760a343-3e28-4e21-9c0b-3cb7c130e7b5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082114 Sep 02 10:01:17.477920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 822/1721] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:17 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:17.697042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0e3d84d8-f84a-4a5a-b38b-2b714dddc037 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:17.697642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0e3d84d8-f84a-4a5a-b38b-2b714dddc037 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 94dc7b98-31d1-406f-9070-26ccfe00e15b] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:17.704672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3d84d8-f84a-4a5a-b38b-2b714dddc037 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:17.705172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3d84d8-f84a-4a5a-b38b-2b714dddc037 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:17.705605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3d84d8-f84a-4a5a-b38b-2b714dddc037 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:17.706276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3d84d8-f84a-4a5a-b38b-2b714dddc037 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:17.706746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3d84d8-f84a-4a5a-b38b-2b714dddc037 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:17.707168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0e3d84d8-f84a-4a5a-b38b-2b714dddc037 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:17.837291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0e3d84d8-f84a-4a5a-b38b-2b714dddc037 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:17.845594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0e3d84d8-f84a-4a5a-b38b-2b714dddc037 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b" status: 200 len: 1560 microversion: 2.1 time: 0.152360 Sep 02 10:01:17.846011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 900/1722] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:17 2022] GET /compute/v2.1/servers/94dc7b98-31d1-406f-9070-26ccfe00e15b => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:18.497671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dd4962aa-d6d5-47b7-9ac9-12aa26559312 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:18.498281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dd4962aa-d6d5-47b7-9ac9-12aa26559312 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:18.505507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd4962aa-d6d5-47b7-9ac9-12aa26559312 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:18.505990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd4962aa-d6d5-47b7-9ac9-12aa26559312 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:18.506423 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd4962aa-d6d5-47b7-9ac9-12aa26559312 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:18.507139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd4962aa-d6d5-47b7-9ac9-12aa26559312 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:18.507596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd4962aa-d6d5-47b7-9ac9-12aa26559312 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:18.508023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd4962aa-d6d5-47b7-9ac9-12aa26559312 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:18.523065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:01:18.571225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dd4962aa-d6d5-47b7-9ac9-12aa26559312 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:18.579922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dd4962aa-d6d5-47b7-9ac9-12aa26559312 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086116 Sep 02 10:01:18.580482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 823/1723] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:18 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:18.968096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c7314252-5fdf-4696-81e3-aeb77ddf1855 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:18.968688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c7314252-5fdf-4696-81e3-aeb77ddf1855 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:18.975555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7314252-5fdf-4696-81e3-aeb77ddf1855 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:18.979938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7314252-5fdf-4696-81e3-aeb77ddf1855 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:18.979938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7314252-5fdf-4696-81e3-aeb77ddf1855 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:18.979938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7314252-5fdf-4696-81e3-aeb77ddf1855 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:18.979938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7314252-5fdf-4696-81e3-aeb77ddf1855 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:18.980352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7314252-5fdf-4696-81e3-aeb77ddf1855 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:19.004845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c7314252-5fdf-4696-81e3-aeb77ddf1855 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Going to try to terminate instance {{(pid=127533) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:01:19.348635 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c7314252-5fdf-4696-81e3-aeb77ddf1855 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 204 len: 0 microversion: 2.1 time: 0.384316 Sep 02 10:01:19.349233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 901/1724] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:01:18 2022] DELETE /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:01:19.357337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-116b93f6-52a6-41f0-b92c-95411a125d4c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:19.357969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-116b93f6-52a6-41f0-b92c-95411a125d4c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:19.360800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=56 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:01:19.365577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-116b93f6-52a6-41f0-b92c-95411a125d4c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:19.366071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-116b93f6-52a6-41f0-b92c-95411a125d4c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:19.366500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-116b93f6-52a6-41f0-b92c-95411a125d4c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:19.367210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-116b93f6-52a6-41f0-b92c-95411a125d4c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:19.367656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-116b93f6-52a6-41f0-b92c-95411a125d4c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:19.368072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-116b93f6-52a6-41f0-b92c-95411a125d4c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:19.494868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-116b93f6-52a6-41f0-b92c-95411a125d4c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:19.503488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-116b93f6-52a6-41f0-b92c-95411a125d4c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.150139 Sep 02 10:01:19.504301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 824/1725] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:01:19.600454 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9b98874d-0f5f-47f9-95b4-adcf6741357e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:19.601151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9b98874d-0f5f-47f9-95b4-adcf6741357e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:19.607105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b98874d-0f5f-47f9-95b4-adcf6741357e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:19.607588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b98874d-0f5f-47f9-95b4-adcf6741357e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:19.608024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b98874d-0f5f-47f9-95b4-adcf6741357e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:19.609325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b98874d-0f5f-47f9-95b4-adcf6741357e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:19.609784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b98874d-0f5f-47f9-95b4-adcf6741357e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:19.610208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b98874d-0f5f-47f9-95b4-adcf6741357e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:19.674949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9b98874d-0f5f-47f9-95b4-adcf6741357e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:19.683089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9b98874d-0f5f-47f9-95b4-adcf6741357e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086838 Sep 02 10:01:19.683649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 902/1726] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:19 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:20.524657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3945a27b-997d-436c-8ba0-afafc8f5f9c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:20.525507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3945a27b-997d-436c-8ba0-afafc8f5f9c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:20.532401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3945a27b-997d-436c-8ba0-afafc8f5f9c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:20.532836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3945a27b-997d-436c-8ba0-afafc8f5f9c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:20.533273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3945a27b-997d-436c-8ba0-afafc8f5f9c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:20.533970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3945a27b-997d-436c-8ba0-afafc8f5f9c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:20.534422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3945a27b-997d-436c-8ba0-afafc8f5f9c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:20.534879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3945a27b-997d-436c-8ba0-afafc8f5f9c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:20.664316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3945a27b-997d-436c-8ba0-afafc8f5f9c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:20.672916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3945a27b-997d-436c-8ba0-afafc8f5f9c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1735 microversion: 2.1 time: 0.152078 Sep 02 10:01:20.673498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 825/1727] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:20.703847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-04d7fa25-8b4e-409d-a491-1532b31dbc5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:20.704574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-04d7fa25-8b4e-409d-a491-1532b31dbc5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:20.711082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04d7fa25-8b4e-409d-a491-1532b31dbc5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:20.711573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04d7fa25-8b4e-409d-a491-1532b31dbc5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:20.712014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04d7fa25-8b4e-409d-a491-1532b31dbc5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:20.712708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04d7fa25-8b4e-409d-a491-1532b31dbc5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:20.713166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04d7fa25-8b4e-409d-a491-1532b31dbc5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:20.713594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04d7fa25-8b4e-409d-a491-1532b31dbc5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:20.784380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-04d7fa25-8b4e-409d-a491-1532b31dbc5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:20.792797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-04d7fa25-8b4e-409d-a491-1532b31dbc5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.093268 Sep 02 10:01:20.793372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 903/1728] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:20 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:21.307472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-125a636b-03a8-4d05-aa27-016467075729 req-15563042-a8b2-4e3c-b501-31dcef8b3b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2bccc75-d837-4a98-8a78-841b2edb8ce5", "name": "network-vif-deleted", "tag": "72e00e01-0226-481d-9c3e-f109d75f21d1"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:01:21.317881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-125a636b-03a8-4d05-aa27-016467075729 req-15563042-a8b2-4e3c-b501-31dcef8b3b34 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:21.318346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-125a636b-03a8-4d05-aa27-016467075729 req-15563042-a8b2-4e3c-b501-31dcef8b3b34 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:21.321081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-125a636b-03a8-4d05-aa27-016467075729 req-15563042-a8b2-4e3c-b501-31dcef8b3b34 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:21.330366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-125a636b-03a8-4d05-aa27-016467075729 req-15563042-a8b2-4e3c-b501-31dcef8b3b34 service nova] Creating event network-vif-deleted:72e00e01-0226-481d-9c3e-f109d75f21d1 for instance a2bccc75-d837-4a98-8a78-841b2edb8ce5 on hv-cinder-85083 Sep 02 10:01:21.336675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-125a636b-03a8-4d05-aa27-016467075729 req-15563042-a8b2-4e3c-b501-31dcef8b3b34 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033064 Sep 02 10:01:21.337361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 826/1729] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:01:21.694368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b83a4504-b0fc-4fa4-94d3-ff102b52d80b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:21.695102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b83a4504-b0fc-4fa4-94d3-ff102b52d80b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:21.700918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b83a4504-b0fc-4fa4-94d3-ff102b52d80b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:21.701399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b83a4504-b0fc-4fa4-94d3-ff102b52d80b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:21.701834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b83a4504-b0fc-4fa4-94d3-ff102b52d80b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:21.702529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b83a4504-b0fc-4fa4-94d3-ff102b52d80b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:21.703010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b83a4504-b0fc-4fa4-94d3-ff102b52d80b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:21.703433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b83a4504-b0fc-4fa4-94d3-ff102b52d80b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:21.764839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b83a4504-b0fc-4fa4-94d3-ff102b52d80b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:21.773069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b83a4504-b0fc-4fa4-94d3-ff102b52d80b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082653 Sep 02 10:01:21.773638 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 904/1730] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:01:21.814223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1a15f7ec-f57f-4e91-963d-7e20a7ee902a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:21.814943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1a15f7ec-f57f-4e91-963d-7e20a7ee902a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:21.821035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a15f7ec-f57f-4e91-963d-7e20a7ee902a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:21.821514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a15f7ec-f57f-4e91-963d-7e20a7ee902a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:21.821949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a15f7ec-f57f-4e91-963d-7e20a7ee902a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:21.822628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a15f7ec-f57f-4e91-963d-7e20a7ee902a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:21.823098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a15f7ec-f57f-4e91-963d-7e20a7ee902a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:21.823518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a15f7ec-f57f-4e91-963d-7e20a7ee902a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:21.899293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1a15f7ec-f57f-4e91-963d-7e20a7ee902a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:21.908958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1a15f7ec-f57f-4e91-963d-7e20a7ee902a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.099229 Sep 02 10:01:21.910145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 827/1731] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:21 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:22.794194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-18276003-2bf4-4a10-a7f8-89d5a80ec8dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:22.794775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-18276003-2bf4-4a10-a7f8-89d5a80ec8dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:22.801657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18276003-2bf4-4a10-a7f8-89d5a80ec8dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:22.802140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18276003-2bf4-4a10-a7f8-89d5a80ec8dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:22.802582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18276003-2bf4-4a10-a7f8-89d5a80ec8dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:22.803292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18276003-2bf4-4a10-a7f8-89d5a80ec8dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:22.803748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18276003-2bf4-4a10-a7f8-89d5a80ec8dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:22.804169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18276003-2bf4-4a10-a7f8-89d5a80ec8dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:22.864898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-18276003-2bf4-4a10-a7f8-89d5a80ec8dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:22.873087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-18276003-2bf4-4a10-a7f8-89d5a80ec8dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082904 Sep 02 10:01:22.873658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 905/1732] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:22.929255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-be479d0b-db1b-4a2c-a5f8-5ce432baef3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:22.929861 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-be479d0b-db1b-4a2c-a5f8-5ce432baef3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:22.936612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be479d0b-db1b-4a2c-a5f8-5ce432baef3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:22.937118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be479d0b-db1b-4a2c-a5f8-5ce432baef3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:22.937815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be479d0b-db1b-4a2c-a5f8-5ce432baef3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:22.939164 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be479d0b-db1b-4a2c-a5f8-5ce432baef3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:22.939612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be479d0b-db1b-4a2c-a5f8-5ce432baef3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:22.940028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be479d0b-db1b-4a2c-a5f8-5ce432baef3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:23.000332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be479d0b-db1b-4a2c-a5f8-5ce432baef3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:23.008765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-be479d0b-db1b-4a2c-a5f8-5ce432baef3b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083338 Sep 02 10:01:23.009321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 828/1733] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:22 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:23.893539 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7bc2cd2f-8f18-4a7f-8774-eac5c254b375 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:23.894153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7bc2cd2f-8f18-4a7f-8774-eac5c254b375 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:23.900561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bc2cd2f-8f18-4a7f-8774-eac5c254b375 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:23.901038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bc2cd2f-8f18-4a7f-8774-eac5c254b375 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:23.901470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bc2cd2f-8f18-4a7f-8774-eac5c254b375 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:23.902147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bc2cd2f-8f18-4a7f-8774-eac5c254b375 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:23.902594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bc2cd2f-8f18-4a7f-8774-eac5c254b375 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:23.903038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7bc2cd2f-8f18-4a7f-8774-eac5c254b375 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:23.966295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7bc2cd2f-8f18-4a7f-8774-eac5c254b375 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:23.975019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7bc2cd2f-8f18-4a7f-8774-eac5c254b375 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085298 Sep 02 10:01:23.975592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 906/1734] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:24.029523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-198d5c2a-7843-4f25-b403-971164a3b984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:24.030128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-198d5c2a-7843-4f25-b403-971164a3b984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:24.036961 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198d5c2a-7843-4f25-b403-971164a3b984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:24.037439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198d5c2a-7843-4f25-b403-971164a3b984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:24.037871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198d5c2a-7843-4f25-b403-971164a3b984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:24.038552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198d5c2a-7843-4f25-b403-971164a3b984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:24.039023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198d5c2a-7843-4f25-b403-971164a3b984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:24.039443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-198d5c2a-7843-4f25-b403-971164a3b984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:24.099934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-198d5c2a-7843-4f25-b403-971164a3b984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:24.107969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-198d5c2a-7843-4f25-b403-971164a3b984 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082404 Sep 02 10:01:24.108520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 829/1735] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:24 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:24.995324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5a470b50-8d1f-49d2-9296-0dbc42dc26c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:24.995921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5a470b50-8d1f-49d2-9296-0dbc42dc26c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:25.003120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a470b50-8d1f-49d2-9296-0dbc42dc26c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:25.003870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a470b50-8d1f-49d2-9296-0dbc42dc26c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:25.004307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a470b50-8d1f-49d2-9296-0dbc42dc26c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:25.004998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a470b50-8d1f-49d2-9296-0dbc42dc26c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:25.005451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a470b50-8d1f-49d2-9296-0dbc42dc26c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:25.005876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a470b50-8d1f-49d2-9296-0dbc42dc26c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:25.066087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5a470b50-8d1f-49d2-9296-0dbc42dc26c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:25.074108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5a470b50-8d1f-49d2-9296-0dbc42dc26c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082730 Sep 02 10:01:25.074665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 907/1736] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:25.129070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4befe4a7-e1d7-427b-a9e2-029e3e4c485f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:25.129674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4befe4a7-e1d7-427b-a9e2-029e3e4c485f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:25.136001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4befe4a7-e1d7-427b-a9e2-029e3e4c485f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:25.136486 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4befe4a7-e1d7-427b-a9e2-029e3e4c485f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:25.136918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4befe4a7-e1d7-427b-a9e2-029e3e4c485f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:25.137592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4befe4a7-e1d7-427b-a9e2-029e3e4c485f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:25.138039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4befe4a7-e1d7-427b-a9e2-029e3e4c485f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:25.138457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4befe4a7-e1d7-427b-a9e2-029e3e4c485f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:25.200637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4befe4a7-e1d7-427b-a9e2-029e3e4c485f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:25.208701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4befe4a7-e1d7-427b-a9e2-029e3e4c485f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084327 Sep 02 10:01:25.209259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 830/1737] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:26.094748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9dd7283f-1227-4995-a4da-4e09376a8095 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:26.095358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9dd7283f-1227-4995-a4da-4e09376a8095 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:26.101788 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9dd7283f-1227-4995-a4da-4e09376a8095 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:26.102209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9dd7283f-1227-4995-a4da-4e09376a8095 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:26.102641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9dd7283f-1227-4995-a4da-4e09376a8095 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:26.103346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9dd7283f-1227-4995-a4da-4e09376a8095 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:26.103798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9dd7283f-1227-4995-a4da-4e09376a8095 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:26.104222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9dd7283f-1227-4995-a4da-4e09376a8095 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:26.166258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9dd7283f-1227-4995-a4da-4e09376a8095 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:26.174420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9dd7283f-1227-4995-a4da-4e09376a8095 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083632 Sep 02 10:01:26.175024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 908/1738] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:26 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:26.228895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-310c7785-fd2a-435a-a611-754e1c76949d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:26.229516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-310c7785-fd2a-435a-a611-754e1c76949d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:26.235920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-310c7785-fd2a-435a-a611-754e1c76949d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:26.236401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-310c7785-fd2a-435a-a611-754e1c76949d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:26.236837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-310c7785-fd2a-435a-a611-754e1c76949d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:26.237517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-310c7785-fd2a-435a-a611-754e1c76949d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:26.237971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-310c7785-fd2a-435a-a611-754e1c76949d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:26.238395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-310c7785-fd2a-435a-a611-754e1c76949d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:26.298570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-310c7785-fd2a-435a-a611-754e1c76949d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:26.306644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-310c7785-fd2a-435a-a611-754e1c76949d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081580 Sep 02 10:01:26.307234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 831/1739] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:26 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:27.196261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b0eaad28-f6ec-460b-9b8b-4ffe614538a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:27.196793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b0eaad28-f6ec-460b-9b8b-4ffe614538a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:27.203175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0eaad28-f6ec-460b-9b8b-4ffe614538a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:27.204200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0eaad28-f6ec-460b-9b8b-4ffe614538a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:27.204642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0eaad28-f6ec-460b-9b8b-4ffe614538a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:27.205327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0eaad28-f6ec-460b-9b8b-4ffe614538a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:27.205778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0eaad28-f6ec-460b-9b8b-4ffe614538a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:27.206204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0eaad28-f6ec-460b-9b8b-4ffe614538a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:27.266488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b0eaad28-f6ec-460b-9b8b-4ffe614538a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:27.274771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b0eaad28-f6ec-460b-9b8b-4ffe614538a7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082389 Sep 02 10:01:27.275336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 909/1740] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:01:27.327481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0d99304d-949c-4cb1-8649-28b90fdecfd2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:27.328094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0d99304d-949c-4cb1-8649-28b90fdecfd2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:27.335162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d99304d-949c-4cb1-8649-28b90fdecfd2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:27.335652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d99304d-949c-4cb1-8649-28b90fdecfd2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:27.336096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d99304d-949c-4cb1-8649-28b90fdecfd2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:27.336785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d99304d-949c-4cb1-8649-28b90fdecfd2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:27.337244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d99304d-949c-4cb1-8649-28b90fdecfd2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:27.337672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0d99304d-949c-4cb1-8649-28b90fdecfd2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:27.397503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0d99304d-949c-4cb1-8649-28b90fdecfd2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:27.405616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0d99304d-949c-4cb1-8649-28b90fdecfd2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081943 Sep 02 10:01:27.406176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 832/1741] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:27 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:28.296035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e9c67df3-cb47-47fd-8b3b-e5b70bedbcf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:28.296574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e9c67df3-cb47-47fd-8b3b-e5b70bedbcf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:28.303868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9c67df3-cb47-47fd-8b3b-e5b70bedbcf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:28.304349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9c67df3-cb47-47fd-8b3b-e5b70bedbcf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:28.304787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9c67df3-cb47-47fd-8b3b-e5b70bedbcf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:28.305468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9c67df3-cb47-47fd-8b3b-e5b70bedbcf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:28.305922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9c67df3-cb47-47fd-8b3b-e5b70bedbcf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:28.306346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9c67df3-cb47-47fd-8b3b-e5b70bedbcf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:28.369901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e9c67df3-cb47-47fd-8b3b-e5b70bedbcf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:28.377991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e9c67df3-cb47-47fd-8b3b-e5b70bedbcf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085899 Sep 02 10:01:28.378837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 910/1742] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:28.427555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d561571-a7fd-44dc-bb57-c7ac408fc03a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:28.428168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6d561571-a7fd-44dc-bb57-c7ac408fc03a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:28.434741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d561571-a7fd-44dc-bb57-c7ac408fc03a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:28.435233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d561571-a7fd-44dc-bb57-c7ac408fc03a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:28.435670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d561571-a7fd-44dc-bb57-c7ac408fc03a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:28.436354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d561571-a7fd-44dc-bb57-c7ac408fc03a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:28.436833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d561571-a7fd-44dc-bb57-c7ac408fc03a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:28.437259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d561571-a7fd-44dc-bb57-c7ac408fc03a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:28.499219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6d561571-a7fd-44dc-bb57-c7ac408fc03a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:28.507741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6d561571-a7fd-44dc-bb57-c7ac408fc03a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084819 Sep 02 10:01:28.508304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 833/1743] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:28 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:29.398729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fe670323-c9b4-46a2-bfc3-471a34a0c89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:29.399391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fe670323-c9b4-46a2-bfc3-471a34a0c89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:29.405867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe670323-c9b4-46a2-bfc3-471a34a0c89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:29.406353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe670323-c9b4-46a2-bfc3-471a34a0c89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:29.406823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe670323-c9b4-46a2-bfc3-471a34a0c89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:29.407544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe670323-c9b4-46a2-bfc3-471a34a0c89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:29.407999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe670323-c9b4-46a2-bfc3-471a34a0c89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:29.408423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fe670323-c9b4-46a2-bfc3-471a34a0c89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:29.469338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fe670323-c9b4-46a2-bfc3-471a34a0c89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:29.477385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fe670323-c9b4-46a2-bfc3-471a34a0c89e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082640 Sep 02 10:01:29.477961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 911/1744] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:29.527377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a84c6fae-3f93-460f-94b7-73a50427b362 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:29.527980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a84c6fae-3f93-460f-94b7-73a50427b362 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:29.534355 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84c6fae-3f93-460f-94b7-73a50427b362 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:29.534863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84c6fae-3f93-460f-94b7-73a50427b362 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:29.535296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84c6fae-3f93-460f-94b7-73a50427b362 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:29.535970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84c6fae-3f93-460f-94b7-73a50427b362 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:29.536421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84c6fae-3f93-460f-94b7-73a50427b362 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:29.536850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84c6fae-3f93-460f-94b7-73a50427b362 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:29.599156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a84c6fae-3f93-460f-94b7-73a50427b362 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:29.607256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a84c6fae-3f93-460f-94b7-73a50427b362 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083674 Sep 02 10:01:29.607819 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 834/1745] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:29 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:30.498464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e4f49a5d-a1b5-4624-a1eb-b3e60d695376 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:30.499170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e4f49a5d-a1b5-4624-a1eb-b3e60d695376 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:30.506323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f49a5d-a1b5-4624-a1eb-b3e60d695376 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:30.506850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f49a5d-a1b5-4624-a1eb-b3e60d695376 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:30.507288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f49a5d-a1b5-4624-a1eb-b3e60d695376 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:30.507975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f49a5d-a1b5-4624-a1eb-b3e60d695376 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:30.508429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f49a5d-a1b5-4624-a1eb-b3e60d695376 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:30.508859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e4f49a5d-a1b5-4624-a1eb-b3e60d695376 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:30.569114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e4f49a5d-a1b5-4624-a1eb-b3e60d695376 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:30.577128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e4f49a5d-a1b5-4624-a1eb-b3e60d695376 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082530 Sep 02 10:01:30.577696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 912/1746] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:30.628956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0f901783-0329-4eb6-b943-f5597ebc5711 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:30.629559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0f901783-0329-4eb6-b943-f5597ebc5711 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:30.635937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f901783-0329-4eb6-b943-f5597ebc5711 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:30.636417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f901783-0329-4eb6-b943-f5597ebc5711 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:30.636845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f901783-0329-4eb6-b943-f5597ebc5711 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:30.637524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f901783-0329-4eb6-b943-f5597ebc5711 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:30.637971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f901783-0329-4eb6-b943-f5597ebc5711 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:30.638389 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0f901783-0329-4eb6-b943-f5597ebc5711 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:30.697924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0f901783-0329-4eb6-b943-f5597ebc5711 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:30.706638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0f901783-0329-4eb6-b943-f5597ebc5711 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082346 Sep 02 10:01:30.707219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 835/1747] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:30 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:31.599042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a51ace05-e90e-4528-ba47-221397bd9a7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:31.599661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a51ace05-e90e-4528-ba47-221397bd9a7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:31.606029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a51ace05-e90e-4528-ba47-221397bd9a7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:31.606510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a51ace05-e90e-4528-ba47-221397bd9a7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:31.606984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a51ace05-e90e-4528-ba47-221397bd9a7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:31.607672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a51ace05-e90e-4528-ba47-221397bd9a7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:31.608124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a51ace05-e90e-4528-ba47-221397bd9a7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:31.608546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a51ace05-e90e-4528-ba47-221397bd9a7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:31.612584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:01:31.669221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a51ace05-e90e-4528-ba47-221397bd9a7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:31.677275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a51ace05-e90e-4528-ba47-221397bd9a7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082738 Sep 02 10:01:31.677843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 913/1748] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:31.727714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2ba2fa20-18af-4096-8557-9db44d2ed41b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:31.728347 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2ba2fa20-18af-4096-8557-9db44d2ed41b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:31.734496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ba2fa20-18af-4096-8557-9db44d2ed41b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:31.735011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ba2fa20-18af-4096-8557-9db44d2ed41b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:31.735450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ba2fa20-18af-4096-8557-9db44d2ed41b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:31.736132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ba2fa20-18af-4096-8557-9db44d2ed41b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:31.736585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ba2fa20-18af-4096-8557-9db44d2ed41b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:31.737010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ba2fa20-18af-4096-8557-9db44d2ed41b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:31.796912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2ba2fa20-18af-4096-8557-9db44d2ed41b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:31.804872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2ba2fa20-18af-4096-8557-9db44d2ed41b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081003 Sep 02 10:01:31.805442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 836/1749] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:31 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:32.698338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6e5c9a88-bd63-4f57-bcad-25d053a018f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:32.698963 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6e5c9a88-bd63-4f57-bcad-25d053a018f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:32.706113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e5c9a88-bd63-4f57-bcad-25d053a018f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:32.706595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e5c9a88-bd63-4f57-bcad-25d053a018f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:32.707057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e5c9a88-bd63-4f57-bcad-25d053a018f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:32.707760 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e5c9a88-bd63-4f57-bcad-25d053a018f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:32.708209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e5c9a88-bd63-4f57-bcad-25d053a018f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:32.708628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e5c9a88-bd63-4f57-bcad-25d053a018f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:32.773559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6e5c9a88-bd63-4f57-bcad-25d053a018f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:32.781562 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6e5c9a88-bd63-4f57-bcad-25d053a018f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087514 Sep 02 10:01:32.782122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 914/1750] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:32.825257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-440cc35f-b4d8-4951-863d-9efca2db82a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:32.825870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-440cc35f-b4d8-4951-863d-9efca2db82a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:32.832938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-440cc35f-b4d8-4951-863d-9efca2db82a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:32.833423 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-440cc35f-b4d8-4951-863d-9efca2db82a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:32.833859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-440cc35f-b4d8-4951-863d-9efca2db82a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:32.834545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-440cc35f-b4d8-4951-863d-9efca2db82a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:32.835034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-440cc35f-b4d8-4951-863d-9efca2db82a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:32.835465 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-440cc35f-b4d8-4951-863d-9efca2db82a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:32.896553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-440cc35f-b4d8-4951-863d-9efca2db82a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:32.904677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-440cc35f-b4d8-4951-863d-9efca2db82a3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083295 Sep 02 10:01:32.905238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 837/1751] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:32 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:33.802572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-caa393ea-4fe6-44d5-8858-70d85d2fd5f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:33.803236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-caa393ea-4fe6-44d5-8858-70d85d2fd5f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:33.809622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-caa393ea-4fe6-44d5-8858-70d85d2fd5f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:33.810105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-caa393ea-4fe6-44d5-8858-70d85d2fd5f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:33.810536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-caa393ea-4fe6-44d5-8858-70d85d2fd5f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:33.811250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-caa393ea-4fe6-44d5-8858-70d85d2fd5f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:33.811700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-caa393ea-4fe6-44d5-8858-70d85d2fd5f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:33.812120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-caa393ea-4fe6-44d5-8858-70d85d2fd5f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:33.873126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-caa393ea-4fe6-44d5-8858-70d85d2fd5f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:33.881769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-caa393ea-4fe6-44d5-8858-70d85d2fd5f8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083681 Sep 02 10:01:33.882337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 915/1752] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:33.924489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fc671a35-e383-4a3e-a407-6d3fe8c0f42a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:33.925104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fc671a35-e383-4a3e-a407-6d3fe8c0f42a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:33.931636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc671a35-e383-4a3e-a407-6d3fe8c0f42a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:33.932119 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc671a35-e383-4a3e-a407-6d3fe8c0f42a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:33.932556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc671a35-e383-4a3e-a407-6d3fe8c0f42a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:33.933238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc671a35-e383-4a3e-a407-6d3fe8c0f42a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:33.933689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc671a35-e383-4a3e-a407-6d3fe8c0f42a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:33.934110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fc671a35-e383-4a3e-a407-6d3fe8c0f42a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:33.996430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fc671a35-e383-4a3e-a407-6d3fe8c0f42a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:34.004906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fc671a35-e383-4a3e-a407-6d3fe8c0f42a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084257 Sep 02 10:01:34.005467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 838/1753] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:33 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:34.902277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c7e43bfd-74b3-4d32-9acf-69081714db34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:34.902917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c7e43bfd-74b3-4d32-9acf-69081714db34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:34.910014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e43bfd-74b3-4d32-9acf-69081714db34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:34.910501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e43bfd-74b3-4d32-9acf-69081714db34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:34.910967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e43bfd-74b3-4d32-9acf-69081714db34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:34.911687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e43bfd-74b3-4d32-9acf-69081714db34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:34.912152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e43bfd-74b3-4d32-9acf-69081714db34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:34.912582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e43bfd-74b3-4d32-9acf-69081714db34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:34.978681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c7e43bfd-74b3-4d32-9acf-69081714db34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:34.986918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c7e43bfd-74b3-4d32-9acf-69081714db34 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.088508 Sep 02 10:01:34.987484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 916/1754] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:35.029096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9f4a7b01-a698-4c37-a951-7294808c6d7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:35.029739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9f4a7b01-a698-4c37-a951-7294808c6d7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:35.036234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f4a7b01-a698-4c37-a951-7294808c6d7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:35.036716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f4a7b01-a698-4c37-a951-7294808c6d7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:35.037152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f4a7b01-a698-4c37-a951-7294808c6d7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:35.037864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f4a7b01-a698-4c37-a951-7294808c6d7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:35.038318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f4a7b01-a698-4c37-a951-7294808c6d7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:35.038768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9f4a7b01-a698-4c37-a951-7294808c6d7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:35.099554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9f4a7b01-a698-4c37-a951-7294808c6d7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:35.107621 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9f4a7b01-a698-4c37-a951-7294808c6d7a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082372 Sep 02 10:01:35.108178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 839/1755] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:35 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:36.007760 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5c5e1298-96c7-42a9-bb4c-24775d3c7654 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:36.008421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5c5e1298-96c7-42a9-bb4c-24775d3c7654 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:36.014858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c5e1298-96c7-42a9-bb4c-24775d3c7654 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:36.015354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c5e1298-96c7-42a9-bb4c-24775d3c7654 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:36.015793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c5e1298-96c7-42a9-bb4c-24775d3c7654 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:36.016484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c5e1298-96c7-42a9-bb4c-24775d3c7654 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:36.016938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c5e1298-96c7-42a9-bb4c-24775d3c7654 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:36.017389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5c5e1298-96c7-42a9-bb4c-24775d3c7654 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:36.077628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5c5e1298-96c7-42a9-bb4c-24775d3c7654 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:36.086354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5c5e1298-96c7-42a9-bb4c-24775d3c7654 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082468 Sep 02 10:01:36.086987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 917/1756] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:36.128314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2bab0732-4263-45f8-89e6-7323c90cd16b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:36.128945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2bab0732-4263-45f8-89e6-7323c90cd16b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:36.135677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bab0732-4263-45f8-89e6-7323c90cd16b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:36.136163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bab0732-4263-45f8-89e6-7323c90cd16b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:36.136605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bab0732-4263-45f8-89e6-7323c90cd16b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:36.137296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bab0732-4263-45f8-89e6-7323c90cd16b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:36.137752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bab0732-4263-45f8-89e6-7323c90cd16b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:36.138180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bab0732-4263-45f8-89e6-7323c90cd16b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:36.199935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2bab0732-4263-45f8-89e6-7323c90cd16b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:36.202250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:01:36.209352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2bab0732-4263-45f8-89e6-7323c90cd16b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085246 Sep 02 10:01:36.219093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 840/1757] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:36 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:37.106999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4a161470-a60f-4daf-b8e7-8e2bb29bb5b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:37.107607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4a161470-a60f-4daf-b8e7-8e2bb29bb5b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:37.114487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a161470-a60f-4daf-b8e7-8e2bb29bb5b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:37.115002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a161470-a60f-4daf-b8e7-8e2bb29bb5b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:37.115433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a161470-a60f-4daf-b8e7-8e2bb29bb5b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:37.116112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a161470-a60f-4daf-b8e7-8e2bb29bb5b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:37.116559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a161470-a60f-4daf-b8e7-8e2bb29bb5b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:37.116978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a161470-a60f-4daf-b8e7-8e2bb29bb5b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:37.181625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4a161470-a60f-4daf-b8e7-8e2bb29bb5b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:37.189808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4a161470-a60f-4daf-b8e7-8e2bb29bb5b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086741 Sep 02 10:01:37.190374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 918/1758] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:37.238625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b8668b9c-4030-46ec-befc-30cf40a10797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:37.239268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b8668b9c-4030-46ec-befc-30cf40a10797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:37.245716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8668b9c-4030-46ec-befc-30cf40a10797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:37.246200 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8668b9c-4030-46ec-befc-30cf40a10797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:37.246634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8668b9c-4030-46ec-befc-30cf40a10797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:37.247346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8668b9c-4030-46ec-befc-30cf40a10797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:37.247802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8668b9c-4030-46ec-befc-30cf40a10797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:37.248258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8668b9c-4030-46ec-befc-30cf40a10797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:37.309314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b8668b9c-4030-46ec-befc-30cf40a10797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:37.317465 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b8668b9c-4030-46ec-befc-30cf40a10797 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083648 Sep 02 10:01:37.318028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 841/1759] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:37 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:38.210499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-90e89c9a-d5e3-4338-924b-b12d69004aba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:38.211140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-90e89c9a-d5e3-4338-924b-b12d69004aba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:38.217316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90e89c9a-d5e3-4338-924b-b12d69004aba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:38.217808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90e89c9a-d5e3-4338-924b-b12d69004aba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:38.218248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90e89c9a-d5e3-4338-924b-b12d69004aba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:38.218971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90e89c9a-d5e3-4338-924b-b12d69004aba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:38.219429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90e89c9a-d5e3-4338-924b-b12d69004aba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:38.219862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90e89c9a-d5e3-4338-924b-b12d69004aba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:38.279713 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-90e89c9a-d5e3-4338-924b-b12d69004aba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:38.288241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-90e89c9a-d5e3-4338-924b-b12d69004aba tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081608 Sep 02 10:01:38.288809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 919/1760] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:38.337303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ec3bed4d-3d47-4ac5-839f-6fe7ee36c88a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:38.337917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ec3bed4d-3d47-4ac5-839f-6fe7ee36c88a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:38.344364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec3bed4d-3d47-4ac5-839f-6fe7ee36c88a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:38.344847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec3bed4d-3d47-4ac5-839f-6fe7ee36c88a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:38.345283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec3bed4d-3d47-4ac5-839f-6fe7ee36c88a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:38.346597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec3bed4d-3d47-4ac5-839f-6fe7ee36c88a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:38.347080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec3bed4d-3d47-4ac5-839f-6fe7ee36c88a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:38.347505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ec3bed4d-3d47-4ac5-839f-6fe7ee36c88a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:38.410083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ec3bed4d-3d47-4ac5-839f-6fe7ee36c88a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:38.418177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ec3bed4d-3d47-4ac5-839f-6fe7ee36c88a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084789 Sep 02 10:01:38.418761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 842/1761] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:38 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:39.309902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-75bf749d-6316-4d62-abb6-0d4d90d72c1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:39.310474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-75bf749d-6316-4d62-abb6-0d4d90d72c1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:39.316795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-75bf749d-6316-4d62-abb6-0d4d90d72c1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:39.317305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-75bf749d-6316-4d62-abb6-0d4d90d72c1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:39.317746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-75bf749d-6316-4d62-abb6-0d4d90d72c1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:39.318437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-75bf749d-6316-4d62-abb6-0d4d90d72c1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:39.318920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-75bf749d-6316-4d62-abb6-0d4d90d72c1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:39.319348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-75bf749d-6316-4d62-abb6-0d4d90d72c1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:39.379715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-75bf749d-6316-4d62-abb6-0d4d90d72c1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:39.387763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-75bf749d-6316-4d62-abb6-0d4d90d72c1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081820 Sep 02 10:01:39.388331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 920/1762] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:39.439051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-022215c9-4889-4344-85ec-b7fb5dcce90c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:39.440193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-022215c9-4889-4344-85ec-b7fb5dcce90c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:39.446584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022215c9-4889-4344-85ec-b7fb5dcce90c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:39.447101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022215c9-4889-4344-85ec-b7fb5dcce90c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:39.447542 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022215c9-4889-4344-85ec-b7fb5dcce90c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:39.448233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022215c9-4889-4344-85ec-b7fb5dcce90c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:39.448690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022215c9-4889-4344-85ec-b7fb5dcce90c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:39.449116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-022215c9-4889-4344-85ec-b7fb5dcce90c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:39.509585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-022215c9-4889-4344-85ec-b7fb5dcce90c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:39.518326 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-022215c9-4889-4344-85ec-b7fb5dcce90c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082539 Sep 02 10:01:39.518925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 843/1763] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:39 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:40.409541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-66c259f3-fdf5-4484-b32a-68bbb0d976a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:40.410146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-66c259f3-fdf5-4484-b32a-68bbb0d976a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:40.416649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c259f3-fdf5-4484-b32a-68bbb0d976a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:40.422592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c259f3-fdf5-4484-b32a-68bbb0d976a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:40.422592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c259f3-fdf5-4484-b32a-68bbb0d976a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:40.422592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c259f3-fdf5-4484-b32a-68bbb0d976a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:40.422592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c259f3-fdf5-4484-b32a-68bbb0d976a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:40.423114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-66c259f3-fdf5-4484-b32a-68bbb0d976a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:40.482035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-66c259f3-fdf5-4484-b32a-68bbb0d976a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:40.491203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-66c259f3-fdf5-4484-b32a-68bbb0d976a3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086137 Sep 02 10:01:40.491778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 921/1764] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:40.539291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-496f5741-89ca-4595-85be-455d5b3976af tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:40.539899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-496f5741-89ca-4595-85be-455d5b3976af tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:40.546352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-496f5741-89ca-4595-85be-455d5b3976af tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:40.546868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-496f5741-89ca-4595-85be-455d5b3976af tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:40.547301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-496f5741-89ca-4595-85be-455d5b3976af tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:40.548010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-496f5741-89ca-4595-85be-455d5b3976af tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:40.548457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-496f5741-89ca-4595-85be-455d5b3976af tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:40.549039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-496f5741-89ca-4595-85be-455d5b3976af tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:40.609567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-496f5741-89ca-4595-85be-455d5b3976af tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:40.617702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-496f5741-89ca-4595-85be-455d5b3976af tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082252 Sep 02 10:01:40.618267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 844/1765] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:40 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:41.512196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2c0bed91-651a-4a3a-abb1-5a170064b6db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:41.512813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2c0bed91-651a-4a3a-abb1-5a170064b6db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:41.519188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c0bed91-651a-4a3a-abb1-5a170064b6db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:41.519767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c0bed91-651a-4a3a-abb1-5a170064b6db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:41.520208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c0bed91-651a-4a3a-abb1-5a170064b6db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:41.520885 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c0bed91-651a-4a3a-abb1-5a170064b6db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:41.521333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c0bed91-651a-4a3a-abb1-5a170064b6db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:41.521753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c0bed91-651a-4a3a-abb1-5a170064b6db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:41.584527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2c0bed91-651a-4a3a-abb1-5a170064b6db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:41.592924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2c0bed91-651a-4a3a-abb1-5a170064b6db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084554 Sep 02 10:01:41.600444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 922/1766] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:41.638383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5f637bd1-380d-4177-8070-743250716cec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:41.639035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5f637bd1-380d-4177-8070-743250716cec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:41.645349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f637bd1-380d-4177-8070-743250716cec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:41.645827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f637bd1-380d-4177-8070-743250716cec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:41.646257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f637bd1-380d-4177-8070-743250716cec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:41.646964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f637bd1-380d-4177-8070-743250716cec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:41.647413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f637bd1-380d-4177-8070-743250716cec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:41.647836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5f637bd1-380d-4177-8070-743250716cec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:41.707573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5f637bd1-380d-4177-8070-743250716cec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:41.715518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5f637bd1-380d-4177-8070-743250716cec tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.080964 Sep 02 10:01:41.716081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 845/1767] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:41 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:42.613352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-172d4db3-8f5e-4902-9fd7-033b9f93f7b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:42.613936 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-172d4db3-8f5e-4902-9fd7-033b9f93f7b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:42.620328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172d4db3-8f5e-4902-9fd7-033b9f93f7b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:42.620811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172d4db3-8f5e-4902-9fd7-033b9f93f7b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:42.621243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172d4db3-8f5e-4902-9fd7-033b9f93f7b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:42.621921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172d4db3-8f5e-4902-9fd7-033b9f93f7b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:42.622367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172d4db3-8f5e-4902-9fd7-033b9f93f7b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:42.622817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172d4db3-8f5e-4902-9fd7-033b9f93f7b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:42.683399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-172d4db3-8f5e-4902-9fd7-033b9f93f7b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:42.691875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-172d4db3-8f5e-4902-9fd7-033b9f93f7b4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082418 Sep 02 10:01:42.692438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 923/1768] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:42.736392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9d07c74e-8c15-4b54-afcb-06505c9608e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:42.737007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9d07c74e-8c15-4b54-afcb-06505c9608e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:42.743496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d07c74e-8c15-4b54-afcb-06505c9608e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:42.743980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d07c74e-8c15-4b54-afcb-06505c9608e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:42.744417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d07c74e-8c15-4b54-afcb-06505c9608e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:42.745098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d07c74e-8c15-4b54-afcb-06505c9608e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:42.745551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d07c74e-8c15-4b54-afcb-06505c9608e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:42.745975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9d07c74e-8c15-4b54-afcb-06505c9608e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:42.811774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9d07c74e-8c15-4b54-afcb-06505c9608e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:42.820491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9d07c74e-8c15-4b54-afcb-06505c9608e3 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087915 Sep 02 10:01:42.821061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 846/1769] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:42 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:43.712022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5b65550b-6090-41ec-8fe1-614cde292a99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:43.712610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5b65550b-6090-41ec-8fe1-614cde292a99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:43.719324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b65550b-6090-41ec-8fe1-614cde292a99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:43.719806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b65550b-6090-41ec-8fe1-614cde292a99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:43.720244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b65550b-6090-41ec-8fe1-614cde292a99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:43.720926 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b65550b-6090-41ec-8fe1-614cde292a99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:43.721380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b65550b-6090-41ec-8fe1-614cde292a99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:43.721804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5b65550b-6090-41ec-8fe1-614cde292a99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:43.781962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5b65550b-6090-41ec-8fe1-614cde292a99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:43.790069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5b65550b-6090-41ec-8fe1-614cde292a99 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081959 Sep 02 10:01:43.790642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 924/1770] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:43.840744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7763c43a-2ec3-4fd7-91c6-848b3c342786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:43.841383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7763c43a-2ec3-4fd7-91c6-848b3c342786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:43.847856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7763c43a-2ec3-4fd7-91c6-848b3c342786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:43.848339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7763c43a-2ec3-4fd7-91c6-848b3c342786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:43.848771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7763c43a-2ec3-4fd7-91c6-848b3c342786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:43.849478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7763c43a-2ec3-4fd7-91c6-848b3c342786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:43.849928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7763c43a-2ec3-4fd7-91c6-848b3c342786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:43.850375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7763c43a-2ec3-4fd7-91c6-848b3c342786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:43.910470 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7763c43a-2ec3-4fd7-91c6-848b3c342786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:43.919004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7763c43a-2ec3-4fd7-91c6-848b3c342786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081774 Sep 02 10:01:43.919254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 847/1771] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:43 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:44.811362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-767f2973-0d20-4784-98dd-16efed25637b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:44.811976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-767f2973-0d20-4784-98dd-16efed25637b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:44.814274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:01:44.819426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-767f2973-0d20-4784-98dd-16efed25637b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:44.819910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-767f2973-0d20-4784-98dd-16efed25637b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:44.820350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-767f2973-0d20-4784-98dd-16efed25637b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:44.821039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-767f2973-0d20-4784-98dd-16efed25637b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:44.821496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-767f2973-0d20-4784-98dd-16efed25637b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:44.821950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-767f2973-0d20-4784-98dd-16efed25637b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:44.883833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-767f2973-0d20-4784-98dd-16efed25637b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:44.892263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-767f2973-0d20-4784-98dd-16efed25637b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084788 Sep 02 10:01:44.892827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 925/1772] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:44.939796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-48fc7093-97a7-4ced-aad1-9bfacac7b407 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:44.940932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-48fc7093-97a7-4ced-aad1-9bfacac7b407 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:44.947321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fc7093-97a7-4ced-aad1-9bfacac7b407 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:44.947800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fc7093-97a7-4ced-aad1-9bfacac7b407 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:44.948232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fc7093-97a7-4ced-aad1-9bfacac7b407 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:44.948902 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fc7093-97a7-4ced-aad1-9bfacac7b407 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:44.949348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fc7093-97a7-4ced-aad1-9bfacac7b407 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:44.949765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-48fc7093-97a7-4ced-aad1-9bfacac7b407 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:45.010597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-48fc7093-97a7-4ced-aad1-9bfacac7b407 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:45.019377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-48fc7093-97a7-4ced-aad1-9bfacac7b407 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083429 Sep 02 10:01:45.019936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 848/1773] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:44 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:45.914147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-077a15a1-9c02-4349-8ddf-ac9aad21cb2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:45.914827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-077a15a1-9c02-4349-8ddf-ac9aad21cb2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:45.921219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-077a15a1-9c02-4349-8ddf-ac9aad21cb2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:45.921700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-077a15a1-9c02-4349-8ddf-ac9aad21cb2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:45.922136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-077a15a1-9c02-4349-8ddf-ac9aad21cb2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:45.922869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-077a15a1-9c02-4349-8ddf-ac9aad21cb2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:45.923321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-077a15a1-9c02-4349-8ddf-ac9aad21cb2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:45.923741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-077a15a1-9c02-4349-8ddf-ac9aad21cb2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:45.986735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-077a15a1-9c02-4349-8ddf-ac9aad21cb2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:45.994836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-077a15a1-9c02-4349-8ddf-ac9aad21cb2f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084573 Sep 02 10:01:45.995402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 926/1774] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:46.040533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8d16fd9c-9b13-4cb4-9e4a-ab1127d9651b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:46.041139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8d16fd9c-9b13-4cb4-9e4a-ab1127d9651b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:46.047526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d16fd9c-9b13-4cb4-9e4a-ab1127d9651b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:46.048047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d16fd9c-9b13-4cb4-9e4a-ab1127d9651b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:46.048483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d16fd9c-9b13-4cb4-9e4a-ab1127d9651b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:46.049166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d16fd9c-9b13-4cb4-9e4a-ab1127d9651b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:46.049620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d16fd9c-9b13-4cb4-9e4a-ab1127d9651b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:46.050045 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d16fd9c-9b13-4cb4-9e4a-ab1127d9651b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:46.109857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8d16fd9c-9b13-4cb4-9e4a-ab1127d9651b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:46.118000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8d16fd9c-9b13-4cb4-9e4a-ab1127d9651b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081285 Sep 02 10:01:46.118569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 849/1775] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:46 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:47.015734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f5ccd741-c81b-444a-9090-bc5776139b31 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:47.016343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f5ccd741-c81b-444a-9090-bc5776139b31 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:47.023317 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5ccd741-c81b-444a-9090-bc5776139b31 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:47.023813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5ccd741-c81b-444a-9090-bc5776139b31 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:47.024281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5ccd741-c81b-444a-9090-bc5776139b31 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:47.024916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5ccd741-c81b-444a-9090-bc5776139b31 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:47.025363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5ccd741-c81b-444a-9090-bc5776139b31 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:47.025784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5ccd741-c81b-444a-9090-bc5776139b31 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:47.085901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f5ccd741-c81b-444a-9090-bc5776139b31 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:47.094097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f5ccd741-c81b-444a-9090-bc5776139b31 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082294 Sep 02 10:01:47.094656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 927/1776] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:47.139032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1ec507a0-5ab0-40cc-a4cc-cfa21e6ed4c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:47.139648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1ec507a0-5ab0-40cc-a4cc-cfa21e6ed4c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:47.146626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec507a0-5ab0-40cc-a4cc-cfa21e6ed4c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:47.147132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec507a0-5ab0-40cc-a4cc-cfa21e6ed4c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:47.147565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec507a0-5ab0-40cc-a4cc-cfa21e6ed4c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:47.148246 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec507a0-5ab0-40cc-a4cc-cfa21e6ed4c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:47.148695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec507a0-5ab0-40cc-a4cc-cfa21e6ed4c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:47.149115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ec507a0-5ab0-40cc-a4cc-cfa21e6ed4c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:47.211824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1ec507a0-5ab0-40cc-a4cc-cfa21e6ed4c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:47.219885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1ec507a0-5ab0-40cc-a4cc-cfa21e6ed4c7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084748 Sep 02 10:01:47.220454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 850/1777] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:47 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:48.115313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4bcd9de8-426e-478c-b7bc-6d25ade2774b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:48.115937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4bcd9de8-426e-478c-b7bc-6d25ade2774b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:48.122362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4bcd9de8-426e-478c-b7bc-6d25ade2774b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:48.122891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4bcd9de8-426e-478c-b7bc-6d25ade2774b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:48.123338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4bcd9de8-426e-478c-b7bc-6d25ade2774b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:48.124031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4bcd9de8-426e-478c-b7bc-6d25ade2774b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:48.124493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4bcd9de8-426e-478c-b7bc-6d25ade2774b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:48.124921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4bcd9de8-426e-478c-b7bc-6d25ade2774b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:48.186762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4bcd9de8-426e-478c-b7bc-6d25ade2774b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:48.194832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4bcd9de8-426e-478c-b7bc-6d25ade2774b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083994 Sep 02 10:01:48.195404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 928/1778] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:48.239988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-be70e27b-3a5e-4274-ae60-b49086c5620c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:48.240591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-be70e27b-3a5e-4274-ae60-b49086c5620c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:48.246890 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be70e27b-3a5e-4274-ae60-b49086c5620c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:48.247369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be70e27b-3a5e-4274-ae60-b49086c5620c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:48.247796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be70e27b-3a5e-4274-ae60-b49086c5620c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:48.248472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be70e27b-3a5e-4274-ae60-b49086c5620c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:48.248927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be70e27b-3a5e-4274-ae60-b49086c5620c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:48.249344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be70e27b-3a5e-4274-ae60-b49086c5620c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:48.309376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be70e27b-3a5e-4274-ae60-b49086c5620c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:48.317588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-be70e27b-3a5e-4274-ae60-b49086c5620c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082054 Sep 02 10:01:48.318163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 851/1779] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:48 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:49.215523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-21f384fe-ddf4-4ede-afc0-04a555eb304a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:49.216083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-21f384fe-ddf4-4ede-afc0-04a555eb304a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:49.222402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-21f384fe-ddf4-4ede-afc0-04a555eb304a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:49.222920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-21f384fe-ddf4-4ede-afc0-04a555eb304a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:49.223363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-21f384fe-ddf4-4ede-afc0-04a555eb304a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:49.224050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-21f384fe-ddf4-4ede-afc0-04a555eb304a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:49.224503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-21f384fe-ddf4-4ede-afc0-04a555eb304a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:49.224928 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-21f384fe-ddf4-4ede-afc0-04a555eb304a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:49.285067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-21f384fe-ddf4-4ede-afc0-04a555eb304a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:49.287217 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:01:49.293733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-21f384fe-ddf4-4ede-afc0-04a555eb304a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082174 Sep 02 10:01:49.294293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 929/1780] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:49.337268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3af98e75-8558-4d0d-80a0-8f0db922bbe9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:49.337905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3af98e75-8558-4d0d-80a0-8f0db922bbe9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:49.344371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3af98e75-8558-4d0d-80a0-8f0db922bbe9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:49.344851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3af98e75-8558-4d0d-80a0-8f0db922bbe9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:49.345283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3af98e75-8558-4d0d-80a0-8f0db922bbe9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:49.345958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3af98e75-8558-4d0d-80a0-8f0db922bbe9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:49.346406 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3af98e75-8558-4d0d-80a0-8f0db922bbe9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:49.346857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3af98e75-8558-4d0d-80a0-8f0db922bbe9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:49.406766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3af98e75-8558-4d0d-80a0-8f0db922bbe9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:49.414639 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3af98e75-8558-4d0d-80a0-8f0db922bbe9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081205 Sep 02 10:01:49.415223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 852/1781] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:49 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:50.315071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a01a24b0-5ce6-44ac-b7fd-b70002809442 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:50.315667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a01a24b0-5ce6-44ac-b7fd-b70002809442 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:50.322696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a01a24b0-5ce6-44ac-b7fd-b70002809442 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:50.323197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a01a24b0-5ce6-44ac-b7fd-b70002809442 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:50.323638 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a01a24b0-5ce6-44ac-b7fd-b70002809442 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:50.324322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a01a24b0-5ce6-44ac-b7fd-b70002809442 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:50.324776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a01a24b0-5ce6-44ac-b7fd-b70002809442 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:50.325199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a01a24b0-5ce6-44ac-b7fd-b70002809442 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:50.388678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a01a24b0-5ce6-44ac-b7fd-b70002809442 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:50.397489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a01a24b0-5ce6-44ac-b7fd-b70002809442 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086683 Sep 02 10:01:50.402858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 930/1782] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:50.435764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6f635c07-98c5-4910-8824-b6b196b889b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:50.436407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6f635c07-98c5-4910-8824-b6b196b889b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:50.438735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=58 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:01:50.443923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f635c07-98c5-4910-8824-b6b196b889b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:50.444415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f635c07-98c5-4910-8824-b6b196b889b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:50.444851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f635c07-98c5-4910-8824-b6b196b889b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:50.445540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f635c07-98c5-4910-8824-b6b196b889b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:50.446015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f635c07-98c5-4910-8824-b6b196b889b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:50.446451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f635c07-98c5-4910-8824-b6b196b889b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:50.511642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6f635c07-98c5-4910-8824-b6b196b889b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:50.524659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6f635c07-98c5-4910-8824-b6b196b889b6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.092788 Sep 02 10:01:50.525232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 853/1783] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:50 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:51.418686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-eb8b1167-bc98-48f8-a6f8-9a032f8dff9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:51.419348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-eb8b1167-bc98-48f8-a6f8-9a032f8dff9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:51.425855 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb8b1167-bc98-48f8-a6f8-9a032f8dff9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:51.426339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb8b1167-bc98-48f8-a6f8-9a032f8dff9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:51.426804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb8b1167-bc98-48f8-a6f8-9a032f8dff9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:51.427491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb8b1167-bc98-48f8-a6f8-9a032f8dff9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:51.427973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb8b1167-bc98-48f8-a6f8-9a032f8dff9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:51.428398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eb8b1167-bc98-48f8-a6f8-9a032f8dff9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:51.488758 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eb8b1167-bc98-48f8-a6f8-9a032f8dff9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:51.496971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-eb8b1167-bc98-48f8-a6f8-9a032f8dff9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082199 Sep 02 10:01:51.497546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 931/1784] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:51.545222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3ba0f693-4a8a-4d07-b200-de47020cb017 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:51.545835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3ba0f693-4a8a-4d07-b200-de47020cb017 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:51.552320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ba0f693-4a8a-4d07-b200-de47020cb017 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:51.552801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ba0f693-4a8a-4d07-b200-de47020cb017 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:51.553238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ba0f693-4a8a-4d07-b200-de47020cb017 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:51.553920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ba0f693-4a8a-4d07-b200-de47020cb017 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:51.554370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ba0f693-4a8a-4d07-b200-de47020cb017 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:51.554822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3ba0f693-4a8a-4d07-b200-de47020cb017 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:51.617838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3ba0f693-4a8a-4d07-b200-de47020cb017 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:51.626052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3ba0f693-4a8a-4d07-b200-de47020cb017 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084665 Sep 02 10:01:51.626617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 854/1785] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:51 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:52.517893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1cb1314f-e56b-4238-b371-90cbc91782d3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:52.518500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1cb1314f-e56b-4238-b371-90cbc91782d3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:52.525475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb1314f-e56b-4238-b371-90cbc91782d3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:52.525951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb1314f-e56b-4238-b371-90cbc91782d3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:52.526383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb1314f-e56b-4238-b371-90cbc91782d3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:52.527087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb1314f-e56b-4238-b371-90cbc91782d3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:52.527533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb1314f-e56b-4238-b371-90cbc91782d3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:52.527952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1cb1314f-e56b-4238-b371-90cbc91782d3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:52.588817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1cb1314f-e56b-4238-b371-90cbc91782d3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:52.596850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1cb1314f-e56b-4238-b371-90cbc91782d3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082860 Sep 02 10:01:52.597405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 932/1786] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:52.645800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b6fa2744-66a4-4a3e-b31f-cb6330c6f67e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:52.646414 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b6fa2744-66a4-4a3e-b31f-cb6330c6f67e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:52.652981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6fa2744-66a4-4a3e-b31f-cb6330c6f67e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:52.653468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6fa2744-66a4-4a3e-b31f-cb6330c6f67e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:52.653956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6fa2744-66a4-4a3e-b31f-cb6330c6f67e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:52.654648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6fa2744-66a4-4a3e-b31f-cb6330c6f67e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:52.655132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6fa2744-66a4-4a3e-b31f-cb6330c6f67e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:52.655561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6fa2744-66a4-4a3e-b31f-cb6330c6f67e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:52.716426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b6fa2744-66a4-4a3e-b31f-cb6330c6f67e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:52.724952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b6fa2744-66a4-4a3e-b31f-cb6330c6f67e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083005 Sep 02 10:01:52.725522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 855/1787] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:52 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:53.617970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-00b76c2e-cee1-4988-b2e5-be443d206c1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:53.618616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-00b76c2e-cee1-4988-b2e5-be443d206c1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:53.625031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00b76c2e-cee1-4988-b2e5-be443d206c1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:53.625512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00b76c2e-cee1-4988-b2e5-be443d206c1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:53.625950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00b76c2e-cee1-4988-b2e5-be443d206c1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:53.626635 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00b76c2e-cee1-4988-b2e5-be443d206c1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:53.627130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00b76c2e-cee1-4988-b2e5-be443d206c1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:53.627809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00b76c2e-cee1-4988-b2e5-be443d206c1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:53.688048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-00b76c2e-cee1-4988-b2e5-be443d206c1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:53.696233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-00b76c2e-cee1-4988-b2e5-be443d206c1f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082117 Sep 02 10:01:53.696790 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 933/1788] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:53.746527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c8ee67be-6da6-4f1b-a90c-40b8b537317e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:53.747174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c8ee67be-6da6-4f1b-a90c-40b8b537317e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:53.753988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8ee67be-6da6-4f1b-a90c-40b8b537317e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:53.754474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8ee67be-6da6-4f1b-a90c-40b8b537317e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:53.754942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8ee67be-6da6-4f1b-a90c-40b8b537317e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:53.755670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8ee67be-6da6-4f1b-a90c-40b8b537317e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:53.756127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8ee67be-6da6-4f1b-a90c-40b8b537317e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:53.756553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8ee67be-6da6-4f1b-a90c-40b8b537317e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:53.816407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c8ee67be-6da6-4f1b-a90c-40b8b537317e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:53.824502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c8ee67be-6da6-4f1b-a90c-40b8b537317e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081841 Sep 02 10:01:53.825073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 856/1789] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:53 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:54.716831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-29fdb5df-fcb2-4ca1-8749-382540dbe338 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:54.717467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-29fdb5df-fcb2-4ca1-8749-382540dbe338 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:54.724472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29fdb5df-fcb2-4ca1-8749-382540dbe338 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:54.724949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29fdb5df-fcb2-4ca1-8749-382540dbe338 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:54.725385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29fdb5df-fcb2-4ca1-8749-382540dbe338 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:54.726060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29fdb5df-fcb2-4ca1-8749-382540dbe338 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:54.726508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29fdb5df-fcb2-4ca1-8749-382540dbe338 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:54.726956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29fdb5df-fcb2-4ca1-8749-382540dbe338 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:54.792403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-29fdb5df-fcb2-4ca1-8749-382540dbe338 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:54.800496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-29fdb5df-fcb2-4ca1-8749-382540dbe338 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087581 Sep 02 10:01:54.801058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 934/1790] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:54.845634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d3dced3b-9297-49ec-8bb2-5850b6bc4dc4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:54.846133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d3dced3b-9297-49ec-8bb2-5850b6bc4dc4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:54.852663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3dced3b-9297-49ec-8bb2-5850b6bc4dc4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:54.853149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3dced3b-9297-49ec-8bb2-5850b6bc4dc4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:54.853582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3dced3b-9297-49ec-8bb2-5850b6bc4dc4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:54.854435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3dced3b-9297-49ec-8bb2-5850b6bc4dc4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:54.854928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3dced3b-9297-49ec-8bb2-5850b6bc4dc4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:54.855351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d3dced3b-9297-49ec-8bb2-5850b6bc4dc4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:54.869860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:01:54.922315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d3dced3b-9297-49ec-8bb2-5850b6bc4dc4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:54.930731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d3dced3b-9297-49ec-8bb2-5850b6bc4dc4 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.089181 Sep 02 10:01:54.931328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 857/1791] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:54 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:55.822575 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-be318996-a436-441d-bc5c-c489930a4fd7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:55.823311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-be318996-a436-441d-bc5c-c489930a4fd7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:55.829588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be318996-a436-441d-bc5c-c489930a4fd7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:55.830073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be318996-a436-441d-bc5c-c489930a4fd7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:55.830517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be318996-a436-441d-bc5c-c489930a4fd7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:55.831236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be318996-a436-441d-bc5c-c489930a4fd7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:55.831687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be318996-a436-441d-bc5c-c489930a4fd7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:55.832114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-be318996-a436-441d-bc5c-c489930a4fd7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:55.894166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-be318996-a436-441d-bc5c-c489930a4fd7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:55.903007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-be318996-a436-441d-bc5c-c489930a4fd7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084429 Sep 02 10:01:55.903569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 935/1792] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:55.952158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8e5b4558-fc17-4b0c-958b-743f8df3675c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:55.952802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8e5b4558-fc17-4b0c-958b-743f8df3675c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:55.959975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e5b4558-fc17-4b0c-958b-743f8df3675c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:55.960493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e5b4558-fc17-4b0c-958b-743f8df3675c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:55.960956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e5b4558-fc17-4b0c-958b-743f8df3675c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:55.961636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e5b4558-fc17-4b0c-958b-743f8df3675c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:55.962086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e5b4558-fc17-4b0c-958b-743f8df3675c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:55.962508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e5b4558-fc17-4b0c-958b-743f8df3675c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:56.025516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8e5b4558-fc17-4b0c-958b-743f8df3675c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:56.033710 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8e5b4558-fc17-4b0c-958b-743f8df3675c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085732 Sep 02 10:01:56.034278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 858/1793] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:55 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:56.924401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cea42dae-a09a-411b-b036-4c68b23ab068 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:56.925009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cea42dae-a09a-411b-b036-4c68b23ab068 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:56.931917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cea42dae-a09a-411b-b036-4c68b23ab068 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:56.932400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cea42dae-a09a-411b-b036-4c68b23ab068 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:56.932835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cea42dae-a09a-411b-b036-4c68b23ab068 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:56.933517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cea42dae-a09a-411b-b036-4c68b23ab068 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:56.933973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cea42dae-a09a-411b-b036-4c68b23ab068 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:56.934396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cea42dae-a09a-411b-b036-4c68b23ab068 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:56.995495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cea42dae-a09a-411b-b036-4c68b23ab068 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:57.003759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cea42dae-a09a-411b-b036-4c68b23ab068 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083294 Sep 02 10:01:57.004325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 936/1794] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:57.055927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8e469acf-48a6-400b-9499-b51bd3e80495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:57.056541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8e469acf-48a6-400b-9499-b51bd3e80495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:57.063100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e469acf-48a6-400b-9499-b51bd3e80495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:57.063589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e469acf-48a6-400b-9499-b51bd3e80495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:57.064034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e469acf-48a6-400b-9499-b51bd3e80495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:57.064853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e469acf-48a6-400b-9499-b51bd3e80495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:57.065309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e469acf-48a6-400b-9499-b51bd3e80495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:57.065759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e469acf-48a6-400b-9499-b51bd3e80495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:57.128238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8e469acf-48a6-400b-9499-b51bd3e80495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:57.136416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8e469acf-48a6-400b-9499-b51bd3e80495 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085014 Sep 02 10:01:57.136986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 859/1795] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:57 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:58.023587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e56b85a6-f08d-4dfb-a651-554c0bb1d094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:58.024195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e56b85a6-f08d-4dfb-a651-554c0bb1d094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:58.030601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e56b85a6-f08d-4dfb-a651-554c0bb1d094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:58.031117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e56b85a6-f08d-4dfb-a651-554c0bb1d094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:58.031557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e56b85a6-f08d-4dfb-a651-554c0bb1d094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:58.032246 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e56b85a6-f08d-4dfb-a651-554c0bb1d094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:58.032701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e56b85a6-f08d-4dfb-a651-554c0bb1d094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:58.033128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e56b85a6-f08d-4dfb-a651-554c0bb1d094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:58.093770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e56b85a6-f08d-4dfb-a651-554c0bb1d094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:58.102573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e56b85a6-f08d-4dfb-a651-554c0bb1d094 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082841 Sep 02 10:01:58.103109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 937/1796] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:58.156591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ddd97908-e7c3-4da5-83ce-8a5f5a4e00f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:58.157205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ddd97908-e7c3-4da5-83ce-8a5f5a4e00f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:58.164404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddd97908-e7c3-4da5-83ce-8a5f5a4e00f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:58.164890 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddd97908-e7c3-4da5-83ce-8a5f5a4e00f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:58.165324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddd97908-e7c3-4da5-83ce-8a5f5a4e00f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:58.166008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddd97908-e7c3-4da5-83ce-8a5f5a4e00f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:58.166460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddd97908-e7c3-4da5-83ce-8a5f5a4e00f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:58.166929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddd97908-e7c3-4da5-83ce-8a5f5a4e00f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:58.226282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ddd97908-e7c3-4da5-83ce-8a5f5a4e00f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:58.234226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ddd97908-e7c3-4da5-83ce-8a5f5a4e00f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081465 Sep 02 10:01:58.234815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 860/1797] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:58 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:59.122833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3411180a-33df-40f6-9451-c714b53e3212 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:59.123381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3411180a-33df-40f6-9451-c714b53e3212 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:59.130858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3411180a-33df-40f6-9451-c714b53e3212 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:59.131351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3411180a-33df-40f6-9451-c714b53e3212 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:59.131797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3411180a-33df-40f6-9451-c714b53e3212 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:59.132522 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3411180a-33df-40f6-9451-c714b53e3212 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:59.133008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3411180a-33df-40f6-9451-c714b53e3212 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:59.133446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3411180a-33df-40f6-9451-c714b53e3212 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:59.197074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3411180a-33df-40f6-9451-c714b53e3212 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:59.205173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3411180a-33df-40f6-9451-c714b53e3212 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086343 Sep 02 10:01:59.205736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 938/1798] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:01:59.255147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-75e937a2-423a-4323-af3e-7239ce37d359 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:01:59.255745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-75e937a2-423a-4323-af3e-7239ce37d359 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:01:59.262073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75e937a2-423a-4323-af3e-7239ce37d359 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:59.262547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75e937a2-423a-4323-af3e-7239ce37d359 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:59.263011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75e937a2-423a-4323-af3e-7239ce37d359 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:59.263687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75e937a2-423a-4323-af3e-7239ce37d359 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:01:59.264133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75e937a2-423a-4323-af3e-7239ce37d359 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:01:59.264551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75e937a2-423a-4323-af3e-7239ce37d359 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:01:59.324650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-75e937a2-423a-4323-af3e-7239ce37d359 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:01:59.332666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-75e937a2-423a-4323-af3e-7239ce37d359 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081650 Sep 02 10:01:59.333231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 861/1799] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:01:59 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:00.225156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a9cfb7fd-7008-4917-8470-a679e4e54275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:00.225770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a9cfb7fd-7008-4917-8470-a679e4e54275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:00.232127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9cfb7fd-7008-4917-8470-a679e4e54275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:00.232606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9cfb7fd-7008-4917-8470-a679e4e54275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:00.233040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9cfb7fd-7008-4917-8470-a679e4e54275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:00.233719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9cfb7fd-7008-4917-8470-a679e4e54275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:00.234167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9cfb7fd-7008-4917-8470-a679e4e54275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:00.234586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9cfb7fd-7008-4917-8470-a679e4e54275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:00.296965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a9cfb7fd-7008-4917-8470-a679e4e54275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:00.305051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a9cfb7fd-7008-4917-8470-a679e4e54275 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083666 Sep 02 10:02:00.305603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 939/1800] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:00.353509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2c99eedf-a7f0-48c0-9366-ddbd8b866d80 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:00.354120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2c99eedf-a7f0-48c0-9366-ddbd8b866d80 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:00.360618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c99eedf-a7f0-48c0-9366-ddbd8b866d80 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:00.361105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c99eedf-a7f0-48c0-9366-ddbd8b866d80 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:00.361547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c99eedf-a7f0-48c0-9366-ddbd8b866d80 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:00.362230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c99eedf-a7f0-48c0-9366-ddbd8b866d80 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:00.362683 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c99eedf-a7f0-48c0-9366-ddbd8b866d80 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:00.363155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2c99eedf-a7f0-48c0-9366-ddbd8b866d80 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:00.427971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2c99eedf-a7f0-48c0-9366-ddbd8b866d80 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:00.436571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2c99eedf-a7f0-48c0-9366-ddbd8b866d80 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087078 Sep 02 10:02:00.437179 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 862/1801] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:00 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:01.325924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0eb03eb9-e306-4018-81b7-a528a30f4544 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:01.326457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0eb03eb9-e306-4018-81b7-a528a30f4544 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:01.332855 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0eb03eb9-e306-4018-81b7-a528a30f4544 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:01.333340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0eb03eb9-e306-4018-81b7-a528a30f4544 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:01.333778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0eb03eb9-e306-4018-81b7-a528a30f4544 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:01.334466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0eb03eb9-e306-4018-81b7-a528a30f4544 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:01.334947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0eb03eb9-e306-4018-81b7-a528a30f4544 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:01.335378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0eb03eb9-e306-4018-81b7-a528a30f4544 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:01.395605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0eb03eb9-e306-4018-81b7-a528a30f4544 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:01.403718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0eb03eb9-e306-4018-81b7-a528a30f4544 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081773 Sep 02 10:02:01.404275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 940/1802] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:01.457274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ce74d522-6977-4ec4-a573-a40464b291f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:01.457883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ce74d522-6977-4ec4-a573-a40464b291f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:01.464252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce74d522-6977-4ec4-a573-a40464b291f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:01.464736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce74d522-6977-4ec4-a573-a40464b291f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:01.465167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce74d522-6977-4ec4-a573-a40464b291f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:01.465845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce74d522-6977-4ec4-a573-a40464b291f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:01.466295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce74d522-6977-4ec4-a573-a40464b291f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:01.466734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce74d522-6977-4ec4-a573-a40464b291f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:01.526647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ce74d522-6977-4ec4-a573-a40464b291f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:01.534967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ce74d522-6977-4ec4-a573-a40464b291f2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081573 Sep 02 10:02:01.536007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 863/1803] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:01 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:02.423546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-11e3e54c-2565-479e-91af-9d9de9eaaee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:02.424161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-11e3e54c-2565-479e-91af-9d9de9eaaee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:02.430690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11e3e54c-2565-479e-91af-9d9de9eaaee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:02.431205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11e3e54c-2565-479e-91af-9d9de9eaaee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:02.431646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11e3e54c-2565-479e-91af-9d9de9eaaee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:02.432338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11e3e54c-2565-479e-91af-9d9de9eaaee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:02.432792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11e3e54c-2565-479e-91af-9d9de9eaaee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:02.433217 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11e3e54c-2565-479e-91af-9d9de9eaaee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:02.496055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-11e3e54c-2565-479e-91af-9d9de9eaaee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:02.505076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-11e3e54c-2565-479e-91af-9d9de9eaaee5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084950 Sep 02 10:02:02.505642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 941/1804] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:02.556057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4f847ea8-9973-4462-97ca-85d75ab5e1bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:02.556662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4f847ea8-9973-4462-97ca-85d75ab5e1bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:02.562644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f847ea8-9973-4462-97ca-85d75ab5e1bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:02.563150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f847ea8-9973-4462-97ca-85d75ab5e1bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:02.563581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f847ea8-9973-4462-97ca-85d75ab5e1bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:02.564257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f847ea8-9973-4462-97ca-85d75ab5e1bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:02.564706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f847ea8-9973-4462-97ca-85d75ab5e1bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:02.565131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4f847ea8-9973-4462-97ca-85d75ab5e1bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:02.625368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4f847ea8-9973-4462-97ca-85d75ab5e1bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:02.634499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4f847ea8-9973-4462-97ca-85d75ab5e1bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082460 Sep 02 10:02:02.635061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 864/1805] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:02 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:03.526403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-78700793-dd4e-41b4-abf4-ffd4c10f8176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:03.527048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-78700793-dd4e-41b4-abf4-ffd4c10f8176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:03.533603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78700793-dd4e-41b4-abf4-ffd4c10f8176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:03.534091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78700793-dd4e-41b4-abf4-ffd4c10f8176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:03.534533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78700793-dd4e-41b4-abf4-ffd4c10f8176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:03.535284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78700793-dd4e-41b4-abf4-ffd4c10f8176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:03.536353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78700793-dd4e-41b4-abf4-ffd4c10f8176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:03.536780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-78700793-dd4e-41b4-abf4-ffd4c10f8176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:03.599541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-78700793-dd4e-41b4-abf4-ffd4c10f8176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:03.607564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-78700793-dd4e-41b4-abf4-ffd4c10f8176 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085026 Sep 02 10:02:03.608134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 942/1806] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:03.654821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4795b790-1b7f-438a-acad-2c12d7695c06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:03.655438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4795b790-1b7f-438a-acad-2c12d7695c06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:03.662453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4795b790-1b7f-438a-acad-2c12d7695c06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:03.662970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4795b790-1b7f-438a-acad-2c12d7695c06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:03.663429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4795b790-1b7f-438a-acad-2c12d7695c06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:03.664120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4795b790-1b7f-438a-acad-2c12d7695c06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:03.664572 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4795b790-1b7f-438a-acad-2c12d7695c06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:03.664997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4795b790-1b7f-438a-acad-2c12d7695c06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:03.725665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4795b790-1b7f-438a-acad-2c12d7695c06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:03.733667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4795b790-1b7f-438a-acad-2c12d7695c06 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082682 Sep 02 10:02:03.734229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 865/1807] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:03 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:04.627503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-39b548df-46f5-4b61-a3b3-147f00c3ea8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:04.628124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-39b548df-46f5-4b61-a3b3-147f00c3ea8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:04.634963 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-39b548df-46f5-4b61-a3b3-147f00c3ea8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:04.635492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-39b548df-46f5-4b61-a3b3-147f00c3ea8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:04.635933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-39b548df-46f5-4b61-a3b3-147f00c3ea8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:04.636634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-39b548df-46f5-4b61-a3b3-147f00c3ea8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:04.637094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-39b548df-46f5-4b61-a3b3-147f00c3ea8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:04.637518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-39b548df-46f5-4b61-a3b3-147f00c3ea8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:04.753987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e9d0e25f-0f77-4635-9e84-df02d4a0f88b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:04.754669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e9d0e25f-0f77-4635-9e84-df02d4a0f88b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:04.761468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9d0e25f-0f77-4635-9e84-df02d4a0f88b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:04.761946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9d0e25f-0f77-4635-9e84-df02d4a0f88b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:04.762377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9d0e25f-0f77-4635-9e84-df02d4a0f88b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:04.763101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9d0e25f-0f77-4635-9e84-df02d4a0f88b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:04.763548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9d0e25f-0f77-4635-9e84-df02d4a0f88b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:04.763973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9d0e25f-0f77-4635-9e84-df02d4a0f88b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:04.832930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e9d0e25f-0f77-4635-9e84-df02d4a0f88b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:04.841451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e9d0e25f-0f77-4635-9e84-df02d4a0f88b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.091774 Sep 02 10:02:04.845475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 866/1808] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:04 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:04.893347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-39b548df-46f5-4b61-a3b3-147f00c3ea8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:04.902098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-39b548df-46f5-4b61-a3b3-147f00c3ea8d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.278741 Sep 02 10:02:04.906201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 943/1809] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:05.865266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-10d0c4d2-1fd3-481f-96ae-f1beeafd7b7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:05.865266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-10d0c4d2-1fd3-481f-96ae-f1beeafd7b7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:05.871530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10d0c4d2-1fd3-481f-96ae-f1beeafd7b7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:05.872022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10d0c4d2-1fd3-481f-96ae-f1beeafd7b7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:05.872460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10d0c4d2-1fd3-481f-96ae-f1beeafd7b7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:05.873160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10d0c4d2-1fd3-481f-96ae-f1beeafd7b7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:05.873614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10d0c4d2-1fd3-481f-96ae-f1beeafd7b7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:05.874037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-10d0c4d2-1fd3-481f-96ae-f1beeafd7b7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:05.923386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-67adad4f-8211-4aaa-8ec8-faab5d74cd55 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:05.924029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-67adad4f-8211-4aaa-8ec8-faab5d74cd55 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:05.930746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67adad4f-8211-4aaa-8ec8-faab5d74cd55 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:05.931374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67adad4f-8211-4aaa-8ec8-faab5d74cd55 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:05.931820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67adad4f-8211-4aaa-8ec8-faab5d74cd55 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:05.932550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67adad4f-8211-4aaa-8ec8-faab5d74cd55 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:05.932973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67adad4f-8211-4aaa-8ec8-faab5d74cd55 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:05.933527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67adad4f-8211-4aaa-8ec8-faab5d74cd55 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:05.936111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-10d0c4d2-1fd3-481f-96ae-f1beeafd7b7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:05.944168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-10d0c4d2-1fd3-481f-96ae-f1beeafd7b7e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084040 Sep 02 10:02:05.944737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 867/1810] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:05 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:05.994274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67adad4f-8211-4aaa-8ec8-faab5d74cd55 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:06.002567 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-67adad4f-8211-4aaa-8ec8-faab5d74cd55 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082853 Sep 02 10:02:06.003169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 944/1811] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:06.964976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1a458b98-1b6a-45cd-8952-902a56ec4a9c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:06.965585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1a458b98-1b6a-45cd-8952-902a56ec4a9c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:06.972104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a458b98-1b6a-45cd-8952-902a56ec4a9c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:06.972617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a458b98-1b6a-45cd-8952-902a56ec4a9c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:06.973096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a458b98-1b6a-45cd-8952-902a56ec4a9c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:06.973783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a458b98-1b6a-45cd-8952-902a56ec4a9c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:06.974235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a458b98-1b6a-45cd-8952-902a56ec4a9c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:06.974659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1a458b98-1b6a-45cd-8952-902a56ec4a9c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:07.024451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b8612767-c0a3-4736-bf6a-e5b94f6cc65c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:07.025090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b8612767-c0a3-4736-bf6a-e5b94f6cc65c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:07.031535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8612767-c0a3-4736-bf6a-e5b94f6cc65c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:07.032019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8612767-c0a3-4736-bf6a-e5b94f6cc65c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:07.032464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8612767-c0a3-4736-bf6a-e5b94f6cc65c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:07.033265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8612767-c0a3-4736-bf6a-e5b94f6cc65c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:07.033598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8612767-c0a3-4736-bf6a-e5b94f6cc65c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:07.034024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b8612767-c0a3-4736-bf6a-e5b94f6cc65c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:07.035422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1a458b98-1b6a-45cd-8952-902a56ec4a9c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:07.043620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1a458b98-1b6a-45cd-8952-902a56ec4a9c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082561 Sep 02 10:02:07.044385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 868/1812] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:06 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:07.094661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b8612767-c0a3-4736-bf6a-e5b94f6cc65c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:07.102822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b8612767-c0a3-4736-bf6a-e5b94f6cc65c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082943 Sep 02 10:02:07.103319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 945/1813] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:08.064919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ca28dcde-a0cb-401a-97f4-cda54a00520b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:08.065492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ca28dcde-a0cb-401a-97f4-cda54a00520b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:08.072547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca28dcde-a0cb-401a-97f4-cda54a00520b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:08.073026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca28dcde-a0cb-401a-97f4-cda54a00520b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:08.073457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca28dcde-a0cb-401a-97f4-cda54a00520b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:08.074138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca28dcde-a0cb-401a-97f4-cda54a00520b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:08.074586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca28dcde-a0cb-401a-97f4-cda54a00520b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:08.075030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca28dcde-a0cb-401a-97f4-cda54a00520b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:08.124048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-81bbbc79-431f-4bb4-ba9a-7cfe12e0e40b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:08.124916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-81bbbc79-431f-4bb4-ba9a-7cfe12e0e40b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:08.131309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bbbc79-431f-4bb4-ba9a-7cfe12e0e40b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:08.131881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bbbc79-431f-4bb4-ba9a-7cfe12e0e40b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:08.132382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bbbc79-431f-4bb4-ba9a-7cfe12e0e40b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:08.133221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bbbc79-431f-4bb4-ba9a-7cfe12e0e40b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:08.133520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bbbc79-431f-4bb4-ba9a-7cfe12e0e40b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:08.133946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81bbbc79-431f-4bb4-ba9a-7cfe12e0e40b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:08.135381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ca28dcde-a0cb-401a-97f4-cda54a00520b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:08.143507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ca28dcde-a0cb-401a-97f4-cda54a00520b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082527 Sep 02 10:02:08.144076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 869/1814] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:08 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:08.149256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:02:08.197310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-81bbbc79-431f-4bb4-ba9a-7cfe12e0e40b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:08.205181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-81bbbc79-431f-4bb4-ba9a-7cfe12e0e40b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085260 Sep 02 10:02:08.205746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 946/1815] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:09.165245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7a8cf9e1-7549-402c-a5bb-1f5a1a019ada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:09.165819 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7a8cf9e1-7549-402c-a5bb-1f5a1a019ada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:09.172286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a8cf9e1-7549-402c-a5bb-1f5a1a019ada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:09.172774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a8cf9e1-7549-402c-a5bb-1f5a1a019ada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:09.176404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a8cf9e1-7549-402c-a5bb-1f5a1a019ada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:09.176404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a8cf9e1-7549-402c-a5bb-1f5a1a019ada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:09.176404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a8cf9e1-7549-402c-a5bb-1f5a1a019ada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:09.176404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7a8cf9e1-7549-402c-a5bb-1f5a1a019ada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:09.225807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-37227406-c4a4-4818-924a-119e4e69988a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:09.226491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-37227406-c4a4-4818-924a-119e4e69988a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:09.232797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37227406-c4a4-4818-924a-119e4e69988a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:09.233284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37227406-c4a4-4818-924a-119e4e69988a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:09.233719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37227406-c4a4-4818-924a-119e4e69988a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:09.234409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37227406-c4a4-4818-924a-119e4e69988a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:09.234893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37227406-c4a4-4818-924a-119e4e69988a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:09.235321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-37227406-c4a4-4818-924a-119e4e69988a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:09.240196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7a8cf9e1-7549-402c-a5bb-1f5a1a019ada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:09.248281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7a8cf9e1-7549-402c-a5bb-1f5a1a019ada tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087528 Sep 02 10:02:09.248839 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 870/1816] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:09 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:09.298035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-37227406-c4a4-4818-924a-119e4e69988a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:09.306780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-37227406-c4a4-4818-924a-119e4e69988a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085324 Sep 02 10:02:09.307340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 947/1817] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:10.269236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3c6d1afe-4db6-44d3-a926-cc059d263b18 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:10.269849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3c6d1afe-4db6-44d3-a926-cc059d263b18 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:10.276300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c6d1afe-4db6-44d3-a926-cc059d263b18 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:10.276787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c6d1afe-4db6-44d3-a926-cc059d263b18 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:10.277226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c6d1afe-4db6-44d3-a926-cc059d263b18 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:10.277915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c6d1afe-4db6-44d3-a926-cc059d263b18 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:10.278373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c6d1afe-4db6-44d3-a926-cc059d263b18 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:10.278831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c6d1afe-4db6-44d3-a926-cc059d263b18 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:10.327439 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c488d0f7-7074-40ac-84f2-093e1b215090 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:10.328073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c488d0f7-7074-40ac-84f2-093e1b215090 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:10.334912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c488d0f7-7074-40ac-84f2-093e1b215090 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:10.335397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c488d0f7-7074-40ac-84f2-093e1b215090 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:10.335833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c488d0f7-7074-40ac-84f2-093e1b215090 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:10.336532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c488d0f7-7074-40ac-84f2-093e1b215090 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:10.337277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c488d0f7-7074-40ac-84f2-093e1b215090 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:10.337411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c488d0f7-7074-40ac-84f2-093e1b215090 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:10.339362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3c6d1afe-4db6-44d3-a926-cc059d263b18 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:10.347618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3c6d1afe-4db6-44d3-a926-cc059d263b18 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082251 Sep 02 10:02:10.348186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 871/1818] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:10 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:10.399283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c488d0f7-7074-40ac-84f2-093e1b215090 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:10.407503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c488d0f7-7074-40ac-84f2-093e1b215090 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084020 Sep 02 10:02:10.408068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 948/1819] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:11.369006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-25a5d865-b21d-4973-8754-dd39f1a50401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:11.369609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-25a5d865-b21d-4973-8754-dd39f1a50401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:11.376015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25a5d865-b21d-4973-8754-dd39f1a50401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:11.376494 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25a5d865-b21d-4973-8754-dd39f1a50401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:11.376924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25a5d865-b21d-4973-8754-dd39f1a50401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:11.377862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25a5d865-b21d-4973-8754-dd39f1a50401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:11.378309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25a5d865-b21d-4973-8754-dd39f1a50401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:11.378749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-25a5d865-b21d-4973-8754-dd39f1a50401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:11.429661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2d93fe7d-585a-4910-9636-96542d325311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:11.430277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2d93fe7d-585a-4910-9636-96542d325311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:11.437200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d93fe7d-585a-4910-9636-96542d325311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:11.437689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d93fe7d-585a-4910-9636-96542d325311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:11.438129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d93fe7d-585a-4910-9636-96542d325311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:11.438853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d93fe7d-585a-4910-9636-96542d325311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:11.439309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d93fe7d-585a-4910-9636-96542d325311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:11.439439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-25a5d865-b21d-4973-8754-dd39f1a50401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:11.439742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d93fe7d-585a-4910-9636-96542d325311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:11.447649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-25a5d865-b21d-4973-8754-dd39f1a50401 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083111 Sep 02 10:02:11.448225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 872/1820] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:11 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:11.504608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2d93fe7d-585a-4910-9636-96542d325311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:11.513597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2d93fe7d-585a-4910-9636-96542d325311 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.088475 Sep 02 10:02:11.514164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 949/1821] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:12.468010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-42f71fa8-d3b3-47c1-9328-0c4d4e0e1b03 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:12.468623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-42f71fa8-d3b3-47c1-9328-0c4d4e0e1b03 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:12.475387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f71fa8-d3b3-47c1-9328-0c4d4e0e1b03 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:12.475881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f71fa8-d3b3-47c1-9328-0c4d4e0e1b03 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:12.476320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f71fa8-d3b3-47c1-9328-0c4d4e0e1b03 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:12.477058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f71fa8-d3b3-47c1-9328-0c4d4e0e1b03 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:12.477515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f71fa8-d3b3-47c1-9328-0c4d4e0e1b03 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:12.477946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42f71fa8-d3b3-47c1-9328-0c4d4e0e1b03 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:12.534134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c067da24-a87d-4e29-9a31-2d946f6e0d09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:12.534793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c067da24-a87d-4e29-9a31-2d946f6e0d09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:12.541455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c067da24-a87d-4e29-9a31-2d946f6e0d09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:12.545084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c067da24-a87d-4e29-9a31-2d946f6e0d09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:12.545084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c067da24-a87d-4e29-9a31-2d946f6e0d09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:12.545410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-42f71fa8-d3b3-47c1-9328-0c4d4e0e1b03 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:12.545556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c067da24-a87d-4e29-9a31-2d946f6e0d09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:12.545556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c067da24-a87d-4e29-9a31-2d946f6e0d09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:12.545556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c067da24-a87d-4e29-9a31-2d946f6e0d09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:12.551112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-42f71fa8-d3b3-47c1-9328-0c4d4e0e1b03 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086703 Sep 02 10:02:12.552276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 873/1822] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:12 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:12.605429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c067da24-a87d-4e29-9a31-2d946f6e0d09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:12.613718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c067da24-a87d-4e29-9a31-2d946f6e0d09 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083468 Sep 02 10:02:12.614729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 950/1823] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:13.572655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2441219d-2133-412a-932d-570dc2e53e6c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:13.573261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2441219d-2133-412a-932d-570dc2e53e6c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:13.579699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2441219d-2133-412a-932d-570dc2e53e6c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:13.580179 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2441219d-2133-412a-932d-570dc2e53e6c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:13.580612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2441219d-2133-412a-932d-570dc2e53e6c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:13.581288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2441219d-2133-412a-932d-570dc2e53e6c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:13.581736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2441219d-2133-412a-932d-570dc2e53e6c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:13.582152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2441219d-2133-412a-932d-570dc2e53e6c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:13.585324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:02:13.636203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7be7e6a9-1d42-4a93-bb60-86ab1b2555f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:13.636853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7be7e6a9-1d42-4a93-bb60-86ab1b2555f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:13.643661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7be7e6a9-1d42-4a93-bb60-86ab1b2555f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:13.644157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7be7e6a9-1d42-4a93-bb60-86ab1b2555f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:13.644598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7be7e6a9-1d42-4a93-bb60-86ab1b2555f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:13.645317 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7be7e6a9-1d42-4a93-bb60-86ab1b2555f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:13.646429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7be7e6a9-1d42-4a93-bb60-86ab1b2555f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:13.646887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7be7e6a9-1d42-4a93-bb60-86ab1b2555f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:13.714535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7be7e6a9-1d42-4a93-bb60-86ab1b2555f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:13.723079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7be7e6a9-1d42-4a93-bb60-86ab1b2555f0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.090729 Sep 02 10:02:13.723873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 951/1824] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:13.797812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2441219d-2133-412a-932d-570dc2e53e6c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:13.805865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2441219d-2133-412a-932d-570dc2e53e6c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.237089 Sep 02 10:02:13.806422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 874/1825] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:13 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:14.744142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2265e77b-49b1-4b0a-8a72-957d38e30862 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:14.744747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2265e77b-49b1-4b0a-8a72-957d38e30862 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:14.751112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2265e77b-49b1-4b0a-8a72-957d38e30862 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:14.751590 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2265e77b-49b1-4b0a-8a72-957d38e30862 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:14.752278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2265e77b-49b1-4b0a-8a72-957d38e30862 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:14.752955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2265e77b-49b1-4b0a-8a72-957d38e30862 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:14.753400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2265e77b-49b1-4b0a-8a72-957d38e30862 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:14.753818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2265e77b-49b1-4b0a-8a72-957d38e30862 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:14.813122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2265e77b-49b1-4b0a-8a72-957d38e30862 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:14.821212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2265e77b-49b1-4b0a-8a72-957d38e30862 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.080897 Sep 02 10:02:14.821768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 952/1826] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:14.826319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cc8d5902-4aec-487b-8b48-e2a1100525a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:14.826954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cc8d5902-4aec-487b-8b48-e2a1100525a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:14.833895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc8d5902-4aec-487b-8b48-e2a1100525a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:14.834377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc8d5902-4aec-487b-8b48-e2a1100525a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:14.834837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc8d5902-4aec-487b-8b48-e2a1100525a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:14.835526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc8d5902-4aec-487b-8b48-e2a1100525a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:14.835977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc8d5902-4aec-487b-8b48-e2a1100525a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:14.836400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc8d5902-4aec-487b-8b48-e2a1100525a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:14.897310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cc8d5902-4aec-487b-8b48-e2a1100525a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:14.905413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cc8d5902-4aec-487b-8b48-e2a1100525a5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082970 Sep 02 10:02:14.905971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 875/1827] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:14 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:15.842228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f1ee8689-7c62-4318-af2a-0f7d51ae1a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:15.842875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f1ee8689-7c62-4318-af2a-0f7d51ae1a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:15.845231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=56 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:02:15.850398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1ee8689-7c62-4318-af2a-0f7d51ae1a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:15.850922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1ee8689-7c62-4318-af2a-0f7d51ae1a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:15.851361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1ee8689-7c62-4318-af2a-0f7d51ae1a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:15.852053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1ee8689-7c62-4318-af2a-0f7d51ae1a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:15.852507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1ee8689-7c62-4318-af2a-0f7d51ae1a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:15.852931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1ee8689-7c62-4318-af2a-0f7d51ae1a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:15.914169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f1ee8689-7c62-4318-af2a-0f7d51ae1a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:15.922307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f1ee8689-7c62-4318-af2a-0f7d51ae1a69 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083959 Sep 02 10:02:15.922921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 953/1828] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:15.927325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-355cf514-34ac-4b67-8a85-9e9a26102215 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:15.927936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-355cf514-34ac-4b67-8a85-9e9a26102215 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:15.934918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-355cf514-34ac-4b67-8a85-9e9a26102215 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:15.935416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-355cf514-34ac-4b67-8a85-9e9a26102215 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:15.935851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-355cf514-34ac-4b67-8a85-9e9a26102215 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:15.936544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-355cf514-34ac-4b67-8a85-9e9a26102215 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:15.936998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-355cf514-34ac-4b67-8a85-9e9a26102215 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:15.937452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-355cf514-34ac-4b67-8a85-9e9a26102215 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:15.998339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-355cf514-34ac-4b67-8a85-9e9a26102215 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:16.006662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-355cf514-34ac-4b67-8a85-9e9a26102215 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083801 Sep 02 10:02:16.007234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 876/1829] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:15 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:16.944164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1dbe8b01-5807-4d79-b709-a2d83630a487 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:16.944780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1dbe8b01-5807-4d79-b709-a2d83630a487 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:16.951226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1dbe8b01-5807-4d79-b709-a2d83630a487 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:16.951708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1dbe8b01-5807-4d79-b709-a2d83630a487 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:16.952144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1dbe8b01-5807-4d79-b709-a2d83630a487 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:16.952829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1dbe8b01-5807-4d79-b709-a2d83630a487 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:16.953284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1dbe8b01-5807-4d79-b709-a2d83630a487 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:16.953711 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1dbe8b01-5807-4d79-b709-a2d83630a487 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:17.016581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1dbe8b01-5807-4d79-b709-a2d83630a487 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:17.024795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1dbe8b01-5807-4d79-b709-a2d83630a487 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085121 Sep 02 10:02:17.025365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 954/1830] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:17.026881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bbef0673-6688-4bd6-837b-8426f86fbd1d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:17.027489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bbef0673-6688-4bd6-837b-8426f86fbd1d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:17.033827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbef0673-6688-4bd6-837b-8426f86fbd1d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:17.034291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbef0673-6688-4bd6-837b-8426f86fbd1d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:17.034731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbef0673-6688-4bd6-837b-8426f86fbd1d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:17.035430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbef0673-6688-4bd6-837b-8426f86fbd1d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:17.035875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbef0673-6688-4bd6-837b-8426f86fbd1d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:17.038168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbef0673-6688-4bd6-837b-8426f86fbd1d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:17.098196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bbef0673-6688-4bd6-837b-8426f86fbd1d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:17.106295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bbef0673-6688-4bd6-837b-8426f86fbd1d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083207 Sep 02 10:02:17.106874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 877/1831] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:17 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:18.045396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2181b9d2-eee4-40aa-9084-c19b5d0eac44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:18.046000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2181b9d2-eee4-40aa-9084-c19b5d0eac44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:18.052370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2181b9d2-eee4-40aa-9084-c19b5d0eac44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:18.052860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2181b9d2-eee4-40aa-9084-c19b5d0eac44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:18.053300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2181b9d2-eee4-40aa-9084-c19b5d0eac44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:18.053988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2181b9d2-eee4-40aa-9084-c19b5d0eac44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:18.054439 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2181b9d2-eee4-40aa-9084-c19b5d0eac44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:18.054894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2181b9d2-eee4-40aa-9084-c19b5d0eac44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:18.118317 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2181b9d2-eee4-40aa-9084-c19b5d0eac44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:18.126526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2181b9d2-eee4-40aa-9084-c19b5d0eac44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085017 Sep 02 10:02:18.127388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 955/1832] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:18.127525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c7a3941a-1f36-4faf-813e-f75c0d7ec964 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:18.128002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c7a3941a-1f36-4faf-813e-f75c0d7ec964 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:18.135606 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7a3941a-1f36-4faf-813e-f75c0d7ec964 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:18.136097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7a3941a-1f36-4faf-813e-f75c0d7ec964 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:18.136540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7a3941a-1f36-4faf-813e-f75c0d7ec964 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:18.137289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7a3941a-1f36-4faf-813e-f75c0d7ec964 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:18.137759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7a3941a-1f36-4faf-813e-f75c0d7ec964 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:18.138188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c7a3941a-1f36-4faf-813e-f75c0d7ec964 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:18.202501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c7a3941a-1f36-4faf-813e-f75c0d7ec964 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:18.211251 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c7a3941a-1f36-4faf-813e-f75c0d7ec964 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087909 Sep 02 10:02:18.211815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 878/1833] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:18 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:19.150029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-eadc45cf-3c09-429d-9de0-aa1befc8ff80 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:19.150576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-eadc45cf-3c09-429d-9de0-aa1befc8ff80 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:19.156920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eadc45cf-3c09-429d-9de0-aa1befc8ff80 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:19.157398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eadc45cf-3c09-429d-9de0-aa1befc8ff80 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:19.157840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eadc45cf-3c09-429d-9de0-aa1befc8ff80 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:19.158554 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eadc45cf-3c09-429d-9de0-aa1befc8ff80 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:19.159017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eadc45cf-3c09-429d-9de0-aa1befc8ff80 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:19.159436 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eadc45cf-3c09-429d-9de0-aa1befc8ff80 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:19.232275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f1748353-8415-4f4d-8030-bcc9d8aae26f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:19.233350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f1748353-8415-4f4d-8030-bcc9d8aae26f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:19.235859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eadc45cf-3c09-429d-9de0-aa1befc8ff80 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:19.239611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1748353-8415-4f4d-8030-bcc9d8aae26f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:19.240102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1748353-8415-4f4d-8030-bcc9d8aae26f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:19.240543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1748353-8415-4f4d-8030-bcc9d8aae26f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:19.241238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1748353-8415-4f4d-8030-bcc9d8aae26f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:19.241696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1748353-8415-4f4d-8030-bcc9d8aae26f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:19.242123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1748353-8415-4f4d-8030-bcc9d8aae26f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:19.243982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-eadc45cf-3c09-429d-9de0-aa1befc8ff80 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.098374 Sep 02 10:02:19.244554 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 956/1834] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:19.304131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f1748353-8415-4f4d-8030-bcc9d8aae26f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:19.312262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f1748353-8415-4f4d-8030-bcc9d8aae26f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083920 Sep 02 10:02:19.312826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 879/1835] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:19 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:20.265212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3ac66ef4-5984-44be-bf5f-638defb3ff39 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:20.265749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3ac66ef4-5984-44be-bf5f-638defb3ff39 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:20.272118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ac66ef4-5984-44be-bf5f-638defb3ff39 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:20.272601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ac66ef4-5984-44be-bf5f-638defb3ff39 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:20.273037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ac66ef4-5984-44be-bf5f-638defb3ff39 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:20.273774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ac66ef4-5984-44be-bf5f-638defb3ff39 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:20.274228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ac66ef4-5984-44be-bf5f-638defb3ff39 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:20.274660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3ac66ef4-5984-44be-bf5f-638defb3ff39 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:20.332390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9213984f-826c-43ee-b642-ce129aa9d4a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:20.332990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9213984f-826c-43ee-b642-ce129aa9d4a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:20.335736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3ac66ef4-5984-44be-bf5f-638defb3ff39 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:20.339682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9213984f-826c-43ee-b642-ce129aa9d4a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:20.340238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9213984f-826c-43ee-b642-ce129aa9d4a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:20.340673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9213984f-826c-43ee-b642-ce129aa9d4a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:20.341368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9213984f-826c-43ee-b642-ce129aa9d4a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:20.341809 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9213984f-826c-43ee-b642-ce129aa9d4a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:20.342227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9213984f-826c-43ee-b642-ce129aa9d4a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:20.343868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3ac66ef4-5984-44be-bf5f-638defb3ff39 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082634 Sep 02 10:02:20.344431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 957/1836] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:20.405600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9213984f-826c-43ee-b642-ce129aa9d4a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:20.414209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9213984f-826c-43ee-b642-ce129aa9d4a7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085819 Sep 02 10:02:20.414774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 880/1837] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:20 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:21.366267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5be2eca2-a932-473b-99cc-a9410efc6c3d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:21.366932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5be2eca2-a932-473b-99cc-a9410efc6c3d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:21.373510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5be2eca2-a932-473b-99cc-a9410efc6c3d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:21.374004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5be2eca2-a932-473b-99cc-a9410efc6c3d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:21.374443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5be2eca2-a932-473b-99cc-a9410efc6c3d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:21.375236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5be2eca2-a932-473b-99cc-a9410efc6c3d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:21.375694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5be2eca2-a932-473b-99cc-a9410efc6c3d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:21.376124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5be2eca2-a932-473b-99cc-a9410efc6c3d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:21.435673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f420825c-f052-411a-9a79-8751c2045fb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:21.436344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f420825c-f052-411a-9a79-8751c2045fb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:21.437372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5be2eca2-a932-473b-99cc-a9410efc6c3d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:21.438792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=56 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:02:21.444118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f420825c-f052-411a-9a79-8751c2045fb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:21.444596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f420825c-f052-411a-9a79-8751c2045fb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:21.445026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f420825c-f052-411a-9a79-8751c2045fb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:21.445710 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f420825c-f052-411a-9a79-8751c2045fb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:21.446159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f420825c-f052-411a-9a79-8751c2045fb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:21.446572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5be2eca2-a932-473b-99cc-a9410efc6c3d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085143 Sep 02 10:02:21.446739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f420825c-f052-411a-9a79-8751c2045fb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:21.447167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 958/1838] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:21.508855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f420825c-f052-411a-9a79-8751c2045fb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:21.516876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f420825c-f052-411a-9a79-8751c2045fb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085253 Sep 02 10:02:21.517434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 881/1839] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:21 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:22.467382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dfde41dc-699b-48f6-b07e-51db1c29d3ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:22.467989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dfde41dc-699b-48f6-b07e-51db1c29d3ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:22.474932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dfde41dc-699b-48f6-b07e-51db1c29d3ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:22.475413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dfde41dc-699b-48f6-b07e-51db1c29d3ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:22.475846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dfde41dc-699b-48f6-b07e-51db1c29d3ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:22.476858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dfde41dc-699b-48f6-b07e-51db1c29d3ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:22.477313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dfde41dc-699b-48f6-b07e-51db1c29d3ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:22.477735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dfde41dc-699b-48f6-b07e-51db1c29d3ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:22.537928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dd91996b-e64b-4e5f-acf1-5b454e4a3b86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:22.538549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dd91996b-e64b-4e5f-acf1-5b454e4a3b86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:22.543043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dfde41dc-699b-48f6-b07e-51db1c29d3ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:22.545130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd91996b-e64b-4e5f-acf1-5b454e4a3b86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:22.545626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd91996b-e64b-4e5f-acf1-5b454e4a3b86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:22.546069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd91996b-e64b-4e5f-acf1-5b454e4a3b86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:22.546795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd91996b-e64b-4e5f-acf1-5b454e4a3b86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:22.547255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd91996b-e64b-4e5f-acf1-5b454e4a3b86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:22.547680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd91996b-e64b-4e5f-acf1-5b454e4a3b86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:22.551299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dfde41dc-699b-48f6-b07e-51db1c29d3ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087911 Sep 02 10:02:22.551880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 959/1840] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:22.611183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dd91996b-e64b-4e5f-acf1-5b454e4a3b86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:22.619927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dd91996b-e64b-4e5f-acf1-5b454e4a3b86 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086503 Sep 02 10:02:22.620463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 882/1841] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:22 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:23.573152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ed04b746-45ec-4de8-b955-341b9e71d4c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:23.573763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ed04b746-45ec-4de8-b955-341b9e71d4c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:23.580217 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed04b746-45ec-4de8-b955-341b9e71d4c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:23.580697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed04b746-45ec-4de8-b955-341b9e71d4c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:23.581133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed04b746-45ec-4de8-b955-341b9e71d4c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:23.581832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed04b746-45ec-4de8-b955-341b9e71d4c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:23.582270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed04b746-45ec-4de8-b955-341b9e71d4c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:23.582692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ed04b746-45ec-4de8-b955-341b9e71d4c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:23.640722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6f55e7fd-467f-44d8-95ca-9c366114ea9f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:23.641357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6f55e7fd-467f-44d8-95ca-9c366114ea9f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:23.645842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ed04b746-45ec-4de8-b955-341b9e71d4c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:23.648176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f55e7fd-467f-44d8-95ca-9c366114ea9f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:23.648672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f55e7fd-467f-44d8-95ca-9c366114ea9f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:23.649109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f55e7fd-467f-44d8-95ca-9c366114ea9f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:23.649843 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f55e7fd-467f-44d8-95ca-9c366114ea9f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:23.650299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f55e7fd-467f-44d8-95ca-9c366114ea9f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:23.650743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6f55e7fd-467f-44d8-95ca-9c366114ea9f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:23.654121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ed04b746-45ec-4de8-b955-341b9e71d4c9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084809 Sep 02 10:02:23.654869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 960/1842] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:23.711526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6f55e7fd-467f-44d8-95ca-9c366114ea9f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:23.719512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6f55e7fd-467f-44d8-95ca-9c366114ea9f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082802 Sep 02 10:02:23.720117 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 883/1843] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:23 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:24.674640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-89bbb48f-c650-446b-9d2a-a91aa8e5c753 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:24.675283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-89bbb48f-c650-446b-9d2a-a91aa8e5c753 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:24.681634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89bbb48f-c650-446b-9d2a-a91aa8e5c753 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:24.682112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89bbb48f-c650-446b-9d2a-a91aa8e5c753 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:24.682549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89bbb48f-c650-446b-9d2a-a91aa8e5c753 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:24.683267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89bbb48f-c650-446b-9d2a-a91aa8e5c753 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:24.683723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89bbb48f-c650-446b-9d2a-a91aa8e5c753 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:24.684147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-89bbb48f-c650-446b-9d2a-a91aa8e5c753 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:24.740122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d8df4ec-6aad-43be-964b-01b2d31640de tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:24.740751 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5d8df4ec-6aad-43be-964b-01b2d31640de tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:24.744215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-89bbb48f-c650-446b-9d2a-a91aa8e5c753 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:24.746934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d8df4ec-6aad-43be-964b-01b2d31640de tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:24.747418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d8df4ec-6aad-43be-964b-01b2d31640de tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:24.747849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d8df4ec-6aad-43be-964b-01b2d31640de tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:24.748531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d8df4ec-6aad-43be-964b-01b2d31640de tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:24.748974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d8df4ec-6aad-43be-964b-01b2d31640de tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:24.749390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d8df4ec-6aad-43be-964b-01b2d31640de tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:24.753213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-89bbb48f-c650-446b-9d2a-a91aa8e5c753 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081857 Sep 02 10:02:24.753709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 961/1844] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:24.812657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5d8df4ec-6aad-43be-964b-01b2d31640de tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:24.821477 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5d8df4ec-6aad-43be-964b-01b2d31640de tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085233 Sep 02 10:02:24.822046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 884/1845] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:24 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:25.773843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b24987cd-692a-42eb-be86-ddd662373cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:25.774472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b24987cd-692a-42eb-be86-ddd662373cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:25.780922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b24987cd-692a-42eb-be86-ddd662373cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:25.781399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b24987cd-692a-42eb-be86-ddd662373cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:25.781832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b24987cd-692a-42eb-be86-ddd662373cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:25.782508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b24987cd-692a-42eb-be86-ddd662373cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:25.782979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b24987cd-692a-42eb-be86-ddd662373cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:25.783405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b24987cd-692a-42eb-be86-ddd662373cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:25.842633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f57aee16-2f4a-4aba-b766-e99dcfeafb46 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:25.843203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f57aee16-2f4a-4aba-b766-e99dcfeafb46 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:25.845736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b24987cd-692a-42eb-be86-ddd662373cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:25.850396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f57aee16-2f4a-4aba-b766-e99dcfeafb46 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:25.851140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f57aee16-2f4a-4aba-b766-e99dcfeafb46 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:25.851575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f57aee16-2f4a-4aba-b766-e99dcfeafb46 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:25.852262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f57aee16-2f4a-4aba-b766-e99dcfeafb46 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:25.852713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f57aee16-2f4a-4aba-b766-e99dcfeafb46 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:25.853127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f57aee16-2f4a-4aba-b766-e99dcfeafb46 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:25.862541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b24987cd-692a-42eb-be86-ddd662373cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.092459 Sep 02 10:02:25.863160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 962/1846] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:25 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:25.915109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f57aee16-2f4a-4aba-b766-e99dcfeafb46 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:25.923143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f57aee16-2f4a-4aba-b766-e99dcfeafb46 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084469 Sep 02 10:02:25.923706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 885/1847] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:25 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:26.884223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0ac23cca-4073-410f-bd71-b11d62722ecb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:26.884825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0ac23cca-4073-410f-bd71-b11d62722ecb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:26.891171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ac23cca-4073-410f-bd71-b11d62722ecb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:26.896903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ac23cca-4073-410f-bd71-b11d62722ecb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:26.896903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ac23cca-4073-410f-bd71-b11d62722ecb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:26.896903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ac23cca-4073-410f-bd71-b11d62722ecb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:26.896903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ac23cca-4073-410f-bd71-b11d62722ecb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:26.897355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ac23cca-4073-410f-bd71-b11d62722ecb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:26.897355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:02:26.943718 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9111d80f-dea6-4e39-adaa-fd5f77a562e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:26.944313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9111d80f-dea6-4e39-adaa-fd5f77a562e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:26.950604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9111d80f-dea6-4e39-adaa-fd5f77a562e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:26.951115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9111d80f-dea6-4e39-adaa-fd5f77a562e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:26.951542 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9111d80f-dea6-4e39-adaa-fd5f77a562e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:26.952222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9111d80f-dea6-4e39-adaa-fd5f77a562e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:26.952664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9111d80f-dea6-4e39-adaa-fd5f77a562e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:26.953080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9111d80f-dea6-4e39-adaa-fd5f77a562e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:26.957469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0ac23cca-4073-410f-bd71-b11d62722ecb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:26.965520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0ac23cca-4073-410f-bd71-b11d62722ecb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085821 Sep 02 10:02:26.966113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 963/1848] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:26 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:27.019775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9111d80f-dea6-4e39-adaa-fd5f77a562e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:27.027945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9111d80f-dea6-4e39-adaa-fd5f77a562e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.088068 Sep 02 10:02:27.028502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 886/1849] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:26 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:27.986661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-716a3866-00b2-41df-9eb3-e56645fb592b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:27.987302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-716a3866-00b2-41df-9eb3-e56645fb592b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:27.994527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-716a3866-00b2-41df-9eb3-e56645fb592b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:27.995040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-716a3866-00b2-41df-9eb3-e56645fb592b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:27.995481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-716a3866-00b2-41df-9eb3-e56645fb592b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:27.996167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-716a3866-00b2-41df-9eb3-e56645fb592b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:27.996620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-716a3866-00b2-41df-9eb3-e56645fb592b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:27.997048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-716a3866-00b2-41df-9eb3-e56645fb592b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:28.048943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-72c97ba4-3d65-4069-853d-8010908ca83e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:28.049550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-72c97ba4-3d65-4069-853d-8010908ca83e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:28.056681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72c97ba4-3d65-4069-853d-8010908ca83e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:28.057166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72c97ba4-3d65-4069-853d-8010908ca83e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:28.057605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72c97ba4-3d65-4069-853d-8010908ca83e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:28.058276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-716a3866-00b2-41df-9eb3-e56645fb592b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:28.058433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72c97ba4-3d65-4069-853d-8010908ca83e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:28.058742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72c97ba4-3d65-4069-853d-8010908ca83e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:28.059169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-72c97ba4-3d65-4069-853d-8010908ca83e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:28.066445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-716a3866-00b2-41df-9eb3-e56645fb592b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083664 Sep 02 10:02:28.067039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 964/1850] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:28.118908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-72c97ba4-3d65-4069-853d-8010908ca83e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:28.127167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-72c97ba4-3d65-4069-853d-8010908ca83e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081906 Sep 02 10:02:28.127717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 887/1851] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:28 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:29.087252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9d4c1837-546f-4b93-890c-4350e1c92c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:29.087820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9d4c1837-546f-4b93-890c-4350e1c92c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:29.094171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d4c1837-546f-4b93-890c-4350e1c92c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:29.096140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d4c1837-546f-4b93-890c-4350e1c92c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:29.096140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d4c1837-546f-4b93-890c-4350e1c92c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:29.096140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d4c1837-546f-4b93-890c-4350e1c92c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:29.096486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d4c1837-546f-4b93-890c-4350e1c92c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:29.096709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9d4c1837-546f-4b93-890c-4350e1c92c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:29.147964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7e397804-c5f0-4fff-809a-f71dd5495cb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:29.148546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7e397804-c5f0-4fff-809a-f71dd5495cb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:29.155293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e397804-c5f0-4fff-809a-f71dd5495cb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:29.155788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e397804-c5f0-4fff-809a-f71dd5495cb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:29.156220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e397804-c5f0-4fff-809a-f71dd5495cb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:29.156941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e397804-c5f0-4fff-809a-f71dd5495cb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:29.157345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e397804-c5f0-4fff-809a-f71dd5495cb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:29.157763 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e397804-c5f0-4fff-809a-f71dd5495cb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:29.158989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9d4c1837-546f-4b93-890c-4350e1c92c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:29.167784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9d4c1837-546f-4b93-890c-4350e1c92c37 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084400 Sep 02 10:02:29.168612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 965/1852] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:29.219169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7e397804-c5f0-4fff-809a-f71dd5495cb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:29.227892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7e397804-c5f0-4fff-809a-f71dd5495cb1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083904 Sep 02 10:02:29.228462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 888/1853] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:29 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:30.189232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-513d267f-e453-423f-b9ad-9ac8d9f17747 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:30.189769 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-513d267f-e453-423f-b9ad-9ac8d9f17747 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:30.196780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-513d267f-e453-423f-b9ad-9ac8d9f17747 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:30.197260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-513d267f-e453-423f-b9ad-9ac8d9f17747 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:30.197690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-513d267f-e453-423f-b9ad-9ac8d9f17747 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:30.198368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-513d267f-e453-423f-b9ad-9ac8d9f17747 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:30.198848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-513d267f-e453-423f-b9ad-9ac8d9f17747 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:30.199270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-513d267f-e453-423f-b9ad-9ac8d9f17747 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:30.249436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-32f1ba16-06c7-4d89-b264-8a39b3d93549 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:30.250047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-32f1ba16-06c7-4d89-b264-8a39b3d93549 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:30.257608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f1ba16-06c7-4d89-b264-8a39b3d93549 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:30.257726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f1ba16-06c7-4d89-b264-8a39b3d93549 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:30.258159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f1ba16-06c7-4d89-b264-8a39b3d93549 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:30.258878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f1ba16-06c7-4d89-b264-8a39b3d93549 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:30.259338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f1ba16-06c7-4d89-b264-8a39b3d93549 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:30.259630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-513d267f-e453-423f-b9ad-9ac8d9f17747 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:30.259781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f1ba16-06c7-4d89-b264-8a39b3d93549 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:30.267974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-513d267f-e453-423f-b9ad-9ac8d9f17747 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082644 Sep 02 10:02:30.268542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 966/1854] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:30.320652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-32f1ba16-06c7-4d89-b264-8a39b3d93549 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:30.328709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-32f1ba16-06c7-4d89-b264-8a39b3d93549 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083175 Sep 02 10:02:30.329281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 889/1855] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:30 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:31.289877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2d4a85e5-8b36-43f3-825b-f5b3726d609d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:31.290429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2d4a85e5-8b36-43f3-825b-f5b3726d609d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:31.296943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d4a85e5-8b36-43f3-825b-f5b3726d609d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:31.297421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d4a85e5-8b36-43f3-825b-f5b3726d609d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:31.297853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d4a85e5-8b36-43f3-825b-f5b3726d609d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:31.298534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d4a85e5-8b36-43f3-825b-f5b3726d609d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:31.299019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d4a85e5-8b36-43f3-825b-f5b3726d609d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:31.299437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d4a85e5-8b36-43f3-825b-f5b3726d609d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:31.349997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-45a872f0-9551-41f1-9792-3a50000d284d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:31.350612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-45a872f0-9551-41f1-9792-3a50000d284d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:31.356979 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a872f0-9551-41f1-9792-3a50000d284d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:31.357454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a872f0-9551-41f1-9792-3a50000d284d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:31.357883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a872f0-9551-41f1-9792-3a50000d284d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:31.358587 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a872f0-9551-41f1-9792-3a50000d284d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:31.359057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a872f0-9551-41f1-9792-3a50000d284d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:31.359475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45a872f0-9551-41f1-9792-3a50000d284d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:31.365835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2d4a85e5-8b36-43f3-825b-f5b3726d609d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:31.373981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2d4a85e5-8b36-43f3-825b-f5b3726d609d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.088597 Sep 02 10:02:31.374571 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 967/1856] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:31.423004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-45a872f0-9551-41f1-9792-3a50000d284d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:31.425194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:02:31.431713 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-45a872f0-9551-41f1-9792-3a50000d284d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086225 Sep 02 10:02:31.439037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 890/1857] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:31 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:32.395018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7c43a730-a9e1-4f24-81fc-8d4e300a1546 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:32.395632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7c43a730-a9e1-4f24-81fc-8d4e300a1546 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:32.402049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c43a730-a9e1-4f24-81fc-8d4e300a1546 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:32.402536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c43a730-a9e1-4f24-81fc-8d4e300a1546 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:32.403015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c43a730-a9e1-4f24-81fc-8d4e300a1546 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:32.403702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c43a730-a9e1-4f24-81fc-8d4e300a1546 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:32.404158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c43a730-a9e1-4f24-81fc-8d4e300a1546 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:32.404582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7c43a730-a9e1-4f24-81fc-8d4e300a1546 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:32.457498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f1afd25b-e0a6-4bb4-9cf6-a3649057ecbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:32.458133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f1afd25b-e0a6-4bb4-9cf6-a3649057ecbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:32.464869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1afd25b-e0a6-4bb4-9cf6-a3649057ecbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:32.465365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1afd25b-e0a6-4bb4-9cf6-a3649057ecbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:32.465526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7c43a730-a9e1-4f24-81fc-8d4e300a1546 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:32.465797 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1afd25b-e0a6-4bb4-9cf6-a3649057ecbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:32.466693 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1afd25b-e0a6-4bb4-9cf6-a3649057ecbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:32.469690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1afd25b-e0a6-4bb4-9cf6-a3649057ecbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:32.469690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1afd25b-e0a6-4bb4-9cf6-a3649057ecbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:32.473658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7c43a730-a9e1-4f24-81fc-8d4e300a1546 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082602 Sep 02 10:02:32.474730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 968/1858] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:32.528410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f1afd25b-e0a6-4bb4-9cf6-a3649057ecbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:32.536489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f1afd25b-e0a6-4bb4-9cf6-a3649057ecbc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082922 Sep 02 10:02:32.537573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 891/1859] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:32 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:33.494641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c03c5a52-4128-4af4-8875-684bb4c5c0d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:33.495274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c03c5a52-4128-4af4-8875-684bb4c5c0d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:33.501942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c03c5a52-4128-4af4-8875-684bb4c5c0d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:33.502416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c03c5a52-4128-4af4-8875-684bb4c5c0d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:33.502877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c03c5a52-4128-4af4-8875-684bb4c5c0d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:33.503557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c03c5a52-4128-4af4-8875-684bb4c5c0d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:33.504005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c03c5a52-4128-4af4-8875-684bb4c5c0d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:33.504426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c03c5a52-4128-4af4-8875-684bb4c5c0d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:33.558150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d076b6ec-1baa-4547-a2de-58b34989178a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:33.558881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d076b6ec-1baa-4547-a2de-58b34989178a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:33.564353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c03c5a52-4128-4af4-8875-684bb4c5c0d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:33.565492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d076b6ec-1baa-4547-a2de-58b34989178a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:33.566051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d076b6ec-1baa-4547-a2de-58b34989178a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:33.566491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d076b6ec-1baa-4547-a2de-58b34989178a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:33.567203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d076b6ec-1baa-4547-a2de-58b34989178a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:33.567654 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d076b6ec-1baa-4547-a2de-58b34989178a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:33.568628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d076b6ec-1baa-4547-a2de-58b34989178a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:33.573377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c03c5a52-4128-4af4-8875-684bb4c5c0d7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082630 Sep 02 10:02:33.574038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 969/1860] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:33.633385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d076b6ec-1baa-4547-a2de-58b34989178a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:33.641349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d076b6ec-1baa-4547-a2de-58b34989178a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087117 Sep 02 10:02:33.641912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 892/1861] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:33 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:34.594287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4c47904d-ccd7-455f-9637-ddffb0a1ca9b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:34.594930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4c47904d-ccd7-455f-9637-ddffb0a1ca9b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:34.601900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c47904d-ccd7-455f-9637-ddffb0a1ca9b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:34.602384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c47904d-ccd7-455f-9637-ddffb0a1ca9b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:34.602848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c47904d-ccd7-455f-9637-ddffb0a1ca9b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:34.603537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c47904d-ccd7-455f-9637-ddffb0a1ca9b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:34.603989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c47904d-ccd7-455f-9637-ddffb0a1ca9b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:34.604419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c47904d-ccd7-455f-9637-ddffb0a1ca9b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:34.661359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-40aea9a8-4fe4-4a78-b82e-afc0361dbf2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:34.662823 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-40aea9a8-4fe4-4a78-b82e-afc0361dbf2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:34.664599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4c47904d-ccd7-455f-9637-ddffb0a1ca9b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:34.669321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40aea9a8-4fe4-4a78-b82e-afc0361dbf2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:34.669834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40aea9a8-4fe4-4a78-b82e-afc0361dbf2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:34.670265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40aea9a8-4fe4-4a78-b82e-afc0361dbf2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:34.671114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40aea9a8-4fe4-4a78-b82e-afc0361dbf2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:34.671569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40aea9a8-4fe4-4a78-b82e-afc0361dbf2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:34.671995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-40aea9a8-4fe4-4a78-b82e-afc0361dbf2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:34.672734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4c47904d-ccd7-455f-9637-ddffb0a1ca9b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082281 Sep 02 10:02:34.673303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 970/1862] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:34.734528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-40aea9a8-4fe4-4a78-b82e-afc0361dbf2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:34.743332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-40aea9a8-4fe4-4a78-b82e-afc0361dbf2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085848 Sep 02 10:02:34.743894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 893/1863] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:34 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:35.693951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-81663c8a-e863-4fe7-b502-d2dc352b85bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:35.694563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-81663c8a-e863-4fe7-b502-d2dc352b85bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:35.700897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81663c8a-e863-4fe7-b502-d2dc352b85bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:35.701377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81663c8a-e863-4fe7-b502-d2dc352b85bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:35.701819 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81663c8a-e863-4fe7-b502-d2dc352b85bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:35.702494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81663c8a-e863-4fe7-b502-d2dc352b85bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:35.702989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81663c8a-e863-4fe7-b502-d2dc352b85bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:35.703386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81663c8a-e863-4fe7-b502-d2dc352b85bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:35.764232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bff2295e-e811-4b30-9624-abba42576370 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:35.764908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bff2295e-e811-4b30-9624-abba42576370 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:35.766198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-81663c8a-e863-4fe7-b502-d2dc352b85bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:35.771497 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bff2295e-e811-4b30-9624-abba42576370 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:35.772049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bff2295e-e811-4b30-9624-abba42576370 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:35.772523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bff2295e-e811-4b30-9624-abba42576370 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:35.773189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bff2295e-e811-4b30-9624-abba42576370 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:35.773634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bff2295e-e811-4b30-9624-abba42576370 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:35.774052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bff2295e-e811-4b30-9624-abba42576370 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:35.774419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-81663c8a-e863-4fe7-b502-d2dc352b85bf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084946 Sep 02 10:02:35.775012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 971/1864] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:35.836892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bff2295e-e811-4b30-9624-abba42576370 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:35.845181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bff2295e-e811-4b30-9624-abba42576370 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084944 Sep 02 10:02:35.845691 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 894/1865] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:35 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:36.795058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-615a27bf-646d-4db0-8c7d-578dcdc955b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:36.795708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-615a27bf-646d-4db0-8c7d-578dcdc955b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:36.802143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-615a27bf-646d-4db0-8c7d-578dcdc955b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:36.802680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-615a27bf-646d-4db0-8c7d-578dcdc955b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:36.809842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-615a27bf-646d-4db0-8c7d-578dcdc955b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:36.809842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-615a27bf-646d-4db0-8c7d-578dcdc955b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:36.809842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-615a27bf-646d-4db0-8c7d-578dcdc955b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:36.809842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-615a27bf-646d-4db0-8c7d-578dcdc955b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:36.865014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c1c6c836-697f-4c5f-bbda-9b01ff5a69ad tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:36.865624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c1c6c836-697f-4c5f-bbda-9b01ff5a69ad tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:36.872622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1c6c836-697f-4c5f-bbda-9b01ff5a69ad tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:36.873251 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1c6c836-697f-4c5f-bbda-9b01ff5a69ad tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:36.873528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1c6c836-697f-4c5f-bbda-9b01ff5a69ad tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:36.874223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1c6c836-697f-4c5f-bbda-9b01ff5a69ad tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:36.874678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1c6c836-697f-4c5f-bbda-9b01ff5a69ad tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:36.875134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1c6c836-697f-4c5f-bbda-9b01ff5a69ad tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:36.876204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-615a27bf-646d-4db0-8c7d-578dcdc955b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:36.885397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-615a27bf-646d-4db0-8c7d-578dcdc955b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.094322 Sep 02 10:02:36.885971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 972/1866] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:36.936847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c1c6c836-697f-4c5f-bbda-9b01ff5a69ad tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:36.945377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c1c6c836-697f-4c5f-bbda-9b01ff5a69ad tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084378 Sep 02 10:02:36.945937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 895/1867] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:36 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:37.906780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f5b0fa20-ea86-4c93-80e7-427df9135fc5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:37.907421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f5b0fa20-ea86-4c93-80e7-427df9135fc5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:37.914266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5b0fa20-ea86-4c93-80e7-427df9135fc5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:37.914845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5b0fa20-ea86-4c93-80e7-427df9135fc5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:37.915295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5b0fa20-ea86-4c93-80e7-427df9135fc5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:37.916022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5b0fa20-ea86-4c93-80e7-427df9135fc5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:37.916480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5b0fa20-ea86-4c93-80e7-427df9135fc5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:37.916910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f5b0fa20-ea86-4c93-80e7-427df9135fc5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:37.965500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-79984501-a95d-4e4a-8a9f-9a851ba08703 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:37.966197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-79984501-a95d-4e4a-8a9f-9a851ba08703 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:37.972644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79984501-a95d-4e4a-8a9f-9a851ba08703 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:37.973216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79984501-a95d-4e4a-8a9f-9a851ba08703 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:37.973714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79984501-a95d-4e4a-8a9f-9a851ba08703 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:37.975058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79984501-a95d-4e4a-8a9f-9a851ba08703 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:37.975509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79984501-a95d-4e4a-8a9f-9a851ba08703 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:37.975926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-79984501-a95d-4e4a-8a9f-9a851ba08703 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:37.980263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f5b0fa20-ea86-4c93-80e7-427df9135fc5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:37.988477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f5b0fa20-ea86-4c93-80e7-427df9135fc5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085634 Sep 02 10:02:37.989270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 973/1868] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:38.036244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-79984501-a95d-4e4a-8a9f-9a851ba08703 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:38.044884 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-79984501-a95d-4e4a-8a9f-9a851ba08703 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083173 Sep 02 10:02:38.045467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 896/1869] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:37 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:39.010065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-007ce1ca-f484-4568-baed-8dec24af433b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:39.010726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-007ce1ca-f484-4568-baed-8dec24af433b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:39.017152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-007ce1ca-f484-4568-baed-8dec24af433b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:39.017643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-007ce1ca-f484-4568-baed-8dec24af433b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:39.018090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-007ce1ca-f484-4568-baed-8dec24af433b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:39.018811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-007ce1ca-f484-4568-baed-8dec24af433b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:39.019274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-007ce1ca-f484-4568-baed-8dec24af433b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:39.019702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-007ce1ca-f484-4568-baed-8dec24af433b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:39.065362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1d6b9702-9801-4f77-ba7b-0f48ae5641bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:39.066004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1d6b9702-9801-4f77-ba7b-0f48ae5641bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:39.073025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d6b9702-9801-4f77-ba7b-0f48ae5641bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:39.073514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d6b9702-9801-4f77-ba7b-0f48ae5641bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:39.073949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d6b9702-9801-4f77-ba7b-0f48ae5641bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:39.074629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d6b9702-9801-4f77-ba7b-0f48ae5641bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:39.075110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d6b9702-9801-4f77-ba7b-0f48ae5641bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:39.075537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1d6b9702-9801-4f77-ba7b-0f48ae5641bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:39.079949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-007ce1ca-f484-4568-baed-8dec24af433b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:39.088671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-007ce1ca-f484-4568-baed-8dec24af433b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083104 Sep 02 10:02:39.089245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 974/1870] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:39.137767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1d6b9702-9801-4f77-ba7b-0f48ae5641bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:39.146489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1d6b9702-9801-4f77-ba7b-0f48ae5641bb tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084418 Sep 02 10:02:39.147114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 897/1871] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:39 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:40.109755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6e9800cb-e5e0-4c7e-97d3-965e35247ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:40.110329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6e9800cb-e5e0-4c7e-97d3-965e35247ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:40.117273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e9800cb-e5e0-4c7e-97d3-965e35247ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:40.117755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e9800cb-e5e0-4c7e-97d3-965e35247ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:40.118195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e9800cb-e5e0-4c7e-97d3-965e35247ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:40.118914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e9800cb-e5e0-4c7e-97d3-965e35247ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:40.119372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e9800cb-e5e0-4c7e-97d3-965e35247ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:40.119810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6e9800cb-e5e0-4c7e-97d3-965e35247ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:40.166639 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4483776c-bf3e-486e-8f91-be5495d432db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:40.167377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4483776c-bf3e-486e-8f91-be5495d432db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:40.173864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4483776c-bf3e-486e-8f91-be5495d432db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:40.174349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4483776c-bf3e-486e-8f91-be5495d432db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:40.174816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4483776c-bf3e-486e-8f91-be5495d432db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:40.175508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4483776c-bf3e-486e-8f91-be5495d432db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:40.175959 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4483776c-bf3e-486e-8f91-be5495d432db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:40.176391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4483776c-bf3e-486e-8f91-be5495d432db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:40.184168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6e9800cb-e5e0-4c7e-97d3-965e35247ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:40.193714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6e9800cb-e5e0-4c7e-97d3-965e35247ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087858 Sep 02 10:02:40.194292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 975/1872] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:40.240387 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4483776c-bf3e-486e-8f91-be5495d432db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:40.248565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4483776c-bf3e-486e-8f91-be5495d432db tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085786 Sep 02 10:02:40.249127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 898/1873] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:40 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:41.217405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f0450de8-fa9a-497f-a585-acd840b3bccc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:41.217948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f0450de8-fa9a-497f-a585-acd840b3bccc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:41.224799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0450de8-fa9a-497f-a585-acd840b3bccc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:41.225288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0450de8-fa9a-497f-a585-acd840b3bccc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:41.225724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0450de8-fa9a-497f-a585-acd840b3bccc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:41.226408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0450de8-fa9a-497f-a585-acd840b3bccc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:41.226888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0450de8-fa9a-497f-a585-acd840b3bccc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:41.227312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f0450de8-fa9a-497f-a585-acd840b3bccc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:41.269304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-eb3c4a25-adb7-45cb-90f3-a5bd3f3910cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:41.269927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-eb3c4a25-adb7-45cb-90f3-a5bd3f3910cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:41.276329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb3c4a25-adb7-45cb-90f3-a5bd3f3910cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:41.276820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb3c4a25-adb7-45cb-90f3-a5bd3f3910cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:41.277259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb3c4a25-adb7-45cb-90f3-a5bd3f3910cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:41.277953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb3c4a25-adb7-45cb-90f3-a5bd3f3910cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:41.278409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb3c4a25-adb7-45cb-90f3-a5bd3f3910cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:41.278865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb3c4a25-adb7-45cb-90f3-a5bd3f3910cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:41.288466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f0450de8-fa9a-497f-a585-acd840b3bccc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:41.296766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f0450de8-fa9a-497f-a585-acd840b3bccc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083668 Sep 02 10:02:41.297336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 976/1874] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:41.339751 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-eb3c4a25-adb7-45cb-90f3-a5bd3f3910cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:41.347936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-eb3c4a25-adb7-45cb-90f3-a5bd3f3910cf tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082497 Sep 02 10:02:41.348504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 899/1875] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:41 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:42.318728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2b7365eb-3941-4875-88bf-e276c8c879d5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:42.319272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2b7365eb-3941-4875-88bf-e276c8c879d5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:42.325600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b7365eb-3941-4875-88bf-e276c8c879d5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:42.326080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b7365eb-3941-4875-88bf-e276c8c879d5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:42.326517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b7365eb-3941-4875-88bf-e276c8c879d5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:42.327220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b7365eb-3941-4875-88bf-e276c8c879d5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:42.327670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b7365eb-3941-4875-88bf-e276c8c879d5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:42.328089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b7365eb-3941-4875-88bf-e276c8c879d5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:42.369552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2bca16b4-91b0-4de7-8359-98530798d91a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:42.370174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2bca16b4-91b0-4de7-8359-98530798d91a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:42.377030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bca16b4-91b0-4de7-8359-98530798d91a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:42.388601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bca16b4-91b0-4de7-8359-98530798d91a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:42.388601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bca16b4-91b0-4de7-8359-98530798d91a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:42.388601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bca16b4-91b0-4de7-8359-98530798d91a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:42.388601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bca16b4-91b0-4de7-8359-98530798d91a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:42.389484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2bca16b4-91b0-4de7-8359-98530798d91a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:42.390629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2b7365eb-3941-4875-88bf-e276c8c879d5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:42.399101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2b7365eb-3941-4875-88bf-e276c8c879d5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084909 Sep 02 10:02:42.399859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 977/1876] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:42.443749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2bca16b4-91b0-4de7-8359-98530798d91a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:42.453304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2bca16b4-91b0-4de7-8359-98530798d91a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087693 Sep 02 10:02:42.458810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 900/1877] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:42 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:43.418902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-71bef8b9-ef46-45e7-b43f-12894fdea14c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:43.419517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-71bef8b9-ef46-45e7-b43f-12894fdea14c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:43.425930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71bef8b9-ef46-45e7-b43f-12894fdea14c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:43.426410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71bef8b9-ef46-45e7-b43f-12894fdea14c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:43.426883 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71bef8b9-ef46-45e7-b43f-12894fdea14c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:43.427571 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71bef8b9-ef46-45e7-b43f-12894fdea14c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:43.428094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71bef8b9-ef46-45e7-b43f-12894fdea14c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:43.428520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71bef8b9-ef46-45e7-b43f-12894fdea14c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:43.473835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-17543066-1b32-4331-8f4e-c2d6bfb60051 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:43.474471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-17543066-1b32-4331-8f4e-c2d6bfb60051 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:43.480860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17543066-1b32-4331-8f4e-c2d6bfb60051 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:43.481341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17543066-1b32-4331-8f4e-c2d6bfb60051 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:43.481774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17543066-1b32-4331-8f4e-c2d6bfb60051 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:43.482461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17543066-1b32-4331-8f4e-c2d6bfb60051 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:43.482938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17543066-1b32-4331-8f4e-c2d6bfb60051 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:43.483363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17543066-1b32-4331-8f4e-c2d6bfb60051 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:43.490407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-71bef8b9-ef46-45e7-b43f-12894fdea14c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:43.498569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-71bef8b9-ef46-45e7-b43f-12894fdea14c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083616 Sep 02 10:02:43.499430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 978/1878] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:43.544882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-17543066-1b32-4331-8f4e-c2d6bfb60051 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:43.552941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-17543066-1b32-4331-8f4e-c2d6bfb60051 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083003 Sep 02 10:02:43.553510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 901/1879] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:43 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:44.519975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d371aafa-14ff-4207-86d0-4897e0c73b30 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:44.520525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d371aafa-14ff-4207-86d0-4897e0c73b30 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:44.527633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d371aafa-14ff-4207-86d0-4897e0c73b30 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:44.528115 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d371aafa-14ff-4207-86d0-4897e0c73b30 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:44.528550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d371aafa-14ff-4207-86d0-4897e0c73b30 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:44.529236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d371aafa-14ff-4207-86d0-4897e0c73b30 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:44.529689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d371aafa-14ff-4207-86d0-4897e0c73b30 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:44.530111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d371aafa-14ff-4207-86d0-4897e0c73b30 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:44.573965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-37f3764a-b8d5-41e6-8658-559dcbd63942 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:44.574664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-37f3764a-b8d5-41e6-8658-559dcbd63942 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:44.581093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f3764a-b8d5-41e6-8658-559dcbd63942 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:44.581670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f3764a-b8d5-41e6-8658-559dcbd63942 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:44.582173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f3764a-b8d5-41e6-8658-559dcbd63942 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:44.582950 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f3764a-b8d5-41e6-8658-559dcbd63942 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:44.583406 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f3764a-b8d5-41e6-8658-559dcbd63942 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:44.584104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-37f3764a-b8d5-41e6-8658-559dcbd63942 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:44.593403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d371aafa-14ff-4207-86d0-4897e0c73b30 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:44.595626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:02:44.602187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d371aafa-14ff-4207-86d0-4897e0c73b30 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086171 Sep 02 10:02:44.602758 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 979/1880] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:44.648028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-37f3764a-b8d5-41e6-8658-559dcbd63942 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:44.656441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-37f3764a-b8d5-41e6-8658-559dcbd63942 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086378 Sep 02 10:02:44.656994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 902/1881] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:44 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:45.623494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f82b5883-714b-4be6-94b6-093a0f15826f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:45.624125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f82b5883-714b-4be6-94b6-093a0f15826f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:45.631201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f82b5883-714b-4be6-94b6-093a0f15826f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:45.631682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f82b5883-714b-4be6-94b6-093a0f15826f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:45.632118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f82b5883-714b-4be6-94b6-093a0f15826f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:45.632798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f82b5883-714b-4be6-94b6-093a0f15826f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:45.633250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f82b5883-714b-4be6-94b6-093a0f15826f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:45.633673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f82b5883-714b-4be6-94b6-093a0f15826f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:45.676665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8da9f60d-beed-4135-af34-763c8baff685 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:45.677299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8da9f60d-beed-4135-af34-763c8baff685 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:45.683746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8da9f60d-beed-4135-af34-763c8baff685 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:45.684235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8da9f60d-beed-4135-af34-763c8baff685 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:45.684673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8da9f60d-beed-4135-af34-763c8baff685 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:45.685359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8da9f60d-beed-4135-af34-763c8baff685 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:45.685811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8da9f60d-beed-4135-af34-763c8baff685 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:45.686235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8da9f60d-beed-4135-af34-763c8baff685 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:45.697466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f82b5883-714b-4be6-94b6-093a0f15826f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:45.705881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f82b5883-714b-4be6-94b6-093a0f15826f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086244 Sep 02 10:02:45.706449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 980/1882] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:45.746499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8da9f60d-beed-4135-af34-763c8baff685 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:45.754823 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8da9f60d-beed-4135-af34-763c8baff685 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081955 Sep 02 10:02:45.755926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 903/1883] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:45 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:46.727107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dbef95af-b7a0-4e84-bea3-c72ab04374db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:46.727735 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dbef95af-b7a0-4e84-bea3-c72ab04374db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:46.729995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=56 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:02:46.734625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbef95af-b7a0-4e84-bea3-c72ab04374db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:46.735130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbef95af-b7a0-4e84-bea3-c72ab04374db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:46.735564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbef95af-b7a0-4e84-bea3-c72ab04374db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:46.736243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbef95af-b7a0-4e84-bea3-c72ab04374db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:46.736696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbef95af-b7a0-4e84-bea3-c72ab04374db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:46.737113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbef95af-b7a0-4e84-bea3-c72ab04374db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:46.776671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7bcddb91-71fd-4896-8859-4839266a301f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:46.777280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7bcddb91-71fd-4896-8859-4839266a301f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:46.783766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bcddb91-71fd-4896-8859-4839266a301f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:46.784264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bcddb91-71fd-4896-8859-4839266a301f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:46.784683 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bcddb91-71fd-4896-8859-4839266a301f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:46.785597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bcddb91-71fd-4896-8859-4839266a301f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:46.786058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bcddb91-71fd-4896-8859-4839266a301f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:46.786480 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bcddb91-71fd-4896-8859-4839266a301f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:46.799391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dbef95af-b7a0-4e84-bea3-c72ab04374db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:46.807948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dbef95af-b7a0-4e84-bea3-c72ab04374db tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084711 Sep 02 10:02:46.808515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 981/1884] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:46.850547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7bcddb91-71fd-4896-8859-4839266a301f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:46.858790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7bcddb91-71fd-4896-8859-4839266a301f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085940 Sep 02 10:02:46.859353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 904/1885] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:46 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:47.829731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c5fd2f47-3565-4b19-9c2c-e564610ae802 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:47.830340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c5fd2f47-3565-4b19-9c2c-e564610ae802 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:47.837276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c5fd2f47-3565-4b19-9c2c-e564610ae802 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:47.837759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c5fd2f47-3565-4b19-9c2c-e564610ae802 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:47.838199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c5fd2f47-3565-4b19-9c2c-e564610ae802 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:47.838913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c5fd2f47-3565-4b19-9c2c-e564610ae802 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:47.839368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c5fd2f47-3565-4b19-9c2c-e564610ae802 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:47.839794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c5fd2f47-3565-4b19-9c2c-e564610ae802 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:47.880504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-54a3829d-a7b0-49b6-a0f3-8c4fbdfb0a44 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:47.881152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-54a3829d-a7b0-49b6-a0f3-8c4fbdfb0a44 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:47.887741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-54a3829d-a7b0-49b6-a0f3-8c4fbdfb0a44 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:47.888231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-54a3829d-a7b0-49b6-a0f3-8c4fbdfb0a44 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:47.888667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-54a3829d-a7b0-49b6-a0f3-8c4fbdfb0a44 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:47.889365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-54a3829d-a7b0-49b6-a0f3-8c4fbdfb0a44 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:47.889820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-54a3829d-a7b0-49b6-a0f3-8c4fbdfb0a44 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:47.890243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-54a3829d-a7b0-49b6-a0f3-8c4fbdfb0a44 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:47.901197 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c5fd2f47-3565-4b19-9c2c-e564610ae802 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:47.909424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c5fd2f47-3565-4b19-9c2c-e564610ae802 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083488 Sep 02 10:02:47.909985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 982/1886] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:47.952254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-54a3829d-a7b0-49b6-a0f3-8c4fbdfb0a44 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:47.960966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-54a3829d-a7b0-49b6-a0f3-8c4fbdfb0a44 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084688 Sep 02 10:02:47.961547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 905/1887] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:47 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:48.930955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d9f54920-b713-4b47-9001-84e87b70b7b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:48.931560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d9f54920-b713-4b47-9001-84e87b70b7b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:48.937935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f54920-b713-4b47-9001-84e87b70b7b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:48.938411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f54920-b713-4b47-9001-84e87b70b7b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:48.938874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f54920-b713-4b47-9001-84e87b70b7b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:48.939559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f54920-b713-4b47-9001-84e87b70b7b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:48.940007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f54920-b713-4b47-9001-84e87b70b7b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:48.940424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d9f54920-b713-4b47-9001-84e87b70b7b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:48.981312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-953c35cf-c443-4b3f-b452-b477bea33dfa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:48.981907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-953c35cf-c443-4b3f-b452-b477bea33dfa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:48.988287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-953c35cf-c443-4b3f-b452-b477bea33dfa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:48.988766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-953c35cf-c443-4b3f-b452-b477bea33dfa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:48.989195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-953c35cf-c443-4b3f-b452-b477bea33dfa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:48.989877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-953c35cf-c443-4b3f-b452-b477bea33dfa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:48.990329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-953c35cf-c443-4b3f-b452-b477bea33dfa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:48.990771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-953c35cf-c443-4b3f-b452-b477bea33dfa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:49.003809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d9f54920-b713-4b47-9001-84e87b70b7b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:49.012632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d9f54920-b713-4b47-9001-84e87b70b7b3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085592 Sep 02 10:02:49.013208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 983/1888] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:49.057059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-953c35cf-c443-4b3f-b452-b477bea33dfa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:49.065127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-953c35cf-c443-4b3f-b452-b477bea33dfa tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.087611 Sep 02 10:02:49.065680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 906/1889] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:48 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:50.034275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6befad50-a143-4f6e-8599-52a61a3076c7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:50.034927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6befad50-a143-4f6e-8599-52a61a3076c7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:50.041943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6befad50-a143-4f6e-8599-52a61a3076c7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:50.042428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6befad50-a143-4f6e-8599-52a61a3076c7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:50.042893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6befad50-a143-4f6e-8599-52a61a3076c7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:50.043613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6befad50-a143-4f6e-8599-52a61a3076c7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:50.044068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6befad50-a143-4f6e-8599-52a61a3076c7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:50.044494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6befad50-a143-4f6e-8599-52a61a3076c7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:50.086003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-95f3f689-59c0-42cb-9db4-9c27e5e1f3fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:50.086549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-95f3f689-59c0-42cb-9db4-9c27e5e1f3fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:50.092980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f3f689-59c0-42cb-9db4-9c27e5e1f3fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:50.093462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f3f689-59c0-42cb-9db4-9c27e5e1f3fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:50.093899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f3f689-59c0-42cb-9db4-9c27e5e1f3fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:50.094590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f3f689-59c0-42cb-9db4-9c27e5e1f3fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:50.095070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f3f689-59c0-42cb-9db4-9c27e5e1f3fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:50.095496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f3f689-59c0-42cb-9db4-9c27e5e1f3fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:50.105140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6befad50-a143-4f6e-8599-52a61a3076c7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:50.110877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:02:50.113540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6befad50-a143-4f6e-8599-52a61a3076c7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083119 Sep 02 10:02:50.114150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 984/1890] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:50.157651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-95f3f689-59c0-42cb-9db4-9c27e5e1f3fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:50.166329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-95f3f689-59c0-42cb-9db4-9c27e5e1f3fd tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084879 Sep 02 10:02:50.166912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 907/1891] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:50 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:51.135231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-62c76973-a866-4317-a8d7-c174b1f39bb1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:51.135805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-62c76973-a866-4317-a8d7-c174b1f39bb1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:51.142007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62c76973-a866-4317-a8d7-c174b1f39bb1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:51.142487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62c76973-a866-4317-a8d7-c174b1f39bb1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:51.142955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62c76973-a866-4317-a8d7-c174b1f39bb1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:51.143633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62c76973-a866-4317-a8d7-c174b1f39bb1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:51.144080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62c76973-a866-4317-a8d7-c174b1f39bb1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:51.144499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62c76973-a866-4317-a8d7-c174b1f39bb1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:51.185832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-60c939db-628e-4670-9930-222b2512a28d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:51.186435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-60c939db-628e-4670-9930-222b2512a28d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:51.193518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60c939db-628e-4670-9930-222b2512a28d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:51.194010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60c939db-628e-4670-9930-222b2512a28d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:51.194469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60c939db-628e-4670-9930-222b2512a28d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:51.195191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60c939db-628e-4670-9930-222b2512a28d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:51.195643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60c939db-628e-4670-9930-222b2512a28d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:51.196180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60c939db-628e-4670-9930-222b2512a28d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:51.205410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-62c76973-a866-4317-a8d7-c174b1f39bb1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:51.214309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-62c76973-a866-4317-a8d7-c174b1f39bb1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082937 Sep 02 10:02:51.214995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 985/1892] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:51.260697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-60c939db-628e-4670-9930-222b2512a28d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:51.268780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-60c939db-628e-4670-9930-222b2512a28d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086801 Sep 02 10:02:51.269353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 908/1893] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:51 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:52.236257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-65bf6059-08d2-4bee-b873-3834b24ab83b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:52.236805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-65bf6059-08d2-4bee-b873-3834b24ab83b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:52.243301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65bf6059-08d2-4bee-b873-3834b24ab83b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:52.243794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65bf6059-08d2-4bee-b873-3834b24ab83b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:52.244232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65bf6059-08d2-4bee-b873-3834b24ab83b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:52.244920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65bf6059-08d2-4bee-b873-3834b24ab83b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:52.245375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65bf6059-08d2-4bee-b873-3834b24ab83b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:52.245802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65bf6059-08d2-4bee-b873-3834b24ab83b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:52.290460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-52da8aa6-812c-495b-8e36-c74e94c3d725 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:52.291136 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-52da8aa6-812c-495b-8e36-c74e94c3d725 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:52.293413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=56 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:02:52.298338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52da8aa6-812c-495b-8e36-c74e94c3d725 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:52.298849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52da8aa6-812c-495b-8e36-c74e94c3d725 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:52.299283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52da8aa6-812c-495b-8e36-c74e94c3d725 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:52.299973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52da8aa6-812c-495b-8e36-c74e94c3d725 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:52.300420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52da8aa6-812c-495b-8e36-c74e94c3d725 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:52.307411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52da8aa6-812c-495b-8e36-c74e94c3d725 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:52.310137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-65bf6059-08d2-4bee-b873-3834b24ab83b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:52.318243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-65bf6059-08d2-4bee-b873-3834b24ab83b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085967 Sep 02 10:02:52.318998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 986/1894] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:52.362410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-52da8aa6-812c-495b-8e36-c74e94c3d725 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:52.370571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-52da8aa6-812c-495b-8e36-c74e94c3d725 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084516 Sep 02 10:02:52.371167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 909/1895] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:52 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:53.339316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e14d1431-8213-43e8-a093-3ee20418e45c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:53.339924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e14d1431-8213-43e8-a093-3ee20418e45c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:53.346243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e14d1431-8213-43e8-a093-3ee20418e45c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:53.346745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e14d1431-8213-43e8-a093-3ee20418e45c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:53.347187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e14d1431-8213-43e8-a093-3ee20418e45c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:53.347872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e14d1431-8213-43e8-a093-3ee20418e45c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:53.348323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e14d1431-8213-43e8-a093-3ee20418e45c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:53.348775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e14d1431-8213-43e8-a093-3ee20418e45c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:53.391682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e017145c-369d-48e8-a41a-41e37c304ad2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:53.398468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e017145c-369d-48e8-a41a-41e37c304ad2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:53.398858 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e017145c-369d-48e8-a41a-41e37c304ad2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:53.399346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e017145c-369d-48e8-a41a-41e37c304ad2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:53.399779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e017145c-369d-48e8-a41a-41e37c304ad2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:53.400477 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e017145c-369d-48e8-a41a-41e37c304ad2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:53.400935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e017145c-369d-48e8-a41a-41e37c304ad2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:53.401336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e017145c-369d-48e8-a41a-41e37c304ad2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:53.412905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e14d1431-8213-43e8-a093-3ee20418e45c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:53.421051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e14d1431-8213-43e8-a093-3ee20418e45c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085562 Sep 02 10:02:53.421628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 987/1896] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:53.465794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e017145c-369d-48e8-a41a-41e37c304ad2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:53.473911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e017145c-369d-48e8-a41a-41e37c304ad2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086609 Sep 02 10:02:53.474464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 910/1897] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:53 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:54.441845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bedb317e-406c-4129-81e5-e039b232047f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:54.442525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bedb317e-406c-4129-81e5-e039b232047f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:54.448896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedb317e-406c-4129-81e5-e039b232047f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:54.449372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedb317e-406c-4129-81e5-e039b232047f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:54.449805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedb317e-406c-4129-81e5-e039b232047f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:54.450480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedb317e-406c-4129-81e5-e039b232047f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:54.450955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedb317e-406c-4129-81e5-e039b232047f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:54.451377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bedb317e-406c-4129-81e5-e039b232047f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:54.494220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-505f2f9e-954c-47e3-9e96-8f2cd984d664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:54.495093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-505f2f9e-954c-47e3-9e96-8f2cd984d664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:54.501705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505f2f9e-954c-47e3-9e96-8f2cd984d664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:54.502191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505f2f9e-954c-47e3-9e96-8f2cd984d664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:54.502644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505f2f9e-954c-47e3-9e96-8f2cd984d664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:54.503351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505f2f9e-954c-47e3-9e96-8f2cd984d664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:54.503807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505f2f9e-954c-47e3-9e96-8f2cd984d664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:54.504236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505f2f9e-954c-47e3-9e96-8f2cd984d664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:54.514613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bedb317e-406c-4129-81e5-e039b232047f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:54.523256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bedb317e-406c-4129-81e5-e039b232047f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085270 Sep 02 10:02:54.523824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 988/1898] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:54.564433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-505f2f9e-954c-47e3-9e96-8f2cd984d664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:54.572533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-505f2f9e-954c-47e3-9e96-8f2cd984d664 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082222 Sep 02 10:02:54.573103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 911/1899] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:54 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:55.545025 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f1c3e166-6947-4b67-952e-7e68b5fd3a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:55.545701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f1c3e166-6947-4b67-952e-7e68b5fd3a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:55.552988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1c3e166-6947-4b67-952e-7e68b5fd3a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:55.553469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1c3e166-6947-4b67-952e-7e68b5fd3a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:55.553908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1c3e166-6947-4b67-952e-7e68b5fd3a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:55.554592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1c3e166-6947-4b67-952e-7e68b5fd3a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:55.555078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1c3e166-6947-4b67-952e-7e68b5fd3a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:55.555507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f1c3e166-6947-4b67-952e-7e68b5fd3a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:55.593327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c0323f54-d0bc-42f5-a5eb-4130492bfabc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:55.593939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c0323f54-d0bc-42f5-a5eb-4130492bfabc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:55.600996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0323f54-d0bc-42f5-a5eb-4130492bfabc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:55.601484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0323f54-d0bc-42f5-a5eb-4130492bfabc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:55.601920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0323f54-d0bc-42f5-a5eb-4130492bfabc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:55.602613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0323f54-d0bc-42f5-a5eb-4130492bfabc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:55.603101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0323f54-d0bc-42f5-a5eb-4130492bfabc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:55.606208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0323f54-d0bc-42f5-a5eb-4130492bfabc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:55.617097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f1c3e166-6947-4b67-952e-7e68b5fd3a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:55.625268 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f1c3e166-6947-4b67-952e-7e68b5fd3a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084122 Sep 02 10:02:55.629221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 989/1900] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:55.668201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c0323f54-d0bc-42f5-a5eb-4130492bfabc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:55.676359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c0323f54-d0bc-42f5-a5eb-4130492bfabc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086881 Sep 02 10:02:55.677542 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 912/1901] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:55 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:56.647053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-23215f91-d18d-4936-a171-57243f1780fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:56.647674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-23215f91-d18d-4936-a171-57243f1780fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:56.654026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23215f91-d18d-4936-a171-57243f1780fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:56.654509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23215f91-d18d-4936-a171-57243f1780fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:56.654971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23215f91-d18d-4936-a171-57243f1780fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:56.655653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23215f91-d18d-4936-a171-57243f1780fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:56.656100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23215f91-d18d-4936-a171-57243f1780fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:56.656517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23215f91-d18d-4936-a171-57243f1780fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:56.698045 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-efc6ce80-2d54-4859-a674-aeb380c5cae9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:56.698663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-efc6ce80-2d54-4859-a674-aeb380c5cae9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:56.705038 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc6ce80-2d54-4859-a674-aeb380c5cae9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:56.705524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc6ce80-2d54-4859-a674-aeb380c5cae9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:56.705955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc6ce80-2d54-4859-a674-aeb380c5cae9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:56.706640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc6ce80-2d54-4859-a674-aeb380c5cae9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:56.707121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc6ce80-2d54-4859-a674-aeb380c5cae9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:56.707544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-efc6ce80-2d54-4859-a674-aeb380c5cae9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:56.717502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-23215f91-d18d-4936-a171-57243f1780fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:56.725720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-23215f91-d18d-4936-a171-57243f1780fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084294 Sep 02 10:02:56.726265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 990/1902] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:56.805862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-efc6ce80-2d54-4859-a674-aeb380c5cae9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:56.805862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-efc6ce80-2d54-4859-a674-aeb380c5cae9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086535 Sep 02 10:02:56.805862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 913/1903] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:56 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:57.747413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6f0729be-ab77-4d67-8dae-37e0087e5018 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:57.748011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6f0729be-ab77-4d67-8dae-37e0087e5018 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:57.755258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f0729be-ab77-4d67-8dae-37e0087e5018 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:57.755743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f0729be-ab77-4d67-8dae-37e0087e5018 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:57.756179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f0729be-ab77-4d67-8dae-37e0087e5018 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:57.756867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f0729be-ab77-4d67-8dae-37e0087e5018 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:57.757319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f0729be-ab77-4d67-8dae-37e0087e5018 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:57.757743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f0729be-ab77-4d67-8dae-37e0087e5018 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:57.821615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6f0729be-ab77-4d67-8dae-37e0087e5018 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:57.824661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-108bd220-6820-4989-a25a-e670f12cda81 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:57.825275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-108bd220-6820-4989-a25a-e670f12cda81 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:57.830407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6f0729be-ab77-4d67-8dae-37e0087e5018 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086839 Sep 02 10:02:57.831027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 991/1904] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:57.831609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108bd220-6820-4989-a25a-e670f12cda81 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:57.832091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108bd220-6820-4989-a25a-e670f12cda81 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:57.832522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108bd220-6820-4989-a25a-e670f12cda81 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:57.833866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108bd220-6820-4989-a25a-e670f12cda81 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:57.834321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108bd220-6820-4989-a25a-e670f12cda81 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:57.834768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-108bd220-6820-4989-a25a-e670f12cda81 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:57.902085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-108bd220-6820-4989-a25a-e670f12cda81 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:57.910198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-108bd220-6820-4989-a25a-e670f12cda81 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.089408 Sep 02 10:02:57.910812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 914/1905] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:57 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:58.852846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0bd34db3-a5a2-465b-bf3c-66e79b7382d9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:58.853482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0bd34db3-a5a2-465b-bf3c-66e79b7382d9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:58.860006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bd34db3-a5a2-465b-bf3c-66e79b7382d9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:58.860492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bd34db3-a5a2-465b-bf3c-66e79b7382d9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:58.860927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bd34db3-a5a2-465b-bf3c-66e79b7382d9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:58.861628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bd34db3-a5a2-465b-bf3c-66e79b7382d9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:58.862059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bd34db3-a5a2-465b-bf3c-66e79b7382d9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:58.862484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0bd34db3-a5a2-465b-bf3c-66e79b7382d9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:58.923223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0bd34db3-a5a2-465b-bf3c-66e79b7382d9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:58.930663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-00536494-0f42-4ed1-a02b-aa3dcbec856f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:58.931379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-00536494-0f42-4ed1-a02b-aa3dcbec856f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:58.931516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0bd34db3-a5a2-465b-bf3c-66e79b7382d9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083112 Sep 02 10:02:58.932000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 992/1906] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:02:58.938142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00536494-0f42-4ed1-a02b-aa3dcbec856f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:58.938625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00536494-0f42-4ed1-a02b-aa3dcbec856f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:58.939101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00536494-0f42-4ed1-a02b-aa3dcbec856f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:58.939776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00536494-0f42-4ed1-a02b-aa3dcbec856f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:58.940227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00536494-0f42-4ed1-a02b-aa3dcbec856f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:58.940668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00536494-0f42-4ed1-a02b-aa3dcbec856f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:59.000421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-00536494-0f42-4ed1-a02b-aa3dcbec856f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:02:59.008773 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-00536494-0f42-4ed1-a02b-aa3dcbec856f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082028 Sep 02 10:02:59.009338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 915/1907] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:58 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:02:59.952063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-74b58084-3472-42c6-a30f-77622b731f08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:02:59.952671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-74b58084-3472-42c6-a30f-77622b731f08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:02:59.959122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74b58084-3472-42c6-a30f-77622b731f08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:59.959625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74b58084-3472-42c6-a30f-77622b731f08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:59.960058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74b58084-3472-42c6-a30f-77622b731f08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:02:59.960738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74b58084-3472-42c6-a30f-77622b731f08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:02:59.961186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74b58084-3472-42c6-a30f-77622b731f08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:02:59.961603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74b58084-3472-42c6-a30f-77622b731f08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:00.023857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-74b58084-3472-42c6-a30f-77622b731f08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:00.029308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-725050ba-cc20-44d4-84a8-03de040fe204 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:00.029918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-725050ba-cc20-44d4-84a8-03de040fe204 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:00.032143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-74b58084-3472-42c6-a30f-77622b731f08 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083972 Sep 02 10:03:00.032718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 993/1908] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:02:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:00.036926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-725050ba-cc20-44d4-84a8-03de040fe204 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:00.037406 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-725050ba-cc20-44d4-84a8-03de040fe204 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:00.037838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-725050ba-cc20-44d4-84a8-03de040fe204 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:00.038525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-725050ba-cc20-44d4-84a8-03de040fe204 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:00.039002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-725050ba-cc20-44d4-84a8-03de040fe204 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:00.039428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-725050ba-cc20-44d4-84a8-03de040fe204 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:00.100447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-725050ba-cc20-44d4-84a8-03de040fe204 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:00.108781 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-725050ba-cc20-44d4-84a8-03de040fe204 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083341 Sep 02 10:03:00.109348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 916/1909] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:00 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:01.053758 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-989d29c5-86f2-420d-96d4-515717298acb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:01.054279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-989d29c5-86f2-420d-96d4-515717298acb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:01.060818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-989d29c5-86f2-420d-96d4-515717298acb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:01.061300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-989d29c5-86f2-420d-96d4-515717298acb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:01.061733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-989d29c5-86f2-420d-96d4-515717298acb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:01.062421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-989d29c5-86f2-420d-96d4-515717298acb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:01.062912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-989d29c5-86f2-420d-96d4-515717298acb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:01.063333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-989d29c5-86f2-420d-96d4-515717298acb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:01.124652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-989d29c5-86f2-420d-96d4-515717298acb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:01.130299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7ab7bb3f-a42b-4034-95d1-ff2b4591653c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:01.130933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7ab7bb3f-a42b-4034-95d1-ff2b4591653c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:01.133764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-989d29c5-86f2-420d-96d4-515717298acb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084446 Sep 02 10:03:01.134346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 994/1910] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:01.137574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ab7bb3f-a42b-4034-95d1-ff2b4591653c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:01.138064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ab7bb3f-a42b-4034-95d1-ff2b4591653c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:01.138498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ab7bb3f-a42b-4034-95d1-ff2b4591653c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:01.139289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ab7bb3f-a42b-4034-95d1-ff2b4591653c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:01.139743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ab7bb3f-a42b-4034-95d1-ff2b4591653c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:01.140179 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7ab7bb3f-a42b-4034-95d1-ff2b4591653c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:01.201026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7ab7bb3f-a42b-4034-95d1-ff2b4591653c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:01.209042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7ab7bb3f-a42b-4034-95d1-ff2b4591653c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.083443 Sep 02 10:03:01.213670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 917/1911] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:01 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:02.153889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-09619855-8cad-44a2-9433-cb1ffe09d5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:02.154466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-09619855-8cad-44a2-9433-cb1ffe09d5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:02.161617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09619855-8cad-44a2-9433-cb1ffe09d5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:02.162098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09619855-8cad-44a2-9433-cb1ffe09d5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:02.162561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09619855-8cad-44a2-9433-cb1ffe09d5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:02.163275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09619855-8cad-44a2-9433-cb1ffe09d5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:02.163729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09619855-8cad-44a2-9433-cb1ffe09d5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:02.164155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09619855-8cad-44a2-9433-cb1ffe09d5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:02.226979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-09619855-8cad-44a2-9433-cb1ffe09d5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:02.229777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3d777773-cf72-409a-b311-76a28ce2d079 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:02.230466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3d777773-cf72-409a-b311-76a28ce2d079 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:02.235359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-09619855-8cad-44a2-9433-cb1ffe09d5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085355 Sep 02 10:03:02.235933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 995/1912] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:02.236554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d777773-cf72-409a-b311-76a28ce2d079 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:02.237103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d777773-cf72-409a-b311-76a28ce2d079 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:02.237603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d777773-cf72-409a-b311-76a28ce2d079 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:02.238360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d777773-cf72-409a-b311-76a28ce2d079 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:02.238926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d777773-cf72-409a-b311-76a28ce2d079 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:02.239416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d777773-cf72-409a-b311-76a28ce2d079 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:02.302252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3d777773-cf72-409a-b311-76a28ce2d079 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:02.310376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3d777773-cf72-409a-b311-76a28ce2d079 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084785 Sep 02 10:03:02.310985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 918/1913] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:02 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:03.256341 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-931388e8-7acd-4e6b-88ca-02114165f97e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:03.256870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-931388e8-7acd-4e6b-88ca-02114165f97e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:03.263301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-931388e8-7acd-4e6b-88ca-02114165f97e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:03.263784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-931388e8-7acd-4e6b-88ca-02114165f97e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:03.264218 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-931388e8-7acd-4e6b-88ca-02114165f97e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:03.264895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-931388e8-7acd-4e6b-88ca-02114165f97e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:03.265339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-931388e8-7acd-4e6b-88ca-02114165f97e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:03.265762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-931388e8-7acd-4e6b-88ca-02114165f97e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:03.280094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:03.325950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-931388e8-7acd-4e6b-88ca-02114165f97e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:03.331624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fa6e50b8-23fa-4da0-bc14-01387670359c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:03.332236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fa6e50b8-23fa-4da0-bc14-01387670359c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:03.334655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-931388e8-7acd-4e6b-88ca-02114165f97e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082247 Sep 02 10:03:03.335251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 996/1914] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:03.339084 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa6e50b8-23fa-4da0-bc14-01387670359c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:03.339567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa6e50b8-23fa-4da0-bc14-01387670359c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:03.339999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa6e50b8-23fa-4da0-bc14-01387670359c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:03.340703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa6e50b8-23fa-4da0-bc14-01387670359c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:03.341141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa6e50b8-23fa-4da0-bc14-01387670359c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:03.341563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa6e50b8-23fa-4da0-bc14-01387670359c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:03.403730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fa6e50b8-23fa-4da0-bc14-01387670359c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:03.412438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fa6e50b8-23fa-4da0-bc14-01387670359c tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084640 Sep 02 10:03:03.412998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 919/1915] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:03 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:04.355380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1ca5249c-c495-4801-bdd4-03a11bc41251 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:04.355995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1ca5249c-c495-4801-bdd4-03a11bc41251 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:04.362859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ca5249c-c495-4801-bdd4-03a11bc41251 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:04.363347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ca5249c-c495-4801-bdd4-03a11bc41251 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:04.364323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ca5249c-c495-4801-bdd4-03a11bc41251 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:04.365011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ca5249c-c495-4801-bdd4-03a11bc41251 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:04.365466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ca5249c-c495-4801-bdd4-03a11bc41251 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:04.365891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ca5249c-c495-4801-bdd4-03a11bc41251 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:04.426302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1ca5249c-c495-4801-bdd4-03a11bc41251 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:04.433198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7841339a-db98-4fb7-a1b0-ab605463a0b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:04.433932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7841339a-db98-4fb7-a1b0-ab605463a0b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:04.435071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1ca5249c-c495-4801-bdd4-03a11bc41251 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083561 Sep 02 10:03:04.435797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 997/1916] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:04.440676 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7841339a-db98-4fb7-a1b0-ab605463a0b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:04.441234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7841339a-db98-4fb7-a1b0-ab605463a0b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:04.441766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7841339a-db98-4fb7-a1b0-ab605463a0b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:04.442458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7841339a-db98-4fb7-a1b0-ab605463a0b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:04.442939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7841339a-db98-4fb7-a1b0-ab605463a0b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:04.443371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7841339a-db98-4fb7-a1b0-ab605463a0b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:04.503183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7841339a-db98-4fb7-a1b0-ab605463a0b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:04.511503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7841339a-db98-4fb7-a1b0-ab605463a0b9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082222 Sep 02 10:03:04.512074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 920/1917] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:04 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:05.455765 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-90acd2ce-800a-43c8-a5f5-add60a046f3f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:05.456354 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-90acd2ce-800a-43c8-a5f5-add60a046f3f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:05.463321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90acd2ce-800a-43c8-a5f5-add60a046f3f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:05.463801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90acd2ce-800a-43c8-a5f5-add60a046f3f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:05.464237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90acd2ce-800a-43c8-a5f5-add60a046f3f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:05.464913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90acd2ce-800a-43c8-a5f5-add60a046f3f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:05.465360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90acd2ce-800a-43c8-a5f5-add60a046f3f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:05.465780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90acd2ce-800a-43c8-a5f5-add60a046f3f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:05.525684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-90acd2ce-800a-43c8-a5f5-add60a046f3f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:05.531489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-42994f95-37a7-4931-b1a2-459c80855d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:05.532129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-42994f95-37a7-4931-b1a2-459c80855d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:05.533966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-90acd2ce-800a-43c8-a5f5-add60a046f3f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082042 Sep 02 10:03:05.534532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 998/1918] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:05.538509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42994f95-37a7-4931-b1a2-459c80855d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:05.539022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42994f95-37a7-4931-b1a2-459c80855d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:05.539459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42994f95-37a7-4931-b1a2-459c80855d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:05.540145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42994f95-37a7-4931-b1a2-459c80855d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:05.540599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42994f95-37a7-4931-b1a2-459c80855d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:05.541020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42994f95-37a7-4931-b1a2-459c80855d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:05.605060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-42994f95-37a7-4931-b1a2-459c80855d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:05.613321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-42994f95-37a7-4931-b1a2-459c80855d89 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085603 Sep 02 10:03:05.614416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 921/1919] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:05 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:06.554518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-510fb52f-323d-41d8-a082-a8b186438e86 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:06.555157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-510fb52f-323d-41d8-a082-a8b186438e86 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:06.561698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-510fb52f-323d-41d8-a082-a8b186438e86 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:06.562174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-510fb52f-323d-41d8-a082-a8b186438e86 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:06.562601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-510fb52f-323d-41d8-a082-a8b186438e86 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:06.563309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-510fb52f-323d-41d8-a082-a8b186438e86 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:06.563759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-510fb52f-323d-41d8-a082-a8b186438e86 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:06.564178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-510fb52f-323d-41d8-a082-a8b186438e86 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:06.633366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-510fb52f-323d-41d8-a082-a8b186438e86 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:06.634806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4b3d6691-392b-465a-a6b0-7f0ef2f77c4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:06.635424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4b3d6691-392b-465a-a6b0-7f0ef2f77c4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:06.641685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-510fb52f-323d-41d8-a082-a8b186438e86 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.090989 Sep 02 10:03:06.641960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b3d6691-392b-465a-a6b0-7f0ef2f77c4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:06.642246 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 999/1920] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:06.642451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b3d6691-392b-465a-a6b0-7f0ef2f77c4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:06.642928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b3d6691-392b-465a-a6b0-7f0ef2f77c4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:06.643629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b3d6691-392b-465a-a6b0-7f0ef2f77c4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:06.644081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b3d6691-392b-465a-a6b0-7f0ef2f77c4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:06.644506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4b3d6691-392b-465a-a6b0-7f0ef2f77c4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:06.708886 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4b3d6691-392b-465a-a6b0-7f0ef2f77c4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:06.716933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4b3d6691-392b-465a-a6b0-7f0ef2f77c4d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.086067 Sep 02 10:03:06.717499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 922/1921] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:06 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:07.662344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7d60db1c-95ce-43f2-9b9b-a5b5e703b07c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:07.662925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7d60db1c-95ce-43f2-9b9b-a5b5e703b07c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:07.668961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7d60db1c-95ce-43f2-9b9b-a5b5e703b07c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:07.669446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7d60db1c-95ce-43f2-9b9b-a5b5e703b07c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:07.669884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7d60db1c-95ce-43f2-9b9b-a5b5e703b07c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:07.670573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7d60db1c-95ce-43f2-9b9b-a5b5e703b07c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:07.671061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7d60db1c-95ce-43f2-9b9b-a5b5e703b07c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:07.671488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7d60db1c-95ce-43f2-9b9b-a5b5e703b07c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:07.732953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7d60db1c-95ce-43f2-9b9b-a5b5e703b07c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:07.737552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-faa0ad11-320a-4461-b385-44a025da4893 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:07.738180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-faa0ad11-320a-4461-b385-44a025da4893 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:07.741286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7d60db1c-95ce-43f2-9b9b-a5b5e703b07c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082868 Sep 02 10:03:07.741856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1000/1922] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:07.744827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-faa0ad11-320a-4461-b385-44a025da4893 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:07.745317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-faa0ad11-320a-4461-b385-44a025da4893 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:07.745754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-faa0ad11-320a-4461-b385-44a025da4893 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:07.746454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-faa0ad11-320a-4461-b385-44a025da4893 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:07.746958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-faa0ad11-320a-4461-b385-44a025da4893 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:07.747388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-faa0ad11-320a-4461-b385-44a025da4893 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:07.808950 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-faa0ad11-320a-4461-b385-44a025da4893 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:07.817771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-faa0ad11-320a-4461-b385-44a025da4893 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084196 Sep 02 10:03:07.818368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 923/1923] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:07 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:08.763021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-525e6938-fae3-4307-869e-5bef91ff20a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:08.763654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-525e6938-fae3-4307-869e-5bef91ff20a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:08.769920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-525e6938-fae3-4307-869e-5bef91ff20a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:08.770401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-525e6938-fae3-4307-869e-5bef91ff20a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:08.770870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-525e6938-fae3-4307-869e-5bef91ff20a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:08.771549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-525e6938-fae3-4307-869e-5bef91ff20a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:08.771996 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-525e6938-fae3-4307-869e-5bef91ff20a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:08.772420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-525e6938-fae3-4307-869e-5bef91ff20a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:08.833251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-525e6938-fae3-4307-869e-5bef91ff20a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:08.837528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e43fa032-6c59-4fe3-87e0-2b7fd57af4a0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:08.838140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e43fa032-6c59-4fe3-87e0-2b7fd57af4a0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:08.841529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-525e6938-fae3-4307-869e-5bef91ff20a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082480 Sep 02 10:03:08.842107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1001/1924] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:08.845799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e43fa032-6c59-4fe3-87e0-2b7fd57af4a0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:08.845939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e43fa032-6c59-4fe3-87e0-2b7fd57af4a0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:08.846267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e43fa032-6c59-4fe3-87e0-2b7fd57af4a0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:08.847003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e43fa032-6c59-4fe3-87e0-2b7fd57af4a0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:08.847458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e43fa032-6c59-4fe3-87e0-2b7fd57af4a0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:08.847953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e43fa032-6c59-4fe3-87e0-2b7fd57af4a0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:08.850650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:08.909868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e43fa032-6c59-4fe3-87e0-2b7fd57af4a0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:08.918538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e43fa032-6c59-4fe3-87e0-2b7fd57af4a0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.084875 Sep 02 10:03:08.919138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 924/1925] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:08 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:09.864157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c3ebfc47-ff40-4b48-b4f1-c9c1919fc838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:09.864795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c3ebfc47-ff40-4b48-b4f1-c9c1919fc838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:09.871204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3ebfc47-ff40-4b48-b4f1-c9c1919fc838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:09.871686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3ebfc47-ff40-4b48-b4f1-c9c1919fc838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:09.872122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3ebfc47-ff40-4b48-b4f1-c9c1919fc838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:09.872810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3ebfc47-ff40-4b48-b4f1-c9c1919fc838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:09.873262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3ebfc47-ff40-4b48-b4f1-c9c1919fc838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:09.873685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c3ebfc47-ff40-4b48-b4f1-c9c1919fc838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:09.934597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c3ebfc47-ff40-4b48-b4f1-c9c1919fc838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:09.939439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-53220ca4-428a-4478-b7d0-90e08fe6c786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:09.940048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-53220ca4-428a-4478-b7d0-90e08fe6c786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:09.943331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c3ebfc47-ff40-4b48-b4f1-c9c1919fc838 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083128 Sep 02 10:03:09.943905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1002/1926] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:09.947374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53220ca4-428a-4478-b7d0-90e08fe6c786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:09.947859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53220ca4-428a-4478-b7d0-90e08fe6c786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:09.948287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53220ca4-428a-4478-b7d0-90e08fe6c786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:09.948975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53220ca4-428a-4478-b7d0-90e08fe6c786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:09.949422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53220ca4-428a-4478-b7d0-90e08fe6c786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:09.949840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53220ca4-428a-4478-b7d0-90e08fe6c786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:10.010408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-53220ca4-428a-4478-b7d0-90e08fe6c786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:10.018324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-53220ca4-428a-4478-b7d0-90e08fe6c786 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082729 Sep 02 10:03:10.018912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 925/1927] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:09 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:10.965766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ad5746c3-2e10-420e-aa86-efb5a9c9899a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:10.967230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ad5746c3-2e10-420e-aa86-efb5a9c9899a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:10.974498 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad5746c3-2e10-420e-aa86-efb5a9c9899a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:10.975017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad5746c3-2e10-420e-aa86-efb5a9c9899a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:10.975475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad5746c3-2e10-420e-aa86-efb5a9c9899a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:10.976182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad5746c3-2e10-420e-aa86-efb5a9c9899a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:10.976791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad5746c3-2e10-420e-aa86-efb5a9c9899a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:10.977384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ad5746c3-2e10-420e-aa86-efb5a9c9899a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:11.040106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3c5c216f-2fac-4a75-9858-7bf78cc160b2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:11.041740 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3c5c216f-2fac-4a75-9858-7bf78cc160b2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:11.049936 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ad5746c3-2e10-420e-aa86-efb5a9c9899a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:11.052944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c5c216f-2fac-4a75-9858-7bf78cc160b2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:11.053724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c5c216f-2fac-4a75-9858-7bf78cc160b2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:11.054369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c5c216f-2fac-4a75-9858-7bf78cc160b2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:11.055354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c5c216f-2fac-4a75-9858-7bf78cc160b2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:11.056100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c5c216f-2fac-4a75-9858-7bf78cc160b2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:11.056730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c5c216f-2fac-4a75-9858-7bf78cc160b2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:11.064086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ad5746c3-2e10-420e-aa86-efb5a9c9899a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.102296 Sep 02 10:03:11.065006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1003/1928] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:11.130150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3c5c216f-2fac-4a75-9858-7bf78cc160b2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:11.138490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3c5c216f-2fac-4a75-9858-7bf78cc160b2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.102879 Sep 02 10:03:11.139076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 926/1929] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:11 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:12.084860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1720547f-5a3a-4a3a-951a-ca24dee6f07b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:12.085478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1720547f-5a3a-4a3a-951a-ca24dee6f07b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:12.092058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1720547f-5a3a-4a3a-951a-ca24dee6f07b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:12.092547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1720547f-5a3a-4a3a-951a-ca24dee6f07b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:12.092989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1720547f-5a3a-4a3a-951a-ca24dee6f07b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:12.093679 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1720547f-5a3a-4a3a-951a-ca24dee6f07b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:12.094139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1720547f-5a3a-4a3a-951a-ca24dee6f07b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:12.094569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1720547f-5a3a-4a3a-951a-ca24dee6f07b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:12.155600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1720547f-5a3a-4a3a-951a-ca24dee6f07b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:12.159690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-401b959c-ce64-44aa-b0cc-2e746b965c07 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:12.160795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-401b959c-ce64-44aa-b0cc-2e746b965c07 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:12.164304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1720547f-5a3a-4a3a-951a-ca24dee6f07b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083317 Sep 02 10:03:12.164910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1004/1930] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:12.167255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-401b959c-ce64-44aa-b0cc-2e746b965c07 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:12.167737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-401b959c-ce64-44aa-b0cc-2e746b965c07 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:12.168168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-401b959c-ce64-44aa-b0cc-2e746b965c07 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:12.168857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-401b959c-ce64-44aa-b0cc-2e746b965c07 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:12.169308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-401b959c-ce64-44aa-b0cc-2e746b965c07 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:12.169726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-401b959c-ce64-44aa-b0cc-2e746b965c07 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:12.230345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-401b959c-ce64-44aa-b0cc-2e746b965c07 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:12.238404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-401b959c-ce64-44aa-b0cc-2e746b965c07 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082433 Sep 02 10:03:12.239527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 927/1931] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:12 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:13.185529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5ccf8909-18b0-4e57-af11-c61bea76ae78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:13.186119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5ccf8909-18b0-4e57-af11-c61bea76ae78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:13.193124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ccf8909-18b0-4e57-af11-c61bea76ae78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:13.193611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ccf8909-18b0-4e57-af11-c61bea76ae78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:13.194043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ccf8909-18b0-4e57-af11-c61bea76ae78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:13.194746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ccf8909-18b0-4e57-af11-c61bea76ae78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:13.195201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ccf8909-18b0-4e57-af11-c61bea76ae78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:13.195623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ccf8909-18b0-4e57-af11-c61bea76ae78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:13.256024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ccf8909-18b0-4e57-af11-c61bea76ae78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:13.260132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-902c7048-b72c-4866-a8dc-40e3d1e00da1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:13.260743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-902c7048-b72c-4866-a8dc-40e3d1e00da1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:13.264295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5ccf8909-18b0-4e57-af11-c61bea76ae78 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082695 Sep 02 10:03:13.264876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1005/1932] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:13.267150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-902c7048-b72c-4866-a8dc-40e3d1e00da1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:13.267630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-902c7048-b72c-4866-a8dc-40e3d1e00da1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:13.268061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-902c7048-b72c-4866-a8dc-40e3d1e00da1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:13.268746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-902c7048-b72c-4866-a8dc-40e3d1e00da1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:13.269196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-902c7048-b72c-4866-a8dc-40e3d1e00da1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:13.269615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-902c7048-b72c-4866-a8dc-40e3d1e00da1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:13.329141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-902c7048-b72c-4866-a8dc-40e3d1e00da1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:13.337175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-902c7048-b72c-4866-a8dc-40e3d1e00da1 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.080844 Sep 02 10:03:13.337735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 928/1933] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:13 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:14.284906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b3a1c052-e6bb-4f22-bd5a-4252faf0cd89 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:14.285513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b3a1c052-e6bb-4f22-bd5a-4252faf0cd89 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:14.291840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a1c052-e6bb-4f22-bd5a-4252faf0cd89 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:14.292321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a1c052-e6bb-4f22-bd5a-4252faf0cd89 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:14.292753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a1c052-e6bb-4f22-bd5a-4252faf0cd89 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:14.293426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a1c052-e6bb-4f22-bd5a-4252faf0cd89 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:14.293875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a1c052-e6bb-4f22-bd5a-4252faf0cd89 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:14.294293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3a1c052-e6bb-4f22-bd5a-4252faf0cd89 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:14.362580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b3a1c052-e6bb-4f22-bd5a-4252faf0cd89 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:14.362794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cc6c3d33-ad97-4f33-a5ef-aa74ca3c887f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:14.362794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cc6c3d33-ad97-4f33-a5ef-aa74ca3c887f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:14.364273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc6c3d33-ad97-4f33-a5ef-aa74ca3c887f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:14.364563 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b3a1c052-e6bb-4f22-bd5a-4252faf0cd89 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083647 Sep 02 10:03:14.364749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc6c3d33-ad97-4f33-a5ef-aa74ca3c887f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:14.365146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1006/1934] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:14.365314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc6c3d33-ad97-4f33-a5ef-aa74ca3c887f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:14.366006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc6c3d33-ad97-4f33-a5ef-aa74ca3c887f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:14.366458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc6c3d33-ad97-4f33-a5ef-aa74ca3c887f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:14.366905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cc6c3d33-ad97-4f33-a5ef-aa74ca3c887f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:14.427538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cc6c3d33-ad97-4f33-a5ef-aa74ca3c887f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:14.435611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cc6c3d33-ad97-4f33-a5ef-aa74ca3c887f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.082039 Sep 02 10:03:14.436172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 929/1935] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:14 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:15.385352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dccdb339-5a6b-4e52-aa79-0826365502fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:15.385964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dccdb339-5a6b-4e52-aa79-0826365502fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:15.392356 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dccdb339-5a6b-4e52-aa79-0826365502fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:15.392834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dccdb339-5a6b-4e52-aa79-0826365502fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:15.393270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dccdb339-5a6b-4e52-aa79-0826365502fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:15.393956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dccdb339-5a6b-4e52-aa79-0826365502fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:15.394408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dccdb339-5a6b-4e52-aa79-0826365502fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:15.395346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dccdb339-5a6b-4e52-aa79-0826365502fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:15.458388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-996758ab-2f7f-474b-bd69-1777609fec00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:15.459029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-996758ab-2f7f-474b-bd69-1777609fec00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:15.459167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dccdb339-5a6b-4e52-aa79-0826365502fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:15.465460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996758ab-2f7f-474b-bd69-1777609fec00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:15.465944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996758ab-2f7f-474b-bd69-1777609fec00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:15.466378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996758ab-2f7f-474b-bd69-1777609fec00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:15.467089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996758ab-2f7f-474b-bd69-1777609fec00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:15.467435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dccdb339-5a6b-4e52-aa79-0826365502fb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085941 Sep 02 10:03:15.467560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996758ab-2f7f-474b-bd69-1777609fec00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:15.467953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-996758ab-2f7f-474b-bd69-1777609fec00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:15.468068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1007/1936] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:15.530607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-996758ab-2f7f-474b-bd69-1777609fec00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:15.539349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-996758ab-2f7f-474b-bd69-1777609fec00 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.085440 Sep 02 10:03:15.539917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 930/1937] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:15 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:16.489616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fdb3ee42-b918-470c-a865-58c73bce0dab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:16.490234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fdb3ee42-b918-470c-a865-58c73bce0dab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:16.496684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdb3ee42-b918-470c-a865-58c73bce0dab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:16.497170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdb3ee42-b918-470c-a865-58c73bce0dab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:16.497609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdb3ee42-b918-470c-a865-58c73bce0dab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:16.498301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdb3ee42-b918-470c-a865-58c73bce0dab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:16.498784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdb3ee42-b918-470c-a865-58c73bce0dab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:16.499215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdb3ee42-b918-470c-a865-58c73bce0dab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:16.559801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fdb3ee42-b918-470c-a865-58c73bce0dab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:16.559976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1ac4178a-2585-47d5-87d5-5d76525d6618 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:16.560485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1ac4178a-2585-47d5-87d5-5d76525d6618 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:16.566912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ac4178a-2585-47d5-87d5-5d76525d6618 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:16.567408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ac4178a-2585-47d5-87d5-5d76525d6618 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:16.567848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ac4178a-2585-47d5-87d5-5d76525d6618 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:16.568364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fdb3ee42-b918-470c-a865-58c73bce0dab tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083325 Sep 02 10:03:16.568545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ac4178a-2585-47d5-87d5-5d76525d6618 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:16.568933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1008/1938] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:16.569063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ac4178a-2585-47d5-87d5-5d76525d6618 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:16.569417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1ac4178a-2585-47d5-87d5-5d76525d6618 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:16.629517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1ac4178a-2585-47d5-87d5-5d76525d6618 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:16.637629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1ac4178a-2585-47d5-87d5-5d76525d6618 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 200 len: 1366 microversion: 2.1 time: 0.081719 Sep 02 10:03:16.638193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 931/1939] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:16 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 1366 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:16.658038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3aa19474-5766-4a16-9086-ac304b97a68f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '.version_select at 0x7f4e5c44e5e0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:16.735837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3aa19474-5766-4a16-9086-ac304b97a68f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637250" status: 202 len: 0 microversion: 2.1 time: 0.081522 Sep 02 10:03:16.736399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1009/1940] 10.222.0.57 () {58 vars in 1212 bytes} [Fri Sep 2 10:03:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637250 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:03:17.589121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-adb535b8-fc85-45d3-9cdd-0548b7245191 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:17.590399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-adb535b8-fc85-45d3-9cdd-0548b7245191 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:17.596860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adb535b8-fc85-45d3-9cdd-0548b7245191 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:17.597336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adb535b8-fc85-45d3-9cdd-0548b7245191 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:17.597765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adb535b8-fc85-45d3-9cdd-0548b7245191 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:17.598440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adb535b8-fc85-45d3-9cdd-0548b7245191 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:17.598913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adb535b8-fc85-45d3-9cdd-0548b7245191 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:17.599333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-adb535b8-fc85-45d3-9cdd-0548b7245191 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:17.640576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3aabf771-a1f3-4b48-9012-0e7aaa73dcf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Action: 'create', calling method: .version_select at 0x7f4e5c64d9d0>, body: {"keypair": {"name": "tempest-keypair-1069925461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLya+OH/WV8j55+Ed0EIw0R1aDaVofZTSTN1C/+eDnMUAZb+LyQeGZGrnLfqG/STVJMEZwng6V76xtfL27HX0U9K5HXiY5Ngr/gzQk5U/ffLHZnLqeEhKzzs+FSGznRV3w=="}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:03:17.647296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:17.663038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-3aabf771-a1f3-4b48-9012-0e7aaa73dcf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Getting quotas for project ea33fe1eaf1047f78312a8e9fa9152c4. Resources: {'key_pairs'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:03:17.667151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-3aabf771-a1f3-4b48-9012-0e7aaa73dcf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Getting quotas for user f65429de28ae41578c51a6b9099fea5c and project ea33fe1eaf1047f78312a8e9fa9152c4. Resources: {'key_pairs'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:03:17.668413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-adb535b8-fc85-45d3-9cdd-0548b7245191 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:17.677294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-adb535b8-fc85-45d3-9cdd-0548b7245191 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.092047 Sep 02 10:03:17.677857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 932/1941] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:17.759269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3aabf771-a1f3-4b48-9012-0e7aaa73dcf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123022 Sep 02 10:03:17.759849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1010/1942] 10.222.0.57 () {60 vars in 1159 bytes} [Fri Sep 2 10:03:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:03:18.698023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-32f5d1b0-11dd-4117-b62d-721ded8ea843 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:18.698629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-32f5d1b0-11dd-4117-b62d-721ded8ea843 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:18.705025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f5d1b0-11dd-4117-b62d-721ded8ea843 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:18.708831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f5d1b0-11dd-4117-b62d-721ded8ea843 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:18.708831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f5d1b0-11dd-4117-b62d-721ded8ea843 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:18.708831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f5d1b0-11dd-4117-b62d-721ded8ea843 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:18.708831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f5d1b0-11dd-4117-b62d-721ded8ea843 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:18.709327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-32f5d1b0-11dd-4117-b62d-721ded8ea843 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:18.767624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-32f5d1b0-11dd-4117-b62d-721ded8ea843 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:18.776901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-32f5d1b0-11dd-4117-b62d-721ded8ea843 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082734 Sep 02 10:03:18.777599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 933/1943] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:19.798311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d120db80-f124-4bf1-ae06-02ee619cc27c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:19.798951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d120db80-f124-4bf1-ae06-02ee619cc27c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:19.806063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d120db80-f124-4bf1-ae06-02ee619cc27c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:19.806542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d120db80-f124-4bf1-ae06-02ee619cc27c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:19.807053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d120db80-f124-4bf1-ae06-02ee619cc27c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:19.807740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d120db80-f124-4bf1-ae06-02ee619cc27c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:19.808192 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d120db80-f124-4bf1-ae06-02ee619cc27c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:19.808763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d120db80-f124-4bf1-ae06-02ee619cc27c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:19.874898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d120db80-f124-4bf1-ae06-02ee619cc27c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:19.881867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d120db80-f124-4bf1-ae06-02ee619cc27c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.088265 Sep 02 10:03:19.882374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1011/1944] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:19.926859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1128224639", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03a44734-2ee4-42c1-bac2-2865fbb1a5aa"}], "security_groups": [{"name": "tempest-securitygroup--44039452"}], "key_name": "tempest-keypair-1069925461", "user_data": "}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:03:20.029705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] validate_networks() for [('03a44734-2ee4-42c1-bac2-2865fbb1a5aa', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 10:03:20.437957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 10:03:20.438413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 10:03:20.438939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 10:03:20.439345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 10:03:20.439753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 10:03:20.448920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:20.449396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:20.449851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:20.450578 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:20.451049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:20.451472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:20.468340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Getting quotas for project ea33fe1eaf1047f78312a8e9fa9152c4. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:03:20.472277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Getting quotas for user f65429de28ae41578c51a6b9099fea5c and project ea33fe1eaf1047f78312a8e9fa9152c4. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:03:20.483088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 10:03:20.485320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 10:03:20.612099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a37843ad-92b6-48cf-93b9-b23fe471a722 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.689508 Sep 02 10:03:20.612735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 934/1945] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 10:03:19 2022] POST /compute/v2.1/servers => generated 400 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 10:03:20.623984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-324b3bf1-d463-47a9-b7d0-fd066498899d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:20.624632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-324b3bf1-d463-47a9-b7d0-fd066498899d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:20.678763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-324b3bf1-d463-47a9-b7d0-fd066498899d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:20.685698 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-324b3bf1-d463-47a9-b7d0-fd066498899d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1238 microversion: 2.1 time: 0.065697 Sep 02 10:03:20.686216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1012/1946] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:20 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:20.903087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb95e8db-7f08-4aa0-8037-a833b5fb5915 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:20.903694 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb95e8db-7f08-4aa0-8037-a833b5fb5915 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:20.910413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb95e8db-7f08-4aa0-8037-a833b5fb5915 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:20.910933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb95e8db-7f08-4aa0-8037-a833b5fb5915 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:20.911365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb95e8db-7f08-4aa0-8037-a833b5fb5915 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:20.912338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb95e8db-7f08-4aa0-8037-a833b5fb5915 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:20.912793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb95e8db-7f08-4aa0-8037-a833b5fb5915 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:20.913213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb95e8db-7f08-4aa0-8037-a833b5fb5915 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:20.976571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb95e8db-7f08-4aa0-8037-a833b5fb5915 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:20.984750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb95e8db-7f08-4aa0-8037-a833b5fb5915 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085633 Sep 02 10:03:20.985318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 935/1947] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:21.708207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-23203efd-7f25-42e0-b928-730cf729462e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:21.708846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-23203efd-7f25-42e0-b928-730cf729462e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:21.715322 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23203efd-7f25-42e0-b928-730cf729462e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:21.715814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23203efd-7f25-42e0-b928-730cf729462e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:21.716254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23203efd-7f25-42e0-b928-730cf729462e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:21.717015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23203efd-7f25-42e0-b928-730cf729462e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:21.717476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23203efd-7f25-42e0-b928-730cf729462e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:21.717910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-23203efd-7f25-42e0-b928-730cf729462e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:21.779198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-23203efd-7f25-42e0-b928-730cf729462e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:21.786794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-23203efd-7f25-42e0-b928-730cf729462e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1242 microversion: 2.1 time: 0.083224 Sep 02 10:03:21.787362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1013/1948] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:21 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:22.005723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0c6cabce-3765-4331-9f5c-b681dac1566f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:22.006475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0c6cabce-3765-4331-9f5c-b681dac1566f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:22.013077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c6cabce-3765-4331-9f5c-b681dac1566f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:22.013568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c6cabce-3765-4331-9f5c-b681dac1566f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:22.014009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c6cabce-3765-4331-9f5c-b681dac1566f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:22.014725 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c6cabce-3765-4331-9f5c-b681dac1566f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:22.015225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c6cabce-3765-4331-9f5c-b681dac1566f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:22.015641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0c6cabce-3765-4331-9f5c-b681dac1566f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:22.080293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0c6cabce-3765-4331-9f5c-b681dac1566f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:22.089050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0c6cabce-3765-4331-9f5c-b681dac1566f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087292 Sep 02 10:03:22.089906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 936/1949] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:22.807609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1b6ccc0d-fdd7-4aad-ae4f-51ae82b4a613 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:22.808226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1b6ccc0d-fdd7-4aad-ae4f-51ae82b4a613 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:22.815628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b6ccc0d-fdd7-4aad-ae4f-51ae82b4a613 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:22.816715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b6ccc0d-fdd7-4aad-ae4f-51ae82b4a613 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:22.817481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b6ccc0d-fdd7-4aad-ae4f-51ae82b4a613 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:22.817937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b6ccc0d-fdd7-4aad-ae4f-51ae82b4a613 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:22.818384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b6ccc0d-fdd7-4aad-ae4f-51ae82b4a613 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:22.818836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b6ccc0d-fdd7-4aad-ae4f-51ae82b4a613 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:22.895256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1b6ccc0d-fdd7-4aad-ae4f-51ae82b4a613 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:22.903071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1b6ccc0d-fdd7-4aad-ae4f-51ae82b4a613 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1298 microversion: 2.1 time: 0.099381 Sep 02 10:03:22.903649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1014/1950] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:22 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:23.117490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-415c13d9-2c5e-4284-92a7-138486f2e7d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:23.117490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-415c13d9-2c5e-4284-92a7-138486f2e7d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:23.117490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:23.118516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-415c13d9-2c5e-4284-92a7-138486f2e7d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:23.119052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-415c13d9-2c5e-4284-92a7-138486f2e7d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:23.119485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-415c13d9-2c5e-4284-92a7-138486f2e7d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:23.120183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-415c13d9-2c5e-4284-92a7-138486f2e7d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:23.120637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-415c13d9-2c5e-4284-92a7-138486f2e7d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:23.121269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-415c13d9-2c5e-4284-92a7-138486f2e7d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:23.186103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-415c13d9-2c5e-4284-92a7-138486f2e7d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:23.195075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-415c13d9-2c5e-4284-92a7-138486f2e7d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.088374 Sep 02 10:03:23.195651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 937/1951] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:23.929606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0abd2475-e3e3-4ca1-a5f5-e3d87bba7589 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:23.930205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0abd2475-e3e3-4ca1-a5f5-e3d87bba7589 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:23.936633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0abd2475-e3e3-4ca1-a5f5-e3d87bba7589 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:23.937213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0abd2475-e3e3-4ca1-a5f5-e3d87bba7589 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:23.937747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0abd2475-e3e3-4ca1-a5f5-e3d87bba7589 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:23.938515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0abd2475-e3e3-4ca1-a5f5-e3d87bba7589 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:23.938998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0abd2475-e3e3-4ca1-a5f5-e3d87bba7589 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:23.939424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0abd2475-e3e3-4ca1-a5f5-e3d87bba7589 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:24.121464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0abd2475-e3e3-4ca1-a5f5-e3d87bba7589 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:24.129985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0abd2475-e3e3-4ca1-a5f5-e3d87bba7589 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1362 microversion: 2.1 time: 0.204430 Sep 02 10:03:24.130546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1015/1952] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:23 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:24.215925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-03bfbabc-fcd6-4f1b-844d-c015cf81e878 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:24.216466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-03bfbabc-fcd6-4f1b-844d-c015cf81e878 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:24.223424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03bfbabc-fcd6-4f1b-844d-c015cf81e878 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:24.223900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03bfbabc-fcd6-4f1b-844d-c015cf81e878 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:24.224336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03bfbabc-fcd6-4f1b-844d-c015cf81e878 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:24.225024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03bfbabc-fcd6-4f1b-844d-c015cf81e878 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:24.225473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03bfbabc-fcd6-4f1b-844d-c015cf81e878 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:24.225896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-03bfbabc-fcd6-4f1b-844d-c015cf81e878 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:24.288905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-03bfbabc-fcd6-4f1b-844d-c015cf81e878 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:24.297207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-03bfbabc-fcd6-4f1b-844d-c015cf81e878 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085298 Sep 02 10:03:24.297775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 938/1953] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:24.480579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-52f145d3-a4f7-45c7-b453-8d6b1fda468c req-8b00d5bc-ce00-4701-8b84-bea03bece95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc0b1ef-0647-403b-82ca-28334d3627fa", "tag": "721d248f-b99f-4e94-be59-bd5e36eb217e"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:03:24.490754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-52f145d3-a4f7-45c7-b453-8d6b1fda468c req-8b00d5bc-ce00-4701-8b84-bea03bece95e service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:24.491232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-52f145d3-a4f7-45c7-b453-8d6b1fda468c req-8b00d5bc-ce00-4701-8b84-bea03bece95e service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:24.491682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-52f145d3-a4f7-45c7-b453-8d6b1fda468c req-8b00d5bc-ce00-4701-8b84-bea03bece95e service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:24.494204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:24.504541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-52f145d3-a4f7-45c7-b453-8d6b1fda468c req-8b00d5bc-ce00-4701-8b84-bea03bece95e service nova] Creating event network-changed:721d248f-b99f-4e94-be59-bd5e36eb217e for instance cdc0b1ef-0647-403b-82ca-28334d3627fa on hv-cinder-85083 Sep 02 10:03:24.509618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-52f145d3-a4f7-45c7-b453-8d6b1fda468c req-8b00d5bc-ce00-4701-8b84-bea03bece95e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087510 Sep 02 10:03:24.510329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1016/1954] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:03:25.151112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6030176f-a930-44e0-b31e-754e4d00ade2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:25.151721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6030176f-a930-44e0-b31e-754e4d00ade2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:25.157709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6030176f-a930-44e0-b31e-754e4d00ade2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:25.158190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6030176f-a930-44e0-b31e-754e4d00ade2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:25.158623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6030176f-a930-44e0-b31e-754e4d00ade2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:25.159478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6030176f-a930-44e0-b31e-754e4d00ade2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:25.160582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6030176f-a930-44e0-b31e-754e4d00ade2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:25.161003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6030176f-a930-44e0-b31e-754e4d00ade2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:25.283671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6030176f-a930-44e0-b31e-754e4d00ade2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:25.291871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6030176f-a930-44e0-b31e-754e4d00ade2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1362 microversion: 2.1 time: 0.144565 Sep 02 10:03:25.292435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 939/1955] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:25 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:25.318491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-04f94aad-c2f4-4518-a59f-1c41144ad4d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:25.319259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-04f94aad-c2f4-4518-a59f-1c41144ad4d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:25.325762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04f94aad-c2f4-4518-a59f-1c41144ad4d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:25.326250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04f94aad-c2f4-4518-a59f-1c41144ad4d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:25.326696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04f94aad-c2f4-4518-a59f-1c41144ad4d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:25.327409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04f94aad-c2f4-4518-a59f-1c41144ad4d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:25.327867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04f94aad-c2f4-4518-a59f-1c41144ad4d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:25.328296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-04f94aad-c2f4-4518-a59f-1c41144ad4d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:25.390759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-04f94aad-c2f4-4518-a59f-1c41144ad4d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:25.399441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-04f94aad-c2f4-4518-a59f-1c41144ad4d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085621 Sep 02 10:03:25.400007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1017/1956] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:25 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:26.312405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3757c495-a655-405a-a490-befcb311cf17 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:26.312962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3757c495-a655-405a-a490-befcb311cf17 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:26.319970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3757c495-a655-405a-a490-befcb311cf17 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:26.320446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3757c495-a655-405a-a490-befcb311cf17 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:26.320876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3757c495-a655-405a-a490-befcb311cf17 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:26.321549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3757c495-a655-405a-a490-befcb311cf17 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:26.322003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3757c495-a655-405a-a490-befcb311cf17 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:26.322421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3757c495-a655-405a-a490-befcb311cf17 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:26.420658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1d8df432-742a-4696-867b-6ab0c118b242 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:26.421271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1d8df432-742a-4696-867b-6ab0c118b242 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:26.427792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d8df432-742a-4696-867b-6ab0c118b242 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:26.428279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d8df432-742a-4696-867b-6ab0c118b242 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:26.428718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d8df432-742a-4696-867b-6ab0c118b242 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:26.429411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d8df432-742a-4696-867b-6ab0c118b242 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:26.429870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d8df432-742a-4696-867b-6ab0c118b242 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:26.430297 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d8df432-742a-4696-867b-6ab0c118b242 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:26.461004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3757c495-a655-405a-a490-befcb311cf17 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:26.468699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3757c495-a655-405a-a490-befcb311cf17 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1362 microversion: 2.1 time: 0.160228 Sep 02 10:03:26.469267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 940/1957] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:26 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:26.491781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1d8df432-742a-4696-867b-6ab0c118b242 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:26.500266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1d8df432-742a-4696-867b-6ab0c118b242 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083155 Sep 02 10:03:26.500824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1018/1958] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:26 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:27.489390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c52787ef-dbd2-413b-875a-ff6483a6faf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:27.490091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c52787ef-dbd2-413b-875a-ff6483a6faf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:27.496672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c52787ef-dbd2-413b-875a-ff6483a6faf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:27.497229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c52787ef-dbd2-413b-875a-ff6483a6faf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:27.497580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c52787ef-dbd2-413b-875a-ff6483a6faf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:27.498345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c52787ef-dbd2-413b-875a-ff6483a6faf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:27.498774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c52787ef-dbd2-413b-875a-ff6483a6faf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:27.499193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c52787ef-dbd2-413b-875a-ff6483a6faf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:27.515177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:27.523694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-62b2564b-02fb-45de-ab89-795564150eda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:27.525238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-62b2564b-02fb-45de-ab89-795564150eda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:27.532776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62b2564b-02fb-45de-ab89-795564150eda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:27.533459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62b2564b-02fb-45de-ab89-795564150eda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:27.533971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62b2564b-02fb-45de-ab89-795564150eda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:27.535535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62b2564b-02fb-45de-ab89-795564150eda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:27.536117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62b2564b-02fb-45de-ab89-795564150eda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:27.536738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62b2564b-02fb-45de-ab89-795564150eda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:27.610571 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-62b2564b-02fb-45de-ab89-795564150eda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:27.618954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-62b2564b-02fb-45de-ab89-795564150eda tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.100059 Sep 02 10:03:27.619576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1019/1959] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:27.645659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c52787ef-dbd2-413b-875a-ff6483a6faf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:27.652183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c52787ef-dbd2-413b-875a-ff6483a6faf6 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1362 microversion: 2.1 time: 0.166891 Sep 02 10:03:27.652748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 941/1960] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:27 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:28.639543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-31c85a5e-dd45-472c-a182-626124a9b7f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:28.640233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-31c85a5e-dd45-472c-a182-626124a9b7f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:28.646525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31c85a5e-dd45-472c-a182-626124a9b7f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:28.647041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31c85a5e-dd45-472c-a182-626124a9b7f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:28.647483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31c85a5e-dd45-472c-a182-626124a9b7f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:28.648198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31c85a5e-dd45-472c-a182-626124a9b7f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:28.648652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31c85a5e-dd45-472c-a182-626124a9b7f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:28.649075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-31c85a5e-dd45-472c-a182-626124a9b7f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:28.673357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fd27c850-4c69-4a28-87dd-8d5bd777cc5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:28.673963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fd27c850-4c69-4a28-87dd-8d5bd777cc5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:28.680758 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fd27c850-4c69-4a28-87dd-8d5bd777cc5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:28.681244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fd27c850-4c69-4a28-87dd-8d5bd777cc5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:28.681686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fd27c850-4c69-4a28-87dd-8d5bd777cc5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:28.682373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fd27c850-4c69-4a28-87dd-8d5bd777cc5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:28.682851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fd27c850-4c69-4a28-87dd-8d5bd777cc5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:28.683275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fd27c850-4c69-4a28-87dd-8d5bd777cc5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:28.710367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-31c85a5e-dd45-472c-a182-626124a9b7f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:28.718936 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-31c85a5e-dd45-472c-a182-626124a9b7f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083209 Sep 02 10:03:28.719508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1020/1961] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:28.812352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fd27c850-4c69-4a28-87dd-8d5bd777cc5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:28.820071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fd27c850-4c69-4a28-87dd-8d5bd777cc5a tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1362 microversion: 2.1 time: 0.150598 Sep 02 10:03:28.820644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 942/1962] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:28 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:29.740796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a3e6666c-b244-41a4-a72b-1f50f18939ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:29.741414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a3e6666c-b244-41a4-a72b-1f50f18939ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:29.747827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3e6666c-b244-41a4-a72b-1f50f18939ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:29.748319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3e6666c-b244-41a4-a72b-1f50f18939ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:29.748757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3e6666c-b244-41a4-a72b-1f50f18939ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:29.749443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3e6666c-b244-41a4-a72b-1f50f18939ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:29.750420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3e6666c-b244-41a4-a72b-1f50f18939ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:29.750875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a3e6666c-b244-41a4-a72b-1f50f18939ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:29.810731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a3e6666c-b244-41a4-a72b-1f50f18939ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:29.819849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a3e6666c-b244-41a4-a72b-1f50f18939ef tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083437 Sep 02 10:03:29.820420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1021/1963] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:29.840854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-652a7b67-7ea1-4650-ba17-abb0196ccac7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:29.841462 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-652a7b67-7ea1-4650-ba17-abb0196ccac7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:29.848018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-652a7b67-7ea1-4650-ba17-abb0196ccac7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:29.848498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-652a7b67-7ea1-4650-ba17-abb0196ccac7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:29.848929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-652a7b67-7ea1-4650-ba17-abb0196ccac7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:29.849615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-652a7b67-7ea1-4650-ba17-abb0196ccac7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:29.850068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-652a7b67-7ea1-4650-ba17-abb0196ccac7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:29.850488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-652a7b67-7ea1-4650-ba17-abb0196ccac7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:29.975829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-652a7b67-7ea1-4650-ba17-abb0196ccac7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:29.983412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-652a7b67-7ea1-4650-ba17-abb0196ccac7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1362 microversion: 2.1 time: 0.146404 Sep 02 10:03:29.983968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 943/1964] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:29 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:30.840654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d7258f44-ab5a-4f75-9215-f8033ac0879e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:30.841303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d7258f44-ab5a-4f75-9215-f8033ac0879e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:30.843310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=6 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:30.848780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7258f44-ab5a-4f75-9215-f8033ac0879e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:30.849285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7258f44-ab5a-4f75-9215-f8033ac0879e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:30.849724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7258f44-ab5a-4f75-9215-f8033ac0879e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:30.850464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7258f44-ab5a-4f75-9215-f8033ac0879e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:30.850952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7258f44-ab5a-4f75-9215-f8033ac0879e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:30.851383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7258f44-ab5a-4f75-9215-f8033ac0879e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:30.914255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d7258f44-ab5a-4f75-9215-f8033ac0879e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:30.922358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d7258f44-ab5a-4f75-9215-f8033ac0879e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085637 Sep 02 10:03:30.922975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1022/1965] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:31.005557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-26ab1419-26ee-436e-bc30-ffe923d00126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:31.006087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-26ab1419-26ee-436e-bc30-ffe923d00126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:31.008001 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:31.008673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:31.013949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ab1419-26ee-436e-bc30-ffe923d00126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:31.014431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ab1419-26ee-436e-bc30-ffe923d00126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:31.014893 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ab1419-26ee-436e-bc30-ffe923d00126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:31.015569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ab1419-26ee-436e-bc30-ffe923d00126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:31.016060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ab1419-26ee-436e-bc30-ffe923d00126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:31.016476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26ab1419-26ee-436e-bc30-ffe923d00126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:31.146821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-26ab1419-26ee-436e-bc30-ffe923d00126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:31.154371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-26ab1419-26ee-436e-bc30-ffe923d00126 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1362 microversion: 2.1 time: 0.153237 Sep 02 10:03:31.154962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 944/1966] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:31 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:31.588170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-439e1b07-4d80-408c-9b8b-971619ffa921 req-2a5bf141-ce90-4c39-babf-dbbae712cd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc0b1ef-0647-403b-82ca-28334d3627fa", "name": "network-vif-plugged", "status": "completed", "tag": "721d248f-b99f-4e94-be59-bd5e36eb217e"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:03:31.597942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-439e1b07-4d80-408c-9b8b-971619ffa921 req-2a5bf141-ce90-4c39-babf-dbbae712cd67 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:31.598417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-439e1b07-4d80-408c-9b8b-971619ffa921 req-2a5bf141-ce90-4c39-babf-dbbae712cd67 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:31.598868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-439e1b07-4d80-408c-9b8b-971619ffa921 req-2a5bf141-ce90-4c39-babf-dbbae712cd67 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:31.610200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-439e1b07-4d80-408c-9b8b-971619ffa921 req-2a5bf141-ce90-4c39-babf-dbbae712cd67 service nova] Creating event network-vif-plugged:721d248f-b99f-4e94-be59-bd5e36eb217e for instance cdc0b1ef-0647-403b-82ca-28334d3627fa on hv-cinder-85083 Sep 02 10:03:31.616646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-439e1b07-4d80-408c-9b8b-971619ffa921 req-2a5bf141-ce90-4c39-babf-dbbae712cd67 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085851 Sep 02 10:03:31.617491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1023/1967] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:03:31.942964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dc8114f2-fdb8-489f-9e52-a0738339490e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:31.943579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dc8114f2-fdb8-489f-9e52-a0738339490e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:31.949506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc8114f2-fdb8-489f-9e52-a0738339490e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:31.949989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc8114f2-fdb8-489f-9e52-a0738339490e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:31.950424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc8114f2-fdb8-489f-9e52-a0738339490e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:31.951136 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc8114f2-fdb8-489f-9e52-a0738339490e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:31.951591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc8114f2-fdb8-489f-9e52-a0738339490e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:31.952019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc8114f2-fdb8-489f-9e52-a0738339490e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:32.014306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dc8114f2-fdb8-489f-9e52-a0738339490e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:32.022988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dc8114f2-fdb8-489f-9e52-a0738339490e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084059 Sep 02 10:03:32.023568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 945/1968] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:32.176362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f2721f76-4724-4297-b144-930982b6b71f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:32.177002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f2721f76-4724-4297-b144-930982b6b71f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:32.183157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2721f76-4724-4297-b144-930982b6b71f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:32.183668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2721f76-4724-4297-b144-930982b6b71f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:32.184111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2721f76-4724-4297-b144-930982b6b71f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:32.184800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2721f76-4724-4297-b144-930982b6b71f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:32.185261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2721f76-4724-4297-b144-930982b6b71f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:32.185689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f2721f76-4724-4297-b144-930982b6b71f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:32.311685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f2721f76-4724-4297-b144-930982b6b71f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:32.319967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f2721f76-4724-4297-b144-930982b6b71f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1362 microversion: 2.1 time: 0.148620 Sep 02 10:03:32.320542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1024/1969] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:32 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:33.044427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7e192051-80ce-413a-b4cb-6eaa15f31238 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:33.045030 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7e192051-80ce-413a-b4cb-6eaa15f31238 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:33.051492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e192051-80ce-413a-b4cb-6eaa15f31238 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:33.051970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e192051-80ce-413a-b4cb-6eaa15f31238 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:33.052403 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e192051-80ce-413a-b4cb-6eaa15f31238 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:33.053079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e192051-80ce-413a-b4cb-6eaa15f31238 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:33.053527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e192051-80ce-413a-b4cb-6eaa15f31238 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:33.053943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7e192051-80ce-413a-b4cb-6eaa15f31238 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:33.114032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7e192051-80ce-413a-b4cb-6eaa15f31238 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:33.122163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7e192051-80ce-413a-b4cb-6eaa15f31238 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081636 Sep 02 10:03:33.122748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 946/1970] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:33.340894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1902067e-a0df-479a-80e2-f5ccc57dae51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:33.341507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1902067e-a0df-479a-80e2-f5ccc57dae51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:33.347995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1902067e-a0df-479a-80e2-f5ccc57dae51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:33.348479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1902067e-a0df-479a-80e2-f5ccc57dae51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:33.348943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1902067e-a0df-479a-80e2-f5ccc57dae51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:33.349632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1902067e-a0df-479a-80e2-f5ccc57dae51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:33.350083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1902067e-a0df-479a-80e2-f5ccc57dae51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:33.350509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1902067e-a0df-479a-80e2-f5ccc57dae51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:33.477305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1902067e-a0df-479a-80e2-f5ccc57dae51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:33.484804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1902067e-a0df-479a-80e2-f5ccc57dae51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1362 microversion: 2.1 time: 0.147750 Sep 02 10:03:33.485368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1025/1971] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:33 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:34.143566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bb1b01fa-44df-401f-bb1a-a824916a6d2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:34.144605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bb1b01fa-44df-401f-bb1a-a824916a6d2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:34.150983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb1b01fa-44df-401f-bb1a-a824916a6d2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:34.151465 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb1b01fa-44df-401f-bb1a-a824916a6d2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:34.151897 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb1b01fa-44df-401f-bb1a-a824916a6d2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:34.152580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb1b01fa-44df-401f-bb1a-a824916a6d2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:34.153028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb1b01fa-44df-401f-bb1a-a824916a6d2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:34.153452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bb1b01fa-44df-401f-bb1a-a824916a6d2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:34.214936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bb1b01fa-44df-401f-bb1a-a824916a6d2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:34.223721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bb1b01fa-44df-401f-bb1a-a824916a6d2a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084114 Sep 02 10:03:34.224309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 947/1972] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:34.506055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-728928d5-2353-40b7-8e59-b4850f262c45 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:34.506667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-728928d5-2353-40b7-8e59-b4850f262c45 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:34.513175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-728928d5-2353-40b7-8e59-b4850f262c45 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:34.513691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-728928d5-2353-40b7-8e59-b4850f262c45 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:34.514144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-728928d5-2353-40b7-8e59-b4850f262c45 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:34.514865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-728928d5-2353-40b7-8e59-b4850f262c45 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:34.515353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-728928d5-2353-40b7-8e59-b4850f262c45 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:34.515809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-728928d5-2353-40b7-8e59-b4850f262c45 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:34.873272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-728928d5-2353-40b7-8e59-b4850f262c45 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:34.881797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-728928d5-2353-40b7-8e59-b4850f262c45 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1548 microversion: 2.1 time: 0.380118 Sep 02 10:03:34.882360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1026/1973] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:34 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1548 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:34.901461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e217dbb5-1fa1-4c95-985b-6bb3b3a3e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:34.901956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e217dbb5-1fa1-4c95-985b-6bb3b3a3e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:34.907887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e217dbb5-1fa1-4c95-985b-6bb3b3a3e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:34.908373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e217dbb5-1fa1-4c95-985b-6bb3b3a3e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:34.908807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e217dbb5-1fa1-4c95-985b-6bb3b3a3e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:34.909491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e217dbb5-1fa1-4c95-985b-6bb3b3a3e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:34.909941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e217dbb5-1fa1-4c95-985b-6bb3b3a3e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:34.910363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e217dbb5-1fa1-4c95-985b-6bb3b3a3e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:34.987490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e217dbb5-1fa1-4c95-985b-6bb3b3a3e169 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089804 Sep 02 10:03:34.988579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 948/1974] 10.222.0.57 () {58 vars in 1275 bytes} [Fri Sep 2 10:03:34 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:03:35.244802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-81e6e0a5-d65f-485b-9444-80f567b80710 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:35.245429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-81e6e0a5-d65f-485b-9444-80f567b80710 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:35.252113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81e6e0a5-d65f-485b-9444-80f567b80710 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:35.252595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81e6e0a5-d65f-485b-9444-80f567b80710 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:35.253040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81e6e0a5-d65f-485b-9444-80f567b80710 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:35.254261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81e6e0a5-d65f-485b-9444-80f567b80710 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:35.254734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81e6e0a5-d65f-485b-9444-80f567b80710 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:35.255170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-81e6e0a5-d65f-485b-9444-80f567b80710 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:35.318842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-81e6e0a5-d65f-485b-9444-80f567b80710 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:35.327480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-81e6e0a5-d65f-485b-9444-80f567b80710 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086496 Sep 02 10:03:35.328078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1027/1975] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:36.220946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-7a19014d-bff2-4c87-9b78-43acc33f05c7 req-0b2d22cf-1865-4232-9090-cbd0f4d15ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc0b1ef-0647-403b-82ca-28334d3627fa", "tag": "721d248f-b99f-4e94-be59-bd5e36eb217e"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:03:36.230678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7a19014d-bff2-4c87-9b78-43acc33f05c7 req-0b2d22cf-1865-4232-9090-cbd0f4d15ce2 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:36.231187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7a19014d-bff2-4c87-9b78-43acc33f05c7 req-0b2d22cf-1865-4232-9090-cbd0f4d15ce2 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:36.231611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-7a19014d-bff2-4c87-9b78-43acc33f05c7 req-0b2d22cf-1865-4232-9090-cbd0f4d15ce2 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:36.243575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-7a19014d-bff2-4c87-9b78-43acc33f05c7 req-0b2d22cf-1865-4232-9090-cbd0f4d15ce2 service nova] Creating event network-changed:721d248f-b99f-4e94-be59-bd5e36eb217e for instance cdc0b1ef-0647-403b-82ca-28334d3627fa on hv-cinder-85083 Sep 02 10:03:36.247212 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR oslo.messaging._drivers.impl_rabbit [req-7a19014d-bff2-4c87-9b78-43acc33f05c7 req-0b2d22cf-1865-4232-9090-cbd0f4d15ce2 service nova] [cbd594e0-924f-4e7a-936b-b12f86fd11e1] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 10:03:36.349077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fbcb057d-776f-4800-ae5b-4dc5108fa5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:36.349694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fbcb057d-776f-4800-ae5b-4dc5108fa5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:36.356082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbcb057d-776f-4800-ae5b-4dc5108fa5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:36.356570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbcb057d-776f-4800-ae5b-4dc5108fa5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:36.357015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbcb057d-776f-4800-ae5b-4dc5108fa5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:36.357708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbcb057d-776f-4800-ae5b-4dc5108fa5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:36.358166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbcb057d-776f-4800-ae5b-4dc5108fa5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:36.358605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fbcb057d-776f-4800-ae5b-4dc5108fa5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:36.419514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fbcb057d-776f-4800-ae5b-4dc5108fa5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:36.428313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fbcb057d-776f-4800-ae5b-4dc5108fa5dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083165 Sep 02 10:03:36.428883 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1028/1976] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:03:37.256087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [req-7a19014d-bff2-4c87-9b78-43acc33f05c7 req-0b2d22cf-1865-4232-9090-cbd0f4d15ce2 service nova] [cbd594e0-924f-4e7a-936b-b12f86fd11e1] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 56818. Sep 02 10:03:37.261333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-7a19014d-bff2-4c87-9b78-43acc33f05c7 req-0b2d22cf-1865-4232-9090-cbd0f4d15ce2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.098483 Sep 02 10:03:37.261948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 949/1977] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:03:37.449253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d460d47b-f959-4274-a86b-c35a89251612 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:37.449862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d460d47b-f959-4274-a86b-c35a89251612 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:37.456557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d460d47b-f959-4274-a86b-c35a89251612 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:37.457054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d460d47b-f959-4274-a86b-c35a89251612 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:37.458105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d460d47b-f959-4274-a86b-c35a89251612 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:37.458842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d460d47b-f959-4274-a86b-c35a89251612 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:37.459305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d460d47b-f959-4274-a86b-c35a89251612 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:37.459754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d460d47b-f959-4274-a86b-c35a89251612 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:37.530718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d460d47b-f959-4274-a86b-c35a89251612 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:37.538984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d460d47b-f959-4274-a86b-c35a89251612 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.093489 Sep 02 10:03:37.539564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1029/1978] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:38.561405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-84667828-9dbd-4da2-a122-3bee00b4ccb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:38.562109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-84667828-9dbd-4da2-a122-3bee00b4ccb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:38.568598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84667828-9dbd-4da2-a122-3bee00b4ccb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:38.569080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84667828-9dbd-4da2-a122-3bee00b4ccb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:38.569515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84667828-9dbd-4da2-a122-3bee00b4ccb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:38.570199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84667828-9dbd-4da2-a122-3bee00b4ccb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:38.570647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84667828-9dbd-4da2-a122-3bee00b4ccb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:38.571093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-84667828-9dbd-4da2-a122-3bee00b4ccb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:38.636747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-84667828-9dbd-4da2-a122-3bee00b4ccb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:38.645918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-84667828-9dbd-4da2-a122-3bee00b4ccb6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.089987 Sep 02 10:03:38.646478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 950/1979] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:39.666969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-09a22a07-c92e-4105-b5c1-215653c52b58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:39.667606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-09a22a07-c92e-4105-b5c1-215653c52b58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:39.673973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09a22a07-c92e-4105-b5c1-215653c52b58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:39.674447 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09a22a07-c92e-4105-b5c1-215653c52b58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:39.674967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09a22a07-c92e-4105-b5c1-215653c52b58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:39.675644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09a22a07-c92e-4105-b5c1-215653c52b58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:39.676092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09a22a07-c92e-4105-b5c1-215653c52b58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:39.676510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-09a22a07-c92e-4105-b5c1-215653c52b58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:39.736496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-09a22a07-c92e-4105-b5c1-215653c52b58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:39.744664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-09a22a07-c92e-4105-b5c1-215653c52b58 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081594 Sep 02 10:03:39.745220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1030/1980] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:40.765860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8fcbf878-c71c-403f-8b03-797d4828e1c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:40.766471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8fcbf878-c71c-403f-8b03-797d4828e1c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:40.773504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fcbf878-c71c-403f-8b03-797d4828e1c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:40.773988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fcbf878-c71c-403f-8b03-797d4828e1c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:40.774427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fcbf878-c71c-403f-8b03-797d4828e1c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:40.775138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fcbf878-c71c-403f-8b03-797d4828e1c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:40.775598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fcbf878-c71c-403f-8b03-797d4828e1c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:40.776024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fcbf878-c71c-403f-8b03-797d4828e1c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:40.836218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8fcbf878-c71c-403f-8b03-797d4828e1c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:40.844564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8fcbf878-c71c-403f-8b03-797d4828e1c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082655 Sep 02 10:03:40.845124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 951/1981] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:41.865858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-60dd3bdd-5146-4dc9-a79c-219f190b733e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:41.866498 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-60dd3bdd-5146-4dc9-a79c-219f190b733e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:41.873112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60dd3bdd-5146-4dc9-a79c-219f190b733e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:41.873593 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60dd3bdd-5146-4dc9-a79c-219f190b733e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:41.874034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60dd3bdd-5146-4dc9-a79c-219f190b733e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:41.875004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60dd3bdd-5146-4dc9-a79c-219f190b733e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:41.875459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60dd3bdd-5146-4dc9-a79c-219f190b733e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:41.875888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-60dd3bdd-5146-4dc9-a79c-219f190b733e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:41.937288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-60dd3bdd-5146-4dc9-a79c-219f190b733e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:41.945379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-60dd3bdd-5146-4dc9-a79c-219f190b733e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083874 Sep 02 10:03:41.945939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1031/1982] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:42.965422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-64a9c11a-4a8b-4609-a223-33c669675d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:42.966033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-64a9c11a-4a8b-4609-a223-33c669675d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:42.972685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64a9c11a-4a8b-4609-a223-33c669675d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:42.973168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64a9c11a-4a8b-4609-a223-33c669675d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:42.973606 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64a9c11a-4a8b-4609-a223-33c669675d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:42.974292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64a9c11a-4a8b-4609-a223-33c669675d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:42.974767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64a9c11a-4a8b-4609-a223-33c669675d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:42.975194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64a9c11a-4a8b-4609-a223-33c669675d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:43.035459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-64a9c11a-4a8b-4609-a223-33c669675d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:43.043523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-64a9c11a-4a8b-4609-a223-33c669675d41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082017 Sep 02 10:03:43.044081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 952/1983] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:44.064573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a8e422c8-d84e-4c89-8988-ae4892c200dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:44.065188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a8e422c8-d84e-4c89-8988-ae4892c200dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:44.071805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8e422c8-d84e-4c89-8988-ae4892c200dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:44.072285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8e422c8-d84e-4c89-8988-ae4892c200dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:44.072713 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8e422c8-d84e-4c89-8988-ae4892c200dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:44.073392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8e422c8-d84e-4c89-8988-ae4892c200dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:44.073840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8e422c8-d84e-4c89-8988-ae4892c200dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:44.074261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8e422c8-d84e-4c89-8988-ae4892c200dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:44.136047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a8e422c8-d84e-4c89-8988-ae4892c200dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:44.144045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a8e422c8-d84e-4c89-8988-ae4892c200dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083334 Sep 02 10:03:44.145266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1032/1984] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:45.210527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-394bd85b-e533-4757-9d10-e38451afecb0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:45.211191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-394bd85b-e533-4757-9d10-e38451afecb0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:45.217072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-394bd85b-e533-4757-9d10-e38451afecb0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:45.217556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-394bd85b-e533-4757-9d10-e38451afecb0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:45.217996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-394bd85b-e533-4757-9d10-e38451afecb0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:45.218680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-394bd85b-e533-4757-9d10-e38451afecb0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:45.219234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-394bd85b-e533-4757-9d10-e38451afecb0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:45.219659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-394bd85b-e533-4757-9d10-e38451afecb0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:45.279377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-394bd85b-e533-4757-9d10-e38451afecb0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:45.287447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-394bd85b-e533-4757-9d10-e38451afecb0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.126407 Sep 02 10:03:45.288009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 953/1985] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:46.307664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a9626ede-f6d8-4dc3-ae4e-03f36c3f5867 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:46.308296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a9626ede-f6d8-4dc3-ae4e-03f36c3f5867 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:46.314640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9626ede-f6d8-4dc3-ae4e-03f36c3f5867 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:46.315180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9626ede-f6d8-4dc3-ae4e-03f36c3f5867 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:46.315613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9626ede-f6d8-4dc3-ae4e-03f36c3f5867 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:46.316294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9626ede-f6d8-4dc3-ae4e-03f36c3f5867 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:46.316739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9626ede-f6d8-4dc3-ae4e-03f36c3f5867 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:46.317161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a9626ede-f6d8-4dc3-ae4e-03f36c3f5867 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:46.380713 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a9626ede-f6d8-4dc3-ae4e-03f36c3f5867 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:46.388700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a9626ede-f6d8-4dc3-ae4e-03f36c3f5867 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084841 Sep 02 10:03:46.389257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1033/1986] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:47.409174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7d4f8828-ded9-4e07-bc27-e59fc6a04a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:47.409783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7d4f8828-ded9-4e07-bc27-e59fc6a04a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:47.416665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4f8828-ded9-4e07-bc27-e59fc6a04a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:47.417144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4f8828-ded9-4e07-bc27-e59fc6a04a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:47.417577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4f8828-ded9-4e07-bc27-e59fc6a04a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:47.418263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4f8828-ded9-4e07-bc27-e59fc6a04a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:47.418776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4f8828-ded9-4e07-bc27-e59fc6a04a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:47.419158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4f8828-ded9-4e07-bc27-e59fc6a04a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:47.484528 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7d4f8828-ded9-4e07-bc27-e59fc6a04a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:47.493228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7d4f8828-ded9-4e07-bc27-e59fc6a04a87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087924 Sep 02 10:03:47.493786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 954/1987] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:48.513427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4d4860b7-a465-47f9-b7c8-45959a6fc4ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:48.514040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4d4860b7-a465-47f9-b7c8-45959a6fc4ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:48.520470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4860b7-a465-47f9-b7c8-45959a6fc4ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:48.520952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4860b7-a465-47f9-b7c8-45959a6fc4ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:48.521385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4860b7-a465-47f9-b7c8-45959a6fc4ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:48.522063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4860b7-a465-47f9-b7c8-45959a6fc4ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:48.522512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4860b7-a465-47f9-b7c8-45959a6fc4ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:48.522958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4860b7-a465-47f9-b7c8-45959a6fc4ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:48.526899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:48.582783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4d4860b7-a465-47f9-b7c8-45959a6fc4ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:48.591004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4d4860b7-a465-47f9-b7c8-45959a6fc4ad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081366 Sep 02 10:03:48.591561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1034/1988] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:49.612253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-750d290e-d3a3-4a64-8ebc-40e2ada0f070 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:49.612857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-750d290e-d3a3-4a64-8ebc-40e2ada0f070 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:49.614928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:03:49.615069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 (ip 10.222.0.57) !!! Sep 02 10:03:49.626960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750d290e-d3a3-4a64-8ebc-40e2ada0f070 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:49.627439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750d290e-d3a3-4a64-8ebc-40e2ada0f070 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:49.627867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750d290e-d3a3-4a64-8ebc-40e2ada0f070 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:49.628543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750d290e-d3a3-4a64-8ebc-40e2ada0f070 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:49.628991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750d290e-d3a3-4a64-8ebc-40e2ada0f070 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:49.629410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-750d290e-d3a3-4a64-8ebc-40e2ada0f070 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:49.689682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-750d290e-d3a3-4a64-8ebc-40e2ada0f070 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:49.698317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-750d290e-d3a3-4a64-8ebc-40e2ada0f070 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.089946 Sep 02 10:03:49.698908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 955/1989] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:50.719506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4c5f8b9f-1f76-4f75-b55d-dfe962775e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:50.720164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4c5f8b9f-1f76-4f75-b55d-dfe962775e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:50.722379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:50.727591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c5f8b9f-1f76-4f75-b55d-dfe962775e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:50.728077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c5f8b9f-1f76-4f75-b55d-dfe962775e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:50.728511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c5f8b9f-1f76-4f75-b55d-dfe962775e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:50.729193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c5f8b9f-1f76-4f75-b55d-dfe962775e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:50.729644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c5f8b9f-1f76-4f75-b55d-dfe962775e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:50.730062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4c5f8b9f-1f76-4f75-b55d-dfe962775e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:50.793988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4c5f8b9f-1f76-4f75-b55d-dfe962775e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:50.802598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4c5f8b9f-1f76-4f75-b55d-dfe962775e66 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086929 Sep 02 10:03:50.803190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1035/1990] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:51.823140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7c7b33f9-bc85-437c-ad98-41db3fe3bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:51.823738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7c7b33f9-bc85-437c-ad98-41db3fe3bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:51.830272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c7b33f9-bc85-437c-ad98-41db3fe3bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:51.835027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c7b33f9-bc85-437c-ad98-41db3fe3bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:51.835027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c7b33f9-bc85-437c-ad98-41db3fe3bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:51.835027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c7b33f9-bc85-437c-ad98-41db3fe3bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:51.835027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c7b33f9-bc85-437c-ad98-41db3fe3bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:51.835587 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7c7b33f9-bc85-437c-ad98-41db3fe3bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:51.894789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7c7b33f9-bc85-437c-ad98-41db3fe3bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:51.903125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7c7b33f9-bc85-437c-ad98-41db3fe3bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083812 Sep 02 10:03:51.905520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 956/1991] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:52.924382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-35ddd4bf-72bb-4f94-806b-8f9affcff858 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:52.924974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-35ddd4bf-72bb-4f94-806b-8f9affcff858 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:52.927700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:03:52.927850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 10:03:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 (ip 10.222.0.57) !!! Sep 02 10:03:52.934367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35ddd4bf-72bb-4f94-806b-8f9affcff858 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:52.934876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35ddd4bf-72bb-4f94-806b-8f9affcff858 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:52.935316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35ddd4bf-72bb-4f94-806b-8f9affcff858 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:52.936001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35ddd4bf-72bb-4f94-806b-8f9affcff858 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:52.936452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35ddd4bf-72bb-4f94-806b-8f9affcff858 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:52.936878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35ddd4bf-72bb-4f94-806b-8f9affcff858 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:52.998874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-35ddd4bf-72bb-4f94-806b-8f9affcff858 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:53.007886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-35ddd4bf-72bb-4f94-806b-8f9affcff858 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087350 Sep 02 10:03:53.008455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1036/1992] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:54.028453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5aa0d744-3fb6-49e4-a9d6-df4f7330ba75 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:54.029065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5aa0d744-3fb6-49e4-a9d6-df4f7330ba75 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:54.035692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aa0d744-3fb6-49e4-a9d6-df4f7330ba75 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:54.036178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aa0d744-3fb6-49e4-a9d6-df4f7330ba75 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:54.037120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aa0d744-3fb6-49e4-a9d6-df4f7330ba75 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:54.037807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aa0d744-3fb6-49e4-a9d6-df4f7330ba75 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:54.038260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aa0d744-3fb6-49e4-a9d6-df4f7330ba75 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:54.038681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5aa0d744-3fb6-49e4-a9d6-df4f7330ba75 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:54.098415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5aa0d744-3fb6-49e4-a9d6-df4f7330ba75 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:54.107291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5aa0d744-3fb6-49e4-a9d6-df4f7330ba75 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082749 Sep 02 10:03:54.107854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 957/1993] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:55.128523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b46cbd97-add4-4203-9d9a-86799a09e839 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:55.129131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b46cbd97-add4-4203-9d9a-86799a09e839 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:55.136076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b46cbd97-add4-4203-9d9a-86799a09e839 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:55.136557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b46cbd97-add4-4203-9d9a-86799a09e839 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:55.136994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b46cbd97-add4-4203-9d9a-86799a09e839 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:55.137672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b46cbd97-add4-4203-9d9a-86799a09e839 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:55.138120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b46cbd97-add4-4203-9d9a-86799a09e839 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:55.138540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b46cbd97-add4-4203-9d9a-86799a09e839 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:55.201533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b46cbd97-add4-4203-9d9a-86799a09e839 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:55.209889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b46cbd97-add4-4203-9d9a-86799a09e839 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085309 Sep 02 10:03:55.210450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1037/1994] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:56.230451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b8c7a2ce-7502-4b97-bcd5-c751d6a9854a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:56.231019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b8c7a2ce-7502-4b97-bcd5-c751d6a9854a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:56.233328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=42 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:56.237973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8c7a2ce-7502-4b97-bcd5-c751d6a9854a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:56.238459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8c7a2ce-7502-4b97-bcd5-c751d6a9854a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:56.238931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8c7a2ce-7502-4b97-bcd5-c751d6a9854a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:56.239618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8c7a2ce-7502-4b97-bcd5-c751d6a9854a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:56.240073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8c7a2ce-7502-4b97-bcd5-c751d6a9854a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:56.240498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8c7a2ce-7502-4b97-bcd5-c751d6a9854a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:56.304024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b8c7a2ce-7502-4b97-bcd5-c751d6a9854a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:56.312185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b8c7a2ce-7502-4b97-bcd5-c751d6a9854a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085702 Sep 02 10:03:56.312879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 958/1995] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:57.333380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ac2f979f-cd25-4495-afef-bbe8db4278b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:57.334517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ac2f979f-cd25-4495-afef-bbe8db4278b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:57.340978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac2f979f-cd25-4495-afef-bbe8db4278b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:57.341462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac2f979f-cd25-4495-afef-bbe8db4278b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:57.341899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac2f979f-cd25-4495-afef-bbe8db4278b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:57.342584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac2f979f-cd25-4495-afef-bbe8db4278b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:57.343064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac2f979f-cd25-4495-afef-bbe8db4278b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:57.343496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ac2f979f-cd25-4495-afef-bbe8db4278b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:57.403787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ac2f979f-cd25-4495-afef-bbe8db4278b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:57.412530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ac2f979f-cd25-4495-afef-bbe8db4278b6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082357 Sep 02 10:03:57.413099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1038/1996] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:58.433966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-986e1469-bfe4-43dd-9370-280c5e762343 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:58.434628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-986e1469-bfe4-43dd-9370-280c5e762343 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:58.441000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-986e1469-bfe4-43dd-9370-280c5e762343 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:58.441481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-986e1469-bfe4-43dd-9370-280c5e762343 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:58.441914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-986e1469-bfe4-43dd-9370-280c5e762343 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:58.442640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-986e1469-bfe4-43dd-9370-280c5e762343 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:58.443102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-986e1469-bfe4-43dd-9370-280c5e762343 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:58.443546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-986e1469-bfe4-43dd-9370-280c5e762343 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:58.446048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:03:58.504899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-986e1469-bfe4-43dd-9370-280c5e762343 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:58.512960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-986e1469-bfe4-43dd-9370-280c5e762343 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083134 Sep 02 10:03:58.513517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 959/1997] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:03:59.533963 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f7da8423-bb2a-4ce2-a213-e8f1cf5626d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:03:59.534589 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f7da8423-bb2a-4ce2-a213-e8f1cf5626d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:03:59.540990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f7da8423-bb2a-4ce2-a213-e8f1cf5626d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:59.541475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f7da8423-bb2a-4ce2-a213-e8f1cf5626d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:59.541913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f7da8423-bb2a-4ce2-a213-e8f1cf5626d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:59.542605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f7da8423-bb2a-4ce2-a213-e8f1cf5626d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:03:59.543093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f7da8423-bb2a-4ce2-a213-e8f1cf5626d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:03:59.543521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f7da8423-bb2a-4ce2-a213-e8f1cf5626d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:03:59.603928 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f7da8423-bb2a-4ce2-a213-e8f1cf5626d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:03:59.611946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f7da8423-bb2a-4ce2-a213-e8f1cf5626d1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081954 Sep 02 10:03:59.612508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1039/1998] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:03:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:00.633922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1b573a52-5a60-40f3-b980-4da90bb8cead tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:00.634515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1b573a52-5a60-40f3-b980-4da90bb8cead tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:00.640941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b573a52-5a60-40f3-b980-4da90bb8cead tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:00.641422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b573a52-5a60-40f3-b980-4da90bb8cead tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:00.641851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b573a52-5a60-40f3-b980-4da90bb8cead tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:00.642533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b573a52-5a60-40f3-b980-4da90bb8cead tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:00.643010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b573a52-5a60-40f3-b980-4da90bb8cead tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:00.643431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1b573a52-5a60-40f3-b980-4da90bb8cead tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:00.705365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1b573a52-5a60-40f3-b980-4da90bb8cead tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:00.713938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1b573a52-5a60-40f3-b980-4da90bb8cead tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084490 Sep 02 10:04:00.714505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 960/1999] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:01.734545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5a6362d2-241f-4240-b888-3e1443dcb840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:01.735182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5a6362d2-241f-4240-b888-3e1443dcb840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:01.742113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a6362d2-241f-4240-b888-3e1443dcb840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:01.742591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a6362d2-241f-4240-b888-3e1443dcb840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:01.743053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a6362d2-241f-4240-b888-3e1443dcb840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:01.743734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a6362d2-241f-4240-b888-3e1443dcb840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:01.744180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a6362d2-241f-4240-b888-3e1443dcb840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:01.744596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a6362d2-241f-4240-b888-3e1443dcb840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:01.805620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5a6362d2-241f-4240-b888-3e1443dcb840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:01.813742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5a6362d2-241f-4240-b888-3e1443dcb840 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083026 Sep 02 10:04:01.814297 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1040/2000] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:02.834933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fcef8afb-4401-4e57-b75d-eeac96958ebd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:02.835515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fcef8afb-4401-4e57-b75d-eeac96958ebd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:02.841530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fcef8afb-4401-4e57-b75d-eeac96958ebd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:02.842008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fcef8afb-4401-4e57-b75d-eeac96958ebd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:02.842439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fcef8afb-4401-4e57-b75d-eeac96958ebd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:02.843147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fcef8afb-4401-4e57-b75d-eeac96958ebd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:02.843588 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fcef8afb-4401-4e57-b75d-eeac96958ebd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:02.844005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fcef8afb-4401-4e57-b75d-eeac96958ebd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:02.904878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fcef8afb-4401-4e57-b75d-eeac96958ebd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:02.913022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fcef8afb-4401-4e57-b75d-eeac96958ebd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082799 Sep 02 10:04:02.913574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 961/2001] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:03.933216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7e49bc0c-e1e7-4d1f-87f9-072eb81a188c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:03.933824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7e49bc0c-e1e7-4d1f-87f9-072eb81a188c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:03.940232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e49bc0c-e1e7-4d1f-87f9-072eb81a188c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:03.940712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e49bc0c-e1e7-4d1f-87f9-072eb81a188c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:03.941146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e49bc0c-e1e7-4d1f-87f9-072eb81a188c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:03.941905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e49bc0c-e1e7-4d1f-87f9-072eb81a188c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:03.942351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e49bc0c-e1e7-4d1f-87f9-072eb81a188c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:03.942802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7e49bc0c-e1e7-4d1f-87f9-072eb81a188c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:04.011130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7e49bc0c-e1e7-4d1f-87f9-072eb81a188c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:04.019511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7e49bc0c-e1e7-4d1f-87f9-072eb81a188c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.090049 Sep 02 10:04:04.020146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1041/2002] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:05.040619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8692d65c-7df7-4e8d-96d6-18ac262ec241 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:05.041244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8692d65c-7df7-4e8d-96d6-18ac262ec241 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:05.047770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8692d65c-7df7-4e8d-96d6-18ac262ec241 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:05.048277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8692d65c-7df7-4e8d-96d6-18ac262ec241 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:05.048705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8692d65c-7df7-4e8d-96d6-18ac262ec241 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:05.049380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8692d65c-7df7-4e8d-96d6-18ac262ec241 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:05.049827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8692d65c-7df7-4e8d-96d6-18ac262ec241 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:05.050246 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8692d65c-7df7-4e8d-96d6-18ac262ec241 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:05.113179 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8692d65c-7df7-4e8d-96d6-18ac262ec241 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:05.121254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8692d65c-7df7-4e8d-96d6-18ac262ec241 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085085 Sep 02 10:04:05.121821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 962/2003] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:06.141748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-10a73bcc-8d97-4310-be49-228a992b608b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:06.142283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-10a73bcc-8d97-4310-be49-228a992b608b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:06.148675 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10a73bcc-8d97-4310-be49-228a992b608b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:06.149151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10a73bcc-8d97-4310-be49-228a992b608b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:06.149582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10a73bcc-8d97-4310-be49-228a992b608b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:06.150265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10a73bcc-8d97-4310-be49-228a992b608b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:06.150736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10a73bcc-8d97-4310-be49-228a992b608b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:06.151150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10a73bcc-8d97-4310-be49-228a992b608b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:06.211788 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-10a73bcc-8d97-4310-be49-228a992b608b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:06.219865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-10a73bcc-8d97-4310-be49-228a992b608b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082060 Sep 02 10:04:06.220424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1042/2004] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:07.243191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-995669c6-1099-4729-bcb8-a05c8b812352 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:07.243742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-995669c6-1099-4729-bcb8-a05c8b812352 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:07.250452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-995669c6-1099-4729-bcb8-a05c8b812352 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:07.250981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-995669c6-1099-4729-bcb8-a05c8b812352 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:07.251426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-995669c6-1099-4729-bcb8-a05c8b812352 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:07.252123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-995669c6-1099-4729-bcb8-a05c8b812352 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:07.252581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-995669c6-1099-4729-bcb8-a05c8b812352 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:07.253014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-995669c6-1099-4729-bcb8-a05c8b812352 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:07.315965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-995669c6-1099-4729-bcb8-a05c8b812352 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:07.322778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-995669c6-1099-4729-bcb8-a05c8b812352 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083519 Sep 02 10:04:07.323347 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 963/2005] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:08.343925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-82d60e0d-d107-4951-89d6-ed383753722f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:08.344544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-82d60e0d-d107-4951-89d6-ed383753722f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:08.350987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82d60e0d-d107-4951-89d6-ed383753722f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:08.351463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82d60e0d-d107-4951-89d6-ed383753722f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:08.351892 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82d60e0d-d107-4951-89d6-ed383753722f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:08.352567 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82d60e0d-d107-4951-89d6-ed383753722f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:08.353012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82d60e0d-d107-4951-89d6-ed383753722f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:08.353430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82d60e0d-d107-4951-89d6-ed383753722f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:08.413758 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-82d60e0d-d107-4951-89d6-ed383753722f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:08.421774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-82d60e0d-d107-4951-89d6-ed383753722f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081839 Sep 02 10:04:08.422342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1043/2006] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:09.442739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2531bc1b-5e8f-4cfd-9aca-30f7e716c90e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:09.443481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2531bc1b-5e8f-4cfd-9aca-30f7e716c90e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:09.450356 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2531bc1b-5e8f-4cfd-9aca-30f7e716c90e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:09.450880 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2531bc1b-5e8f-4cfd-9aca-30f7e716c90e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:09.451319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2531bc1b-5e8f-4cfd-9aca-30f7e716c90e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:09.452004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2531bc1b-5e8f-4cfd-9aca-30f7e716c90e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:09.452453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2531bc1b-5e8f-4cfd-9aca-30f7e716c90e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:09.452881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2531bc1b-5e8f-4cfd-9aca-30f7e716c90e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:09.513430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2531bc1b-5e8f-4cfd-9aca-30f7e716c90e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:09.522048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2531bc1b-5e8f-4cfd-9aca-30f7e716c90e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082689 Sep 02 10:04:09.522628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 964/2007] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:10.543178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4d9250cd-c9f7-4bbb-8af5-5a0dec049663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:10.543809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4d9250cd-c9f7-4bbb-8af5-5a0dec049663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:10.550163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d9250cd-c9f7-4bbb-8af5-5a0dec049663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:10.550647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d9250cd-c9f7-4bbb-8af5-5a0dec049663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:10.551112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d9250cd-c9f7-4bbb-8af5-5a0dec049663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:10.551786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d9250cd-c9f7-4bbb-8af5-5a0dec049663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:10.552234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d9250cd-c9f7-4bbb-8af5-5a0dec049663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:10.552652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d9250cd-c9f7-4bbb-8af5-5a0dec049663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:10.614175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4d9250cd-c9f7-4bbb-8af5-5a0dec049663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:10.627914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4d9250cd-c9f7-4bbb-8af5-5a0dec049663 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.088592 Sep 02 10:04:10.628482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1044/2008] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:11.649049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-eb1b4c5e-2f69-4d7b-a97b-46eb2691fa2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:11.649647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-eb1b4c5e-2f69-4d7b-a97b-46eb2691fa2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:11.656028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb1b4c5e-2f69-4d7b-a97b-46eb2691fa2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:11.656505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb1b4c5e-2f69-4d7b-a97b-46eb2691fa2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:11.656936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb1b4c5e-2f69-4d7b-a97b-46eb2691fa2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:11.657607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb1b4c5e-2f69-4d7b-a97b-46eb2691fa2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:11.658055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb1b4c5e-2f69-4d7b-a97b-46eb2691fa2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:11.658473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb1b4c5e-2f69-4d7b-a97b-46eb2691fa2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:11.718484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-eb1b4c5e-2f69-4d7b-a97b-46eb2691fa2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:11.727364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-eb1b4c5e-2f69-4d7b-a97b-46eb2691fa2d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082648 Sep 02 10:04:11.727972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 965/2009] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:12.747955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-86bc4efd-daf3-4b73-8806-0814c78bf11e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:12.748832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-86bc4efd-daf3-4b73-8806-0814c78bf11e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:12.755253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86bc4efd-daf3-4b73-8806-0814c78bf11e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:12.756241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86bc4efd-daf3-4b73-8806-0814c78bf11e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:12.756678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86bc4efd-daf3-4b73-8806-0814c78bf11e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:12.757361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86bc4efd-daf3-4b73-8806-0814c78bf11e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:12.757812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86bc4efd-daf3-4b73-8806-0814c78bf11e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:12.758234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-86bc4efd-daf3-4b73-8806-0814c78bf11e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:12.821273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-86bc4efd-daf3-4b73-8806-0814c78bf11e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:12.829577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-86bc4efd-daf3-4b73-8806-0814c78bf11e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085469 Sep 02 10:04:12.830137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1045/2010] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:13.851558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b6b91aa4-bb11-499b-90b3-f958aea00052 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:13.852168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b6b91aa4-bb11-499b-90b3-f958aea00052 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:13.858580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b91aa4-bb11-499b-90b3-f958aea00052 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:13.859089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b91aa4-bb11-499b-90b3-f958aea00052 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:13.859525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b91aa4-bb11-499b-90b3-f958aea00052 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:13.860208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b91aa4-bb11-499b-90b3-f958aea00052 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:13.860660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b91aa4-bb11-499b-90b3-f958aea00052 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:13.861084 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b91aa4-bb11-499b-90b3-f958aea00052 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:13.929273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b6b91aa4-bb11-499b-90b3-f958aea00052 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:13.937910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b6b91aa4-bb11-499b-90b3-f958aea00052 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.090833 Sep 02 10:04:13.938618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 966/2011] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:14.958680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-55a1aec7-3dc6-41e7-afb5-3ea5594c7afc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:14.959949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-55a1aec7-3dc6-41e7-afb5-3ea5594c7afc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:14.966314 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a1aec7-3dc6-41e7-afb5-3ea5594c7afc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:14.966822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a1aec7-3dc6-41e7-afb5-3ea5594c7afc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:14.967254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a1aec7-3dc6-41e7-afb5-3ea5594c7afc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:14.967927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a1aec7-3dc6-41e7-afb5-3ea5594c7afc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:14.968373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a1aec7-3dc6-41e7-afb5-3ea5594c7afc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:14.968792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-55a1aec7-3dc6-41e7-afb5-3ea5594c7afc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:15.029007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-55a1aec7-3dc6-41e7-afb5-3ea5594c7afc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:15.037183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-55a1aec7-3dc6-41e7-afb5-3ea5594c7afc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082305 Sep 02 10:04:15.037737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1046/2012] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:16.057555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dd7d9c26-a44e-4036-aea4-4fd17792bc1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:16.058175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dd7d9c26-a44e-4036-aea4-4fd17792bc1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:16.064814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd7d9c26-a44e-4036-aea4-4fd17792bc1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:16.065295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd7d9c26-a44e-4036-aea4-4fd17792bc1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:16.065725 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd7d9c26-a44e-4036-aea4-4fd17792bc1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:16.066408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd7d9c26-a44e-4036-aea4-4fd17792bc1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:16.066894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd7d9c26-a44e-4036-aea4-4fd17792bc1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:16.067322 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dd7d9c26-a44e-4036-aea4-4fd17792bc1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:16.128757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dd7d9c26-a44e-4036-aea4-4fd17792bc1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:16.136882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dd7d9c26-a44e-4036-aea4-4fd17792bc1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083225 Sep 02 10:04:16.137448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 967/2013] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:17.157833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-745f221c-3bdd-4b97-a00b-9dec5e2b586e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:17.158397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-745f221c-3bdd-4b97-a00b-9dec5e2b586e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:17.165331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-745f221c-3bdd-4b97-a00b-9dec5e2b586e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:17.165818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-745f221c-3bdd-4b97-a00b-9dec5e2b586e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:17.166265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-745f221c-3bdd-4b97-a00b-9dec5e2b586e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:17.166982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-745f221c-3bdd-4b97-a00b-9dec5e2b586e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:17.167437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-745f221c-3bdd-4b97-a00b-9dec5e2b586e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:17.167866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-745f221c-3bdd-4b97-a00b-9dec5e2b586e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:17.227920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-745f221c-3bdd-4b97-a00b-9dec5e2b586e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:17.236041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-745f221c-3bdd-4b97-a00b-9dec5e2b586e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082166 Sep 02 10:04:17.236611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1047/2014] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:18.257411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-df06fa66-eddf-4c67-bc12-01d3b15fd0d4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:18.257962 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-df06fa66-eddf-4c67-bc12-01d3b15fd0d4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:18.264385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df06fa66-eddf-4c67-bc12-01d3b15fd0d4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:18.264864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df06fa66-eddf-4c67-bc12-01d3b15fd0d4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:18.265302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df06fa66-eddf-4c67-bc12-01d3b15fd0d4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:18.265981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df06fa66-eddf-4c67-bc12-01d3b15fd0d4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:18.266435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df06fa66-eddf-4c67-bc12-01d3b15fd0d4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:18.266894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df06fa66-eddf-4c67-bc12-01d3b15fd0d4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:18.326695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-df06fa66-eddf-4c67-bc12-01d3b15fd0d4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:18.335103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-df06fa66-eddf-4c67-bc12-01d3b15fd0d4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081118 Sep 02 10:04:18.335672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 968/2015] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:19.355385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4cca22f7-5e68-4511-aa9d-34ca92a44d1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:19.355999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4cca22f7-5e68-4511-aa9d-34ca92a44d1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:19.362394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cca22f7-5e68-4511-aa9d-34ca92a44d1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:19.362909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cca22f7-5e68-4511-aa9d-34ca92a44d1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:19.363345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cca22f7-5e68-4511-aa9d-34ca92a44d1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:19.364026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cca22f7-5e68-4511-aa9d-34ca92a44d1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:19.364479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cca22f7-5e68-4511-aa9d-34ca92a44d1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:19.364905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cca22f7-5e68-4511-aa9d-34ca92a44d1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:19.368789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=84 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:04:19.427499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4cca22f7-5e68-4511-aa9d-34ca92a44d1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:19.435506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4cca22f7-5e68-4511-aa9d-34ca92a44d1b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083925 Sep 02 10:04:19.436075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1048/2016] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:20.456154 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-45faa91c-7fa2-413c-a51f-e56ca8ca17c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:20.456795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-45faa91c-7fa2-413c-a51f-e56ca8ca17c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:20.463666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45faa91c-7fa2-413c-a51f-e56ca8ca17c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:20.464136 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45faa91c-7fa2-413c-a51f-e56ca8ca17c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:20.464566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45faa91c-7fa2-413c-a51f-e56ca8ca17c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:20.465242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45faa91c-7fa2-413c-a51f-e56ca8ca17c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:20.465687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45faa91c-7fa2-413c-a51f-e56ca8ca17c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:20.466108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45faa91c-7fa2-413c-a51f-e56ca8ca17c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:20.527596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-45faa91c-7fa2-413c-a51f-e56ca8ca17c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:20.536346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-45faa91c-7fa2-413c-a51f-e56ca8ca17c4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084019 Sep 02 10:04:20.536919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 969/2017] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:21.557982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1d0accf7-94e0-43a1-ae7a-13418bf8a004 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:21.558557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1d0accf7-94e0-43a1-ae7a-13418bf8a004 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:21.560894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=28 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:04:21.565656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0accf7-94e0-43a1-ae7a-13418bf8a004 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:21.566180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0accf7-94e0-43a1-ae7a-13418bf8a004 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:21.569021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0accf7-94e0-43a1-ae7a-13418bf8a004 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:21.569021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0accf7-94e0-43a1-ae7a-13418bf8a004 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:21.569021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0accf7-94e0-43a1-ae7a-13418bf8a004 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:21.569021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d0accf7-94e0-43a1-ae7a-13418bf8a004 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:21.639441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1d0accf7-94e0-43a1-ae7a-13418bf8a004 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:21.647422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1d0accf7-94e0-43a1-ae7a-13418bf8a004 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.093888 Sep 02 10:04:21.648017 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1049/2018] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:22.667818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9e7cbf8c-dcb0-4e5f-9ee9-163720d75b8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:22.668426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9e7cbf8c-dcb0-4e5f-9ee9-163720d75b8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:22.674914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e7cbf8c-dcb0-4e5f-9ee9-163720d75b8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:22.675401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e7cbf8c-dcb0-4e5f-9ee9-163720d75b8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:22.675844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e7cbf8c-dcb0-4e5f-9ee9-163720d75b8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:22.676534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e7cbf8c-dcb0-4e5f-9ee9-163720d75b8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:22.676991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e7cbf8c-dcb0-4e5f-9ee9-163720d75b8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:22.677418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e7cbf8c-dcb0-4e5f-9ee9-163720d75b8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:22.740294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e7cbf8c-dcb0-4e5f-9ee9-163720d75b8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:22.749124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9e7cbf8c-dcb0-4e5f-9ee9-163720d75b8f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085212 Sep 02 10:04:22.749697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 970/2019] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:04:23.770248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-121452ae-b90d-4247-b37a-a3bfefa5df7a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:23.770877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-121452ae-b90d-4247-b37a-a3bfefa5df7a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:23.777265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121452ae-b90d-4247-b37a-a3bfefa5df7a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:23.777741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121452ae-b90d-4247-b37a-a3bfefa5df7a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:23.778167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121452ae-b90d-4247-b37a-a3bfefa5df7a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:23.778902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121452ae-b90d-4247-b37a-a3bfefa5df7a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:23.779349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121452ae-b90d-4247-b37a-a3bfefa5df7a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:23.779770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-121452ae-b90d-4247-b37a-a3bfefa5df7a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:23.840449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-121452ae-b90d-4247-b37a-a3bfefa5df7a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:23.848636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-121452ae-b90d-4247-b37a-a3bfefa5df7a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082304 Sep 02 10:04:23.849200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1050/2020] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:24.869359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1fc7c25e-de15-48a0-b94e-7e749e61bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:24.869965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1fc7c25e-de15-48a0-b94e-7e749e61bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:24.876748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fc7c25e-de15-48a0-b94e-7e749e61bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:24.877293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fc7c25e-de15-48a0-b94e-7e749e61bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:24.877726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fc7c25e-de15-48a0-b94e-7e749e61bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:24.878408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fc7c25e-de15-48a0-b94e-7e749e61bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:24.879080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fc7c25e-de15-48a0-b94e-7e749e61bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:24.879501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1fc7c25e-de15-48a0-b94e-7e749e61bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:24.942408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1fc7c25e-de15-48a0-b94e-7e749e61bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:24.951391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1fc7c25e-de15-48a0-b94e-7e749e61bd7c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085961 Sep 02 10:04:24.951954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 971/2021] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:25.971913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f87b723f-c64c-417b-a98f-2886f6a6e34e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:25.972502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f87b723f-c64c-417b-a98f-2886f6a6e34e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:25.979887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f87b723f-c64c-417b-a98f-2886f6a6e34e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:25.980378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f87b723f-c64c-417b-a98f-2886f6a6e34e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:25.980822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f87b723f-c64c-417b-a98f-2886f6a6e34e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:25.981548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f87b723f-c64c-417b-a98f-2886f6a6e34e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:25.982007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f87b723f-c64c-417b-a98f-2886f6a6e34e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:25.982442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f87b723f-c64c-417b-a98f-2886f6a6e34e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:26.045105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f87b723f-c64c-417b-a98f-2886f6a6e34e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:26.053349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f87b723f-c64c-417b-a98f-2886f6a6e34e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085314 Sep 02 10:04:26.055588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1051/2022] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:25 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:27.073391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-095a69ac-7d9b-478c-bdd9-bcbd3f8eb156 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:27.073980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-095a69ac-7d9b-478c-bdd9-bcbd3f8eb156 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:27.076421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=28 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:04:27.081072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-095a69ac-7d9b-478c-bdd9-bcbd3f8eb156 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:27.081552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-095a69ac-7d9b-478c-bdd9-bcbd3f8eb156 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:27.086524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-095a69ac-7d9b-478c-bdd9-bcbd3f8eb156 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:27.086524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-095a69ac-7d9b-478c-bdd9-bcbd3f8eb156 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:27.086524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-095a69ac-7d9b-478c-bdd9-bcbd3f8eb156 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:27.086524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-095a69ac-7d9b-478c-bdd9-bcbd3f8eb156 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:27.144339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-095a69ac-7d9b-478c-bdd9-bcbd3f8eb156 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:27.152925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-095a69ac-7d9b-478c-bdd9-bcbd3f8eb156 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083410 Sep 02 10:04:27.153492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 972/2023] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:28.174119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8c2b7ae5-6cfa-42da-9b1a-56b7df72a3c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:28.174649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8c2b7ae5-6cfa-42da-9b1a-56b7df72a3c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:28.181150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c2b7ae5-6cfa-42da-9b1a-56b7df72a3c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:28.181636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c2b7ae5-6cfa-42da-9b1a-56b7df72a3c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:28.182076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c2b7ae5-6cfa-42da-9b1a-56b7df72a3c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:28.182793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c2b7ae5-6cfa-42da-9b1a-56b7df72a3c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:28.183252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c2b7ae5-6cfa-42da-9b1a-56b7df72a3c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:28.183681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c2b7ae5-6cfa-42da-9b1a-56b7df72a3c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:28.243272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8c2b7ae5-6cfa-42da-9b1a-56b7df72a3c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:28.251566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8c2b7ae5-6cfa-42da-9b1a-56b7df72a3c8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081410 Sep 02 10:04:28.252134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1052/2024] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:29.271829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3d297103-deb3-4bb7-8b78-2273e25f279d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:29.272453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3d297103-deb3-4bb7-8b78-2273e25f279d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:29.280352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d297103-deb3-4bb7-8b78-2273e25f279d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:29.280887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d297103-deb3-4bb7-8b78-2273e25f279d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:29.281402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d297103-deb3-4bb7-8b78-2273e25f279d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:29.282168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d297103-deb3-4bb7-8b78-2273e25f279d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:29.282699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d297103-deb3-4bb7-8b78-2273e25f279d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:29.283201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d297103-deb3-4bb7-8b78-2273e25f279d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:29.287952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=84 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:04:29.346914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3d297103-deb3-4bb7-8b78-2273e25f279d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:29.354933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3d297103-deb3-4bb7-8b78-2273e25f279d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087045 Sep 02 10:04:29.355503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 973/2025] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:30.375692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-33875f0f-04b3-49a0-88ca-d4f43ce4dfea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:30.376337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-33875f0f-04b3-49a0-88ca-d4f43ce4dfea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:30.382677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-33875f0f-04b3-49a0-88ca-d4f43ce4dfea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:30.383188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-33875f0f-04b3-49a0-88ca-d4f43ce4dfea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:30.383629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-33875f0f-04b3-49a0-88ca-d4f43ce4dfea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:30.384313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-33875f0f-04b3-49a0-88ca-d4f43ce4dfea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:30.384764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-33875f0f-04b3-49a0-88ca-d4f43ce4dfea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:30.385228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-33875f0f-04b3-49a0-88ca-d4f43ce4dfea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:30.447772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-33875f0f-04b3-49a0-88ca-d4f43ce4dfea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:30.455840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-33875f0f-04b3-49a0-88ca-d4f43ce4dfea tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084275 Sep 02 10:04:30.456405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1053/2026] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:31.476672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-eb6a2037-0dd8-448b-a124-46ce745184a0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:31.477264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-eb6a2037-0dd8-448b-a124-46ce745184a0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:31.483672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb6a2037-0dd8-448b-a124-46ce745184a0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:31.484154 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb6a2037-0dd8-448b-a124-46ce745184a0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:31.484585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb6a2037-0dd8-448b-a124-46ce745184a0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:31.485296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb6a2037-0dd8-448b-a124-46ce745184a0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:31.485747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb6a2037-0dd8-448b-a124-46ce745184a0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:31.486167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb6a2037-0dd8-448b-a124-46ce745184a0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:31.549347 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-eb6a2037-0dd8-448b-a124-46ce745184a0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:31.557558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-eb6a2037-0dd8-448b-a124-46ce745184a0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084805 Sep 02 10:04:31.558121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 974/2027] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:32.579270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-da41479c-bb26-47d1-a99d-dc0b8adb581b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:32.579881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-da41479c-bb26-47d1-a99d-dc0b8adb581b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:32.586299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da41479c-bb26-47d1-a99d-dc0b8adb581b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:32.586817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da41479c-bb26-47d1-a99d-dc0b8adb581b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:32.587255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da41479c-bb26-47d1-a99d-dc0b8adb581b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:32.587961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da41479c-bb26-47d1-a99d-dc0b8adb581b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:32.588476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da41479c-bb26-47d1-a99d-dc0b8adb581b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:32.588901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-da41479c-bb26-47d1-a99d-dc0b8adb581b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:32.651717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-da41479c-bb26-47d1-a99d-dc0b8adb581b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:32.659834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-da41479c-bb26-47d1-a99d-dc0b8adb581b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084582 Sep 02 10:04:32.660399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1054/2028] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:33.680784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-49cfa46b-5d02-4b32-997a-7b07feabd074 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:33.681388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-49cfa46b-5d02-4b32-997a-7b07feabd074 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:33.687440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49cfa46b-5d02-4b32-997a-7b07feabd074 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:33.687920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49cfa46b-5d02-4b32-997a-7b07feabd074 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:33.688380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49cfa46b-5d02-4b32-997a-7b07feabd074 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:33.689060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49cfa46b-5d02-4b32-997a-7b07feabd074 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:33.689510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49cfa46b-5d02-4b32-997a-7b07feabd074 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:33.689937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49cfa46b-5d02-4b32-997a-7b07feabd074 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:33.749812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-49cfa46b-5d02-4b32-997a-7b07feabd074 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:33.758379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-49cfa46b-5d02-4b32-997a-7b07feabd074 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081668 Sep 02 10:04:33.758995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 975/2029] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:34.778805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5da20f28-a175-43cd-b0e9-2b0427c4cf20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:34.779450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5da20f28-a175-43cd-b0e9-2b0427c4cf20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:34.786044 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da20f28-a175-43cd-b0e9-2b0427c4cf20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:34.794848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da20f28-a175-43cd-b0e9-2b0427c4cf20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:34.794848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da20f28-a175-43cd-b0e9-2b0427c4cf20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:34.794848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da20f28-a175-43cd-b0e9-2b0427c4cf20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:34.794848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da20f28-a175-43cd-b0e9-2b0427c4cf20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:34.795376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da20f28-a175-43cd-b0e9-2b0427c4cf20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:34.849306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5da20f28-a175-43cd-b0e9-2b0427c4cf20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:34.857980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5da20f28-a175-43cd-b0e9-2b0427c4cf20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083024 Sep 02 10:04:34.858555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1055/2030] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:35.879096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a1b710bd-0de5-43e8-980a-257489c0d3a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:35.879700 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a1b710bd-0de5-43e8-980a-257489c0d3a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:35.886153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1b710bd-0de5-43e8-980a-257489c0d3a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:35.886631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1b710bd-0de5-43e8-980a-257489c0d3a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:35.887096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1b710bd-0de5-43e8-980a-257489c0d3a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:35.887771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1b710bd-0de5-43e8-980a-257489c0d3a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:35.888248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1b710bd-0de5-43e8-980a-257489c0d3a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:35.888666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a1b710bd-0de5-43e8-980a-257489c0d3a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:35.948560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a1b710bd-0de5-43e8-980a-257489c0d3a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:35.956598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a1b710bd-0de5-43e8-980a-257489c0d3a8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081359 Sep 02 10:04:35.957160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 976/2031] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:36.978203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6f005e38-fb07-4b2f-885f-cab6775dfa6f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:36.978848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6f005e38-fb07-4b2f-885f-cab6775dfa6f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:36.985300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f005e38-fb07-4b2f-885f-cab6775dfa6f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:36.985789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f005e38-fb07-4b2f-885f-cab6775dfa6f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:36.986230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f005e38-fb07-4b2f-885f-cab6775dfa6f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:36.986964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f005e38-fb07-4b2f-885f-cab6775dfa6f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:36.987426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f005e38-fb07-4b2f-885f-cab6775dfa6f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:36.987861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f005e38-fb07-4b2f-885f-cab6775dfa6f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:37.048691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6f005e38-fb07-4b2f-885f-cab6775dfa6f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:37.057497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6f005e38-fb07-4b2f-885f-cab6775dfa6f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083793 Sep 02 10:04:37.058065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1056/2032] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:38.077434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e9cb118c-2d88-4e3e-bf90-b38fb4e10bdb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:38.077988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e9cb118c-2d88-4e3e-bf90-b38fb4e10bdb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:38.084525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9cb118c-2d88-4e3e-bf90-b38fb4e10bdb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:38.085027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9cb118c-2d88-4e3e-bf90-b38fb4e10bdb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:38.085454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9cb118c-2d88-4e3e-bf90-b38fb4e10bdb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:38.086137 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9cb118c-2d88-4e3e-bf90-b38fb4e10bdb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:38.086591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9cb118c-2d88-4e3e-bf90-b38fb4e10bdb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:38.087045 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e9cb118c-2d88-4e3e-bf90-b38fb4e10bdb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:38.147927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e9cb118c-2d88-4e3e-bf90-b38fb4e10bdb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:38.156052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e9cb118c-2d88-4e3e-bf90-b38fb4e10bdb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082618 Sep 02 10:04:38.156623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 977/2033] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:39.177052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2f3d3931-92b0-4585-9cf2-e46c2529a84c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:39.177613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2f3d3931-92b0-4585-9cf2-e46c2529a84c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:39.183551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f3d3931-92b0-4585-9cf2-e46c2529a84c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:39.184029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f3d3931-92b0-4585-9cf2-e46c2529a84c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:39.184463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f3d3931-92b0-4585-9cf2-e46c2529a84c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:39.185141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f3d3931-92b0-4585-9cf2-e46c2529a84c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:39.185584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f3d3931-92b0-4585-9cf2-e46c2529a84c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:39.186002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f3d3931-92b0-4585-9cf2-e46c2529a84c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:39.250795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2f3d3931-92b0-4585-9cf2-e46c2529a84c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:39.259362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2f3d3931-92b0-4585-9cf2-e46c2529a84c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086428 Sep 02 10:04:39.259927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1057/2034] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:40.279831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-601b1b9b-3523-4faa-aeb1-6e5be9cf0364 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:40.280385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-601b1b9b-3523-4faa-aeb1-6e5be9cf0364 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:40.286695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-601b1b9b-3523-4faa-aeb1-6e5be9cf0364 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:40.287193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-601b1b9b-3523-4faa-aeb1-6e5be9cf0364 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:40.287623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-601b1b9b-3523-4faa-aeb1-6e5be9cf0364 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:40.288959 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-601b1b9b-3523-4faa-aeb1-6e5be9cf0364 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:40.289405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-601b1b9b-3523-4faa-aeb1-6e5be9cf0364 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:40.289825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-601b1b9b-3523-4faa-aeb1-6e5be9cf0364 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:40.352884 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-601b1b9b-3523-4faa-aeb1-6e5be9cf0364 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:40.361112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-601b1b9b-3523-4faa-aeb1-6e5be9cf0364 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085205 Sep 02 10:04:40.361677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 978/2035] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:40.848939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cb8b9ed4-cab6-4172-9ad6-2095ec05befc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:40.849429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cb8b9ed4-cab6-4172-9ad6-2095ec05befc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:40.855903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ed4-cab6-4172-9ad6-2095ec05befc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:40.856407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ed4-cab6-4172-9ad6-2095ec05befc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:40.856829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ed4-cab6-4172-9ad6-2095ec05befc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:40.857514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ed4-cab6-4172-9ad6-2095ec05befc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:40.857968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ed4-cab6-4172-9ad6-2095ec05befc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:40.858392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb8b9ed4-cab6-4172-9ad6-2095ec05befc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:40.882544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cb8b9ed4-cab6-4172-9ad6-2095ec05befc tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/ips" status: 200 len: 146 microversion: 2.1 time: 0.037029 Sep 02 10:04:40.883227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1058/2036] 10.222.0.57 () {58 vars in 1248 bytes} [Fri Sep 2 10:04:40 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:04:41.381955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6bf5d489-322b-4c69-9d06-4097f3d70ea0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:41.382567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6bf5d489-322b-4c69-9d06-4097f3d70ea0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:41.389545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf5d489-322b-4c69-9d06-4097f3d70ea0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:41.390028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf5d489-322b-4c69-9d06-4097f3d70ea0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:41.390466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf5d489-322b-4c69-9d06-4097f3d70ea0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:41.391186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf5d489-322b-4c69-9d06-4097f3d70ea0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:41.391644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf5d489-322b-4c69-9d06-4097f3d70ea0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:41.392074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf5d489-322b-4c69-9d06-4097f3d70ea0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:41.452056 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6bf5d489-322b-4c69-9d06-4097f3d70ea0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:41.460132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6bf5d489-322b-4c69-9d06-4097f3d70ea0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082091 Sep 02 10:04:41.460709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 979/2037] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:42.479904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-27999759-f7df-4e72-83bf-ea39012158b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:42.480495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-27999759-f7df-4e72-83bf-ea39012158b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:42.486881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27999759-f7df-4e72-83bf-ea39012158b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:42.487367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27999759-f7df-4e72-83bf-ea39012158b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:42.487803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27999759-f7df-4e72-83bf-ea39012158b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:42.488479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27999759-f7df-4e72-83bf-ea39012158b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:42.488925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27999759-f7df-4e72-83bf-ea39012158b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:42.489345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27999759-f7df-4e72-83bf-ea39012158b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:42.549749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-27999759-f7df-4e72-83bf-ea39012158b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:42.558307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-27999759-f7df-4e72-83bf-ea39012158b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082315 Sep 02 10:04:42.558899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1059/2038] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:43.579048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9a215a37-53d1-48aa-8c48-2253722676b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:43.579674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9a215a37-53d1-48aa-8c48-2253722676b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:43.586527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a215a37-53d1-48aa-8c48-2253722676b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:43.587032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a215a37-53d1-48aa-8c48-2253722676b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:43.587461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a215a37-53d1-48aa-8c48-2253722676b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:43.588138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a215a37-53d1-48aa-8c48-2253722676b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:43.588586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a215a37-53d1-48aa-8c48-2253722676b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:43.589002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9a215a37-53d1-48aa-8c48-2253722676b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:43.650818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9a215a37-53d1-48aa-8c48-2253722676b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:43.658897 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9a215a37-53d1-48aa-8c48-2253722676b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083669 Sep 02 10:04:43.659460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 980/2039] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:44.680548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-99d8e844-2315-4aa7-b32e-2cf95524d1f5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:44.681151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-99d8e844-2315-4aa7-b32e-2cf95524d1f5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:44.687622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99d8e844-2315-4aa7-b32e-2cf95524d1f5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:44.688100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99d8e844-2315-4aa7-b32e-2cf95524d1f5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:44.688532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99d8e844-2315-4aa7-b32e-2cf95524d1f5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:44.689205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99d8e844-2315-4aa7-b32e-2cf95524d1f5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:44.689650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99d8e844-2315-4aa7-b32e-2cf95524d1f5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:44.690068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-99d8e844-2315-4aa7-b32e-2cf95524d1f5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:44.750350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-99d8e844-2315-4aa7-b32e-2cf95524d1f5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:44.758324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-99d8e844-2315-4aa7-b32e-2cf95524d1f5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082217 Sep 02 10:04:44.758908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1060/2040] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:45.778955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-351b0a87-fb50-4cad-8977-06d141e6551f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:45.779613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-351b0a87-fb50-4cad-8977-06d141e6551f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:45.785953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-351b0a87-fb50-4cad-8977-06d141e6551f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:45.786430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-351b0a87-fb50-4cad-8977-06d141e6551f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:45.786897 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-351b0a87-fb50-4cad-8977-06d141e6551f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:45.790294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-351b0a87-fb50-4cad-8977-06d141e6551f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:45.790294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-351b0a87-fb50-4cad-8977-06d141e6551f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:45.790294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-351b0a87-fb50-4cad-8977-06d141e6551f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:45.849667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-351b0a87-fb50-4cad-8977-06d141e6551f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:45.858575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-351b0a87-fb50-4cad-8977-06d141e6551f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083678 Sep 02 10:04:45.859161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 981/2041] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:04:46.879511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cafe85fc-9b90-477d-94d8-c201c03e9cd8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:46.880121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cafe85fc-9b90-477d-94d8-c201c03e9cd8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:46.887004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cafe85fc-9b90-477d-94d8-c201c03e9cd8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:46.887486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cafe85fc-9b90-477d-94d8-c201c03e9cd8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:46.887920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cafe85fc-9b90-477d-94d8-c201c03e9cd8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:46.888604 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cafe85fc-9b90-477d-94d8-c201c03e9cd8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:46.889055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cafe85fc-9b90-477d-94d8-c201c03e9cd8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:46.889487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cafe85fc-9b90-477d-94d8-c201c03e9cd8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:46.950610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cafe85fc-9b90-477d-94d8-c201c03e9cd8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:46.958826 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cafe85fc-9b90-477d-94d8-c201c03e9cd8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083174 Sep 02 10:04:46.959389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1061/2042] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:47.979590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-534b20c0-06ea-480c-a636-5a81a7dcfc67 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:47.980127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-534b20c0-06ea-480c-a636-5a81a7dcfc67 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:47.986490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534b20c0-06ea-480c-a636-5a81a7dcfc67 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:47.987007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534b20c0-06ea-480c-a636-5a81a7dcfc67 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:47.987438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534b20c0-06ea-480c-a636-5a81a7dcfc67 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:47.988118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534b20c0-06ea-480c-a636-5a81a7dcfc67 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:47.988565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534b20c0-06ea-480c-a636-5a81a7dcfc67 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:47.988982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-534b20c0-06ea-480c-a636-5a81a7dcfc67 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:48.052365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-534b20c0-06ea-480c-a636-5a81a7dcfc67 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:48.060482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-534b20c0-06ea-480c-a636-5a81a7dcfc67 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085455 Sep 02 10:04:48.061040 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 982/2043] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:49.080881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-025f294a-9297-4ec8-acbe-4457e02e2790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:49.081486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-025f294a-9297-4ec8-acbe-4457e02e2790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:49.087953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-025f294a-9297-4ec8-acbe-4457e02e2790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:49.088433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-025f294a-9297-4ec8-acbe-4457e02e2790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:49.088862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-025f294a-9297-4ec8-acbe-4457e02e2790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:49.089540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-025f294a-9297-4ec8-acbe-4457e02e2790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:49.089988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-025f294a-9297-4ec8-acbe-4457e02e2790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:49.090409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-025f294a-9297-4ec8-acbe-4457e02e2790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:49.154859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-025f294a-9297-4ec8-acbe-4457e02e2790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:49.163443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-025f294a-9297-4ec8-acbe-4457e02e2790 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085858 Sep 02 10:04:49.164001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1062/2044] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:50.183696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-81cbc4c6-ce9d-4567-af15-a1b401564db5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:50.184312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-81cbc4c6-ce9d-4567-af15-a1b401564db5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:50.190847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81cbc4c6-ce9d-4567-af15-a1b401564db5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:50.191328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81cbc4c6-ce9d-4567-af15-a1b401564db5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:50.191763 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81cbc4c6-ce9d-4567-af15-a1b401564db5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:50.192446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81cbc4c6-ce9d-4567-af15-a1b401564db5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:50.192920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81cbc4c6-ce9d-4567-af15-a1b401564db5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:50.193344 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81cbc4c6-ce9d-4567-af15-a1b401564db5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:50.255461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-81cbc4c6-ce9d-4567-af15-a1b401564db5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:50.263551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-81cbc4c6-ce9d-4567-af15-a1b401564db5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083732 Sep 02 10:04:50.264125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 983/2045] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:51.284133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-25b0984e-cc86-4f95-9c4f-4b04367ef0d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:51.284683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-25b0984e-cc86-4f95-9c4f-4b04367ef0d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:51.291628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0984e-cc86-4f95-9c4f-4b04367ef0d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:51.292115 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0984e-cc86-4f95-9c4f-4b04367ef0d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:51.292552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0984e-cc86-4f95-9c4f-4b04367ef0d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:51.293233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0984e-cc86-4f95-9c4f-4b04367ef0d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:51.293687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0984e-cc86-4f95-9c4f-4b04367ef0d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:51.294113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-25b0984e-cc86-4f95-9c4f-4b04367ef0d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:51.297992 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=88 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:04:51.354061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-25b0984e-cc86-4f95-9c4f-4b04367ef0d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:51.362208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-25b0984e-cc86-4f95-9c4f-4b04367ef0d0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082034 Sep 02 10:04:51.362789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1063/2046] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:52.383929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d7c625ba-a265-4512-a0a4-33da82945957 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:52.384540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d7c625ba-a265-4512-a0a4-33da82945957 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:52.391049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c625ba-a265-4512-a0a4-33da82945957 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:52.391526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c625ba-a265-4512-a0a4-33da82945957 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:52.391958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c625ba-a265-4512-a0a4-33da82945957 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:52.392677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c625ba-a265-4512-a0a4-33da82945957 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:52.393130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c625ba-a265-4512-a0a4-33da82945957 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:52.393549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d7c625ba-a265-4512-a0a4-33da82945957 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:52.454766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d7c625ba-a265-4512-a0a4-33da82945957 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:52.463141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d7c625ba-a265-4512-a0a4-33da82945957 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083642 Sep 02 10:04:52.463706 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 984/2047] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:53.483145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b2bd323c-9a1b-453c-a9a1-ba94ccb0ae51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:53.483677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b2bd323c-9a1b-453c-a9a1-ba94ccb0ae51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:53.485924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=30 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:04:53.490537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2bd323c-9a1b-453c-a9a1-ba94ccb0ae51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:53.491043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2bd323c-9a1b-453c-a9a1-ba94ccb0ae51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:53.495919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2bd323c-9a1b-453c-a9a1-ba94ccb0ae51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:53.495919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2bd323c-9a1b-453c-a9a1-ba94ccb0ae51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:53.495919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2bd323c-9a1b-453c-a9a1-ba94ccb0ae51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:53.495919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b2bd323c-9a1b-453c-a9a1-ba94ccb0ae51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:53.553805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b2bd323c-9a1b-453c-a9a1-ba94ccb0ae51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:53.561830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b2bd323c-9a1b-453c-a9a1-ba94ccb0ae51 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082643 Sep 02 10:04:53.562382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1064/2048] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:54.583283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c87b8a3b-e8d2-4597-80c1-a3810cfa0bf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:54.583890 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c87b8a3b-e8d2-4597-80c1-a3810cfa0bf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:54.590821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c87b8a3b-e8d2-4597-80c1-a3810cfa0bf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:54.591307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c87b8a3b-e8d2-4597-80c1-a3810cfa0bf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:54.591746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c87b8a3b-e8d2-4597-80c1-a3810cfa0bf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:54.592430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c87b8a3b-e8d2-4597-80c1-a3810cfa0bf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:54.592885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c87b8a3b-e8d2-4597-80c1-a3810cfa0bf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:54.593310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c87b8a3b-e8d2-4597-80c1-a3810cfa0bf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:54.654079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c87b8a3b-e8d2-4597-80c1-a3810cfa0bf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:54.662172 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c87b8a3b-e8d2-4597-80c1-a3810cfa0bf3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082737 Sep 02 10:04:54.663425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 985/2049] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:55.683993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-feb525c4-be40-4076-bc6d-fa0c4a912218 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:55.684610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-feb525c4-be40-4076-bc6d-fa0c4a912218 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:55.691278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feb525c4-be40-4076-bc6d-fa0c4a912218 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:55.691763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feb525c4-be40-4076-bc6d-fa0c4a912218 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:55.692206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feb525c4-be40-4076-bc6d-fa0c4a912218 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:55.692896 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feb525c4-be40-4076-bc6d-fa0c4a912218 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:55.693355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feb525c4-be40-4076-bc6d-fa0c4a912218 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:55.693785 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-feb525c4-be40-4076-bc6d-fa0c4a912218 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:55.755198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-feb525c4-be40-4076-bc6d-fa0c4a912218 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:55.763517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-feb525c4-be40-4076-bc6d-fa0c4a912218 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083410 Sep 02 10:04:55.764073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1065/2050] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:56.784353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6659421c-d22b-492e-8fec-9475ca85f1da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:56.784957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6659421c-d22b-492e-8fec-9475ca85f1da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:56.791444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6659421c-d22b-492e-8fec-9475ca85f1da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:56.793229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6659421c-d22b-492e-8fec-9475ca85f1da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:56.793229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6659421c-d22b-492e-8fec-9475ca85f1da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:56.793229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6659421c-d22b-492e-8fec-9475ca85f1da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:56.793583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6659421c-d22b-492e-8fec-9475ca85f1da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:56.793860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6659421c-d22b-492e-8fec-9475ca85f1da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:56.857513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6659421c-d22b-492e-8fec-9475ca85f1da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:56.866459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6659421c-d22b-492e-8fec-9475ca85f1da tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085518 Sep 02 10:04:56.867595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 986/2051] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:57.887434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-873aa45a-7c84-49c4-b3c8-58bed4dfbdc6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:57.888043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-873aa45a-7c84-49c4-b3c8-58bed4dfbdc6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:57.894722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-873aa45a-7c84-49c4-b3c8-58bed4dfbdc6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:57.895236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-873aa45a-7c84-49c4-b3c8-58bed4dfbdc6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:57.895652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-873aa45a-7c84-49c4-b3c8-58bed4dfbdc6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:57.896326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-873aa45a-7c84-49c4-b3c8-58bed4dfbdc6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:57.897281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-873aa45a-7c84-49c4-b3c8-58bed4dfbdc6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:57.897708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-873aa45a-7c84-49c4-b3c8-58bed4dfbdc6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:57.961666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-873aa45a-7c84-49c4-b3c8-58bed4dfbdc6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:57.970011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-873aa45a-7c84-49c4-b3c8-58bed4dfbdc6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086442 Sep 02 10:04:57.970597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1066/2052] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:04:58.990787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-95f720d2-7413-4cb2-a04a-93b450ec10f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:04:58.991388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-95f720d2-7413-4cb2-a04a-93b450ec10f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:04:58.993698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=30 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:04:58.998678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f720d2-7413-4cb2-a04a-93b450ec10f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:58.999306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f720d2-7413-4cb2-a04a-93b450ec10f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:58.999792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f720d2-7413-4cb2-a04a-93b450ec10f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:59.000469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f720d2-7413-4cb2-a04a-93b450ec10f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:04:59.000914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f720d2-7413-4cb2-a04a-93b450ec10f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:04:59.001332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-95f720d2-7413-4cb2-a04a-93b450ec10f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:04:59.065436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-95f720d2-7413-4cb2-a04a-93b450ec10f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:04:59.074129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-95f720d2-7413-4cb2-a04a-93b450ec10f2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087360 Sep 02 10:04:59.074752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 987/2053] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:04:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:00.094892 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3dcace4b-becf-4395-bc1a-586b63e4fc22 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:00.095501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3dcace4b-becf-4395-bc1a-586b63e4fc22 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:00.102560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3dcace4b-becf-4395-bc1a-586b63e4fc22 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:00.103006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3dcace4b-becf-4395-bc1a-586b63e4fc22 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:00.103439 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3dcace4b-becf-4395-bc1a-586b63e4fc22 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:00.104118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3dcace4b-becf-4395-bc1a-586b63e4fc22 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:00.104564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3dcace4b-becf-4395-bc1a-586b63e4fc22 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:00.104983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3dcace4b-becf-4395-bc1a-586b63e4fc22 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:00.165359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3dcace4b-becf-4395-bc1a-586b63e4fc22 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:00.173413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3dcace4b-becf-4395-bc1a-586b63e4fc22 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082407 Sep 02 10:05:00.173982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1067/2054] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:01.194252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c71ea8cd-f8f1-4685-82fd-b4c2b5fac4f7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:01.194842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c71ea8cd-f8f1-4685-82fd-b4c2b5fac4f7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:01.201313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c71ea8cd-f8f1-4685-82fd-b4c2b5fac4f7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:01.201791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c71ea8cd-f8f1-4685-82fd-b4c2b5fac4f7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:01.202225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c71ea8cd-f8f1-4685-82fd-b4c2b5fac4f7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:01.202947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c71ea8cd-f8f1-4685-82fd-b4c2b5fac4f7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:01.203403 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c71ea8cd-f8f1-4685-82fd-b4c2b5fac4f7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:01.203832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c71ea8cd-f8f1-4685-82fd-b4c2b5fac4f7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:01.206354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=90 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:05:01.264820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c71ea8cd-f8f1-4685-82fd-b4c2b5fac4f7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:01.273421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c71ea8cd-f8f1-4685-82fd-b4c2b5fac4f7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083158 Sep 02 10:05:01.273994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 988/2055] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:02.293508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-41dbdcca-ec8c-45bd-b0bc-7e9fb0099af6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:02.294118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-41dbdcca-ec8c-45bd-b0bc-7e9fb0099af6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:02.302116 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41dbdcca-ec8c-45bd-b0bc-7e9fb0099af6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:02.302601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41dbdcca-ec8c-45bd-b0bc-7e9fb0099af6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:02.303652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41dbdcca-ec8c-45bd-b0bc-7e9fb0099af6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:02.304343 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41dbdcca-ec8c-45bd-b0bc-7e9fb0099af6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:02.304795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41dbdcca-ec8c-45bd-b0bc-7e9fb0099af6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:02.305249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-41dbdcca-ec8c-45bd-b0bc-7e9fb0099af6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:02.371201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-41dbdcca-ec8c-45bd-b0bc-7e9fb0099af6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:02.380008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-41dbdcca-ec8c-45bd-b0bc-7e9fb0099af6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.090169 Sep 02 10:05:02.380327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1068/2056] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:03.401831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-836373db-ff37-4acf-951d-1890e18a0955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:03.402443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-836373db-ff37-4acf-951d-1890e18a0955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:03.408551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-836373db-ff37-4acf-951d-1890e18a0955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:03.409024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-836373db-ff37-4acf-951d-1890e18a0955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:03.409465 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-836373db-ff37-4acf-951d-1890e18a0955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:03.410153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-836373db-ff37-4acf-951d-1890e18a0955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:03.410611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-836373db-ff37-4acf-951d-1890e18a0955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:03.411067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-836373db-ff37-4acf-951d-1890e18a0955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:03.470734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-836373db-ff37-4acf-951d-1890e18a0955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:03.478896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-836373db-ff37-4acf-951d-1890e18a0955 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081492 Sep 02 10:05:03.479474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 989/2057] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:04.499904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f88ceb00-1df3-4a2e-a030-abea902336fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:04.500506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f88ceb00-1df3-4a2e-a030-abea902336fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:04.506748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f88ceb00-1df3-4a2e-a030-abea902336fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:04.507232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f88ceb00-1df3-4a2e-a030-abea902336fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:04.507672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f88ceb00-1df3-4a2e-a030-abea902336fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:04.508350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f88ceb00-1df3-4a2e-a030-abea902336fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:04.508797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f88ceb00-1df3-4a2e-a030-abea902336fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:04.509216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f88ceb00-1df3-4a2e-a030-abea902336fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:04.572549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f88ceb00-1df3-4a2e-a030-abea902336fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:04.580565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f88ceb00-1df3-4a2e-a030-abea902336fd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084799 Sep 02 10:05:04.581117 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1069/2058] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:05.601648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3098d540-5820-4084-9200-0b2b146284d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:05.602240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3098d540-5820-4084-9200-0b2b146284d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:05.608634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3098d540-5820-4084-9200-0b2b146284d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:05.609108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3098d540-5820-4084-9200-0b2b146284d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:05.609539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3098d540-5820-4084-9200-0b2b146284d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:05.610213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3098d540-5820-4084-9200-0b2b146284d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:05.610661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3098d540-5820-4084-9200-0b2b146284d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:05.611103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3098d540-5820-4084-9200-0b2b146284d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:05.674965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3098d540-5820-4084-9200-0b2b146284d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:05.683905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3098d540-5820-4084-9200-0b2b146284d2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086687 Sep 02 10:05:05.684472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 990/2059] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:06.704919 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-144cd9ad-aefa-4296-a1dc-0636b6a63048 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:06.705527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-144cd9ad-aefa-4296-a1dc-0636b6a63048 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:06.712012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-144cd9ad-aefa-4296-a1dc-0636b6a63048 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:06.712489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-144cd9ad-aefa-4296-a1dc-0636b6a63048 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:06.712916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-144cd9ad-aefa-4296-a1dc-0636b6a63048 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:06.713618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-144cd9ad-aefa-4296-a1dc-0636b6a63048 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:06.714062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-144cd9ad-aefa-4296-a1dc-0636b6a63048 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:06.714478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-144cd9ad-aefa-4296-a1dc-0636b6a63048 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:06.775803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-144cd9ad-aefa-4296-a1dc-0636b6a63048 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:06.783951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-144cd9ad-aefa-4296-a1dc-0636b6a63048 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082886 Sep 02 10:05:06.784509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1070/2060] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:07.804559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3178b300-5b60-488f-948e-76585a83fc7d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:07.805170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3178b300-5b60-488f-948e-76585a83fc7d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:07.811599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3178b300-5b60-488f-948e-76585a83fc7d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:07.812078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3178b300-5b60-488f-948e-76585a83fc7d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:07.812516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3178b300-5b60-488f-948e-76585a83fc7d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:07.813197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3178b300-5b60-488f-948e-76585a83fc7d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:07.813676 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3178b300-5b60-488f-948e-76585a83fc7d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:07.814102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3178b300-5b60-488f-948e-76585a83fc7d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:07.875734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3178b300-5b60-488f-948e-76585a83fc7d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:07.884354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3178b300-5b60-488f-948e-76585a83fc7d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083657 Sep 02 10:05:07.884933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 991/2061] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:08.905605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-20fe7571-127d-43a8-be55-011274ce2c57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:08.906151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-20fe7571-127d-43a8-be55-011274ce2c57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:08.912753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20fe7571-127d-43a8-be55-011274ce2c57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:08.913234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20fe7571-127d-43a8-be55-011274ce2c57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:08.913672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20fe7571-127d-43a8-be55-011274ce2c57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:08.914359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20fe7571-127d-43a8-be55-011274ce2c57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:08.914835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20fe7571-127d-43a8-be55-011274ce2c57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:08.915265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-20fe7571-127d-43a8-be55-011274ce2c57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:08.975286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-20fe7571-127d-43a8-be55-011274ce2c57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:08.983357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-20fe7571-127d-43a8-be55-011274ce2c57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081821 Sep 02 10:05:08.983906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1071/2062] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:10.004977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a177e619-55c7-4d64-a755-5b77d0ed9206 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:10.005586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a177e619-55c7-4d64-a755-5b77d0ed9206 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:10.012634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a177e619-55c7-4d64-a755-5b77d0ed9206 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:10.013113 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a177e619-55c7-4d64-a755-5b77d0ed9206 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:10.013553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a177e619-55c7-4d64-a755-5b77d0ed9206 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:10.014242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a177e619-55c7-4d64-a755-5b77d0ed9206 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:10.014817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a177e619-55c7-4d64-a755-5b77d0ed9206 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:10.015132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a177e619-55c7-4d64-a755-5b77d0ed9206 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:10.076823 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a177e619-55c7-4d64-a755-5b77d0ed9206 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:10.084995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a177e619-55c7-4d64-a755-5b77d0ed9206 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083941 Sep 02 10:05:10.085555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 992/2063] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:11.106008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-18c2479f-91c6-4114-8317-40741ae58bbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:11.106545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-18c2479f-91c6-4114-8317-40741ae58bbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:11.112995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c2479f-91c6-4114-8317-40741ae58bbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:11.113477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c2479f-91c6-4114-8317-40741ae58bbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:11.113904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c2479f-91c6-4114-8317-40741ae58bbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:11.114580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c2479f-91c6-4114-8317-40741ae58bbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:11.115065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c2479f-91c6-4114-8317-40741ae58bbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:11.116054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-18c2479f-91c6-4114-8317-40741ae58bbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:11.176907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-18c2479f-91c6-4114-8317-40741ae58bbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:11.185664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-18c2479f-91c6-4114-8317-40741ae58bbe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083609 Sep 02 10:05:11.186228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1072/2064] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:12.206558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-60f4f650-04f1-407c-9cc4-997b64b900ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:12.207130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-60f4f650-04f1-407c-9cc4-997b64b900ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:12.213640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60f4f650-04f1-407c-9cc4-997b64b900ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:12.214124 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60f4f650-04f1-407c-9cc4-997b64b900ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:12.214558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60f4f650-04f1-407c-9cc4-997b64b900ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:12.215267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60f4f650-04f1-407c-9cc4-997b64b900ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:12.215719 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60f4f650-04f1-407c-9cc4-997b64b900ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:12.216142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60f4f650-04f1-407c-9cc4-997b64b900ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:12.278211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-60f4f650-04f1-407c-9cc4-997b64b900ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:12.286354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-60f4f650-04f1-407c-9cc4-997b64b900ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083782 Sep 02 10:05:12.286950 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 993/2065] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:13.306641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-13247cab-da4b-476a-870f-e93a2f50a0d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:13.307207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-13247cab-da4b-476a-870f-e93a2f50a0d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:13.313608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-13247cab-da4b-476a-870f-e93a2f50a0d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:13.314096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-13247cab-da4b-476a-870f-e93a2f50a0d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:13.314540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-13247cab-da4b-476a-870f-e93a2f50a0d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:13.315256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-13247cab-da4b-476a-870f-e93a2f50a0d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:13.315714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-13247cab-da4b-476a-870f-e93a2f50a0d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:13.316182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-13247cab-da4b-476a-870f-e93a2f50a0d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:13.378480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-13247cab-da4b-476a-870f-e93a2f50a0d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:13.387083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-13247cab-da4b-476a-870f-e93a2f50a0d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084361 Sep 02 10:05:13.387652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1073/2066] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:14.408197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-173f91c0-bc4c-4817-8269-382b61e5c875 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:14.408836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-173f91c0-bc4c-4817-8269-382b61e5c875 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:14.415720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-173f91c0-bc4c-4817-8269-382b61e5c875 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:14.416198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-173f91c0-bc4c-4817-8269-382b61e5c875 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:14.416638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-173f91c0-bc4c-4817-8269-382b61e5c875 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:14.417321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-173f91c0-bc4c-4817-8269-382b61e5c875 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:14.417772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-173f91c0-bc4c-4817-8269-382b61e5c875 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:14.418195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-173f91c0-bc4c-4817-8269-382b61e5c875 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:14.481549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-173f91c0-bc4c-4817-8269-382b61e5c875 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:14.489671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-173f91c0-bc4c-4817-8269-382b61e5c875 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085364 Sep 02 10:05:14.490233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 994/2067] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:15.510921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e9b27e6c-a6b2-493b-8928-0345acbe02be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:15.511536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e9b27e6c-a6b2-493b-8928-0345acbe02be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:15.517988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9b27e6c-a6b2-493b-8928-0345acbe02be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:15.518472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9b27e6c-a6b2-493b-8928-0345acbe02be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:15.518954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9b27e6c-a6b2-493b-8928-0345acbe02be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:15.519641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9b27e6c-a6b2-493b-8928-0345acbe02be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:15.520094 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9b27e6c-a6b2-493b-8928-0345acbe02be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:15.520516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9b27e6c-a6b2-493b-8928-0345acbe02be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:15.580269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e9b27e6c-a6b2-493b-8928-0345acbe02be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:15.588342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e9b27e6c-a6b2-493b-8928-0345acbe02be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081369 Sep 02 10:05:15.588897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1074/2068] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:16.609341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-eec5eab7-f27f-433d-ae6f-e45e36304925 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:16.609952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-eec5eab7-f27f-433d-ae6f-e45e36304925 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:16.617194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eec5eab7-f27f-433d-ae6f-e45e36304925 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:16.617675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eec5eab7-f27f-433d-ae6f-e45e36304925 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:16.618112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eec5eab7-f27f-433d-ae6f-e45e36304925 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:16.618827 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eec5eab7-f27f-433d-ae6f-e45e36304925 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:16.619283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eec5eab7-f27f-433d-ae6f-e45e36304925 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:16.619705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eec5eab7-f27f-433d-ae6f-e45e36304925 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:16.680092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-eec5eab7-f27f-433d-ae6f-e45e36304925 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:16.688159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-eec5eab7-f27f-433d-ae6f-e45e36304925 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082680 Sep 02 10:05:16.688723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 995/2069] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:17.709324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-226eb0d9-e2d3-4453-8806-b49943eaac8a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:17.709941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-226eb0d9-e2d3-4453-8806-b49943eaac8a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:17.719865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-226eb0d9-e2d3-4453-8806-b49943eaac8a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:17.719865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-226eb0d9-e2d3-4453-8806-b49943eaac8a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:17.719865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-226eb0d9-e2d3-4453-8806-b49943eaac8a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:17.719865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-226eb0d9-e2d3-4453-8806-b49943eaac8a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:17.720325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-226eb0d9-e2d3-4453-8806-b49943eaac8a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:17.720325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-226eb0d9-e2d3-4453-8806-b49943eaac8a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:17.783989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-226eb0d9-e2d3-4453-8806-b49943eaac8a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:17.792386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-226eb0d9-e2d3-4453-8806-b49943eaac8a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086958 Sep 02 10:05:17.792949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1075/2070] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:18.813346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-64db078e-257c-4647-a5c6-1dc7bc407f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:18.813953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-64db078e-257c-4647-a5c6-1dc7bc407f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:18.822115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64db078e-257c-4647-a5c6-1dc7bc407f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:18.822592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64db078e-257c-4647-a5c6-1dc7bc407f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:18.823059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64db078e-257c-4647-a5c6-1dc7bc407f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:18.823741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64db078e-257c-4647-a5c6-1dc7bc407f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:18.824232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64db078e-257c-4647-a5c6-1dc7bc407f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:18.824651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-64db078e-257c-4647-a5c6-1dc7bc407f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:18.887227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-64db078e-257c-4647-a5c6-1dc7bc407f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:18.895367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-64db078e-257c-4647-a5c6-1dc7bc407f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086228 Sep 02 10:05:18.895921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 996/2071] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:19.916579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-58063f17-24a9-4e61-87a1-8e247ca5dff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:19.917237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-58063f17-24a9-4e61-87a1-8e247ca5dff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:19.923796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58063f17-24a9-4e61-87a1-8e247ca5dff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:19.924275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58063f17-24a9-4e61-87a1-8e247ca5dff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:19.924711 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58063f17-24a9-4e61-87a1-8e247ca5dff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:19.925388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58063f17-24a9-4e61-87a1-8e247ca5dff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:19.925836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58063f17-24a9-4e61-87a1-8e247ca5dff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:19.926255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58063f17-24a9-4e61-87a1-8e247ca5dff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:20.054609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-58063f17-24a9-4e61-87a1-8e247ca5dff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:20.061576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-58063f17-24a9-4e61-87a1-8e247ca5dff7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.148932 Sep 02 10:05:20.062173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1076/2072] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:21.081379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-804d5ef5-b9ec-4900-a1c3-2875eb90eec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:21.081992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-804d5ef5-b9ec-4900-a1c3-2875eb90eec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:21.089058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-804d5ef5-b9ec-4900-a1c3-2875eb90eec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:21.089545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-804d5ef5-b9ec-4900-a1c3-2875eb90eec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:21.089980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-804d5ef5-b9ec-4900-a1c3-2875eb90eec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:21.090686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-804d5ef5-b9ec-4900-a1c3-2875eb90eec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:21.091153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-804d5ef5-b9ec-4900-a1c3-2875eb90eec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:21.091576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-804d5ef5-b9ec-4900-a1c3-2875eb90eec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:21.152440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-804d5ef5-b9ec-4900-a1c3-2875eb90eec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:21.160685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-804d5ef5-b9ec-4900-a1c3-2875eb90eec7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083210 Sep 02 10:05:21.161234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 997/2073] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:22.181339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b09b04dc-75ca-4fb2-9497-9cb12f1a41a6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:22.181879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b09b04dc-75ca-4fb2-9497-9cb12f1a41a6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:22.188292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b09b04dc-75ca-4fb2-9497-9cb12f1a41a6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:22.188770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b09b04dc-75ca-4fb2-9497-9cb12f1a41a6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:22.189219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b09b04dc-75ca-4fb2-9497-9cb12f1a41a6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:22.189875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b09b04dc-75ca-4fb2-9497-9cb12f1a41a6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:22.190325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b09b04dc-75ca-4fb2-9497-9cb12f1a41a6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:22.190775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b09b04dc-75ca-4fb2-9497-9cb12f1a41a6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:22.193291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=84 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:05:22.255125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b09b04dc-75ca-4fb2-9497-9cb12f1a41a6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:22.263798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b09b04dc-75ca-4fb2-9497-9cb12f1a41a6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086932 Sep 02 10:05:22.264357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1077/2074] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:23.284373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-de4f350e-ea5b-4265-a599-22c7ab9682f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:23.284959 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-de4f350e-ea5b-4265-a599-22c7ab9682f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:23.291894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de4f350e-ea5b-4265-a599-22c7ab9682f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:23.292371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de4f350e-ea5b-4265-a599-22c7ab9682f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:23.292800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de4f350e-ea5b-4265-a599-22c7ab9682f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:23.293473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de4f350e-ea5b-4265-a599-22c7ab9682f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:23.293918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de4f350e-ea5b-4265-a599-22c7ab9682f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:23.294364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-de4f350e-ea5b-4265-a599-22c7ab9682f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:23.401051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-de4f350e-ea5b-4265-a599-22c7ab9682f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:23.409178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-de4f350e-ea5b-4265-a599-22c7ab9682f1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.128732 Sep 02 10:05:23.409743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 998/2075] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:05:24.429778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ab784169-71e4-467a-a4ca-b430084aa9dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:24.430385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ab784169-71e4-467a-a4ca-b430084aa9dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:24.432686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=28 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:05:24.437375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab784169-71e4-467a-a4ca-b430084aa9dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:24.437857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab784169-71e4-467a-a4ca-b430084aa9dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:24.438296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab784169-71e4-467a-a4ca-b430084aa9dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:24.439007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab784169-71e4-467a-a4ca-b430084aa9dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:24.439463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab784169-71e4-467a-a4ca-b430084aa9dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:24.439888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ab784169-71e4-467a-a4ca-b430084aa9dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:24.500640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ab784169-71e4-467a-a4ca-b430084aa9dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:24.509345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ab784169-71e4-467a-a4ca-b430084aa9dc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083915 Sep 02 10:05:24.509911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1078/2076] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:25.529815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c252619a-91e6-4472-962e-18945132666b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:25.530432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c252619a-91e6-4472-962e-18945132666b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:25.536925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c252619a-91e6-4472-962e-18945132666b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:25.537419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c252619a-91e6-4472-962e-18945132666b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:25.537835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c252619a-91e6-4472-962e-18945132666b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:25.538509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c252619a-91e6-4472-962e-18945132666b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:25.538990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c252619a-91e6-4472-962e-18945132666b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:25.539410 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c252619a-91e6-4472-962e-18945132666b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:25.599166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c252619a-91e6-4472-962e-18945132666b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:25.607264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c252619a-91e6-4472-962e-18945132666b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081389 Sep 02 10:05:25.607824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 999/2077] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:25 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:26.628357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a5c503df-f237-43a2-8a0e-3e10119ad16c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:26.628969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a5c503df-f237-43a2-8a0e-3e10119ad16c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:26.635404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5c503df-f237-43a2-8a0e-3e10119ad16c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:26.635890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5c503df-f237-43a2-8a0e-3e10119ad16c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:26.636326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5c503df-f237-43a2-8a0e-3e10119ad16c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:26.637010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5c503df-f237-43a2-8a0e-3e10119ad16c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:26.637467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5c503df-f237-43a2-8a0e-3e10119ad16c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:26.637893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a5c503df-f237-43a2-8a0e-3e10119ad16c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:26.698454 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a5c503df-f237-43a2-8a0e-3e10119ad16c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:26.706533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a5c503df-f237-43a2-8a0e-3e10119ad16c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082078 Sep 02 10:05:26.707132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1079/2078] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:26 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:27.729581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3d1d1885-b647-458b-9cff-dbb4de53bec5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:27.730185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3d1d1885-b647-458b-9cff-dbb4de53bec5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:27.736584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d1d1885-b647-458b-9cff-dbb4de53bec5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:27.737058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d1d1885-b647-458b-9cff-dbb4de53bec5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:27.737517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d1d1885-b647-458b-9cff-dbb4de53bec5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:27.738194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d1d1885-b647-458b-9cff-dbb4de53bec5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:27.738641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d1d1885-b647-458b-9cff-dbb4de53bec5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:27.739082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3d1d1885-b647-458b-9cff-dbb4de53bec5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:27.801353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3d1d1885-b647-458b-9cff-dbb4de53bec5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:27.810177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3d1d1885-b647-458b-9cff-dbb4de53bec5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084949 Sep 02 10:05:27.810750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1000/2079] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:28.830662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-592f3c05-b1a6-4843-9a63-9af98d99444f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:28.831308 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-592f3c05-b1a6-4843-9a63-9af98d99444f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:28.838250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-592f3c05-b1a6-4843-9a63-9af98d99444f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:28.838764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-592f3c05-b1a6-4843-9a63-9af98d99444f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:28.839205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-592f3c05-b1a6-4843-9a63-9af98d99444f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:28.839897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-592f3c05-b1a6-4843-9a63-9af98d99444f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:28.840356 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-592f3c05-b1a6-4843-9a63-9af98d99444f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:28.840781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-592f3c05-b1a6-4843-9a63-9af98d99444f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:28.902515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-592f3c05-b1a6-4843-9a63-9af98d99444f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:28.910607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-592f3c05-b1a6-4843-9a63-9af98d99444f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083943 Sep 02 10:05:28.911195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1080/2080] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:29.932191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9c5048bd-d100-49e7-b0e4-9a59c5bc2d9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:29.932829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9c5048bd-d100-49e7-b0e4-9a59c5bc2d9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:29.935252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:05:29.935400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:05:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 (ip 10.222.0.57) !!! Sep 02 10:05:29.936875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=28 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:05:29.942600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c5048bd-d100-49e7-b0e4-9a59c5bc2d9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:29.943546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c5048bd-d100-49e7-b0e4-9a59c5bc2d9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:29.943546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c5048bd-d100-49e7-b0e4-9a59c5bc2d9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:29.944195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c5048bd-d100-49e7-b0e4-9a59c5bc2d9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:29.944647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c5048bd-d100-49e7-b0e4-9a59c5bc2d9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:29.945069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c5048bd-d100-49e7-b0e4-9a59c5bc2d9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:30.007202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9c5048bd-d100-49e7-b0e4-9a59c5bc2d9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:30.015375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9c5048bd-d100-49e7-b0e4-9a59c5bc2d9c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087636 Sep 02 10:05:30.015943 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1001/2081] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:31.036464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b58c8ed9-55c5-4193-8a1f-871e639a1a13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:31.037084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b58c8ed9-55c5-4193-8a1f-871e639a1a13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:31.044077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b58c8ed9-55c5-4193-8a1f-871e639a1a13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:31.044556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b58c8ed9-55c5-4193-8a1f-871e639a1a13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:31.044990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b58c8ed9-55c5-4193-8a1f-871e639a1a13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:31.045664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b58c8ed9-55c5-4193-8a1f-871e639a1a13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:31.046111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b58c8ed9-55c5-4193-8a1f-871e639a1a13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:31.046533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b58c8ed9-55c5-4193-8a1f-871e639a1a13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:31.109576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b58c8ed9-55c5-4193-8a1f-871e639a1a13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:31.117820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b58c8ed9-55c5-4193-8a1f-871e639a1a13 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085542 Sep 02 10:05:31.118392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1081/2082] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:32.138770 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-30a16fc3-8c79-41cd-9075-909e2b7cb427 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:32.139321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-30a16fc3-8c79-41cd-9075-909e2b7cb427 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:32.145442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30a16fc3-8c79-41cd-9075-909e2b7cb427 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:32.145927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30a16fc3-8c79-41cd-9075-909e2b7cb427 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:32.146364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30a16fc3-8c79-41cd-9075-909e2b7cb427 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:32.147072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30a16fc3-8c79-41cd-9075-909e2b7cb427 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:32.147527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30a16fc3-8c79-41cd-9075-909e2b7cb427 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:32.147953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-30a16fc3-8c79-41cd-9075-909e2b7cb427 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:32.150469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=84 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:05:32.214328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-30a16fc3-8c79-41cd-9075-909e2b7cb427 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:32.222419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-30a16fc3-8c79-41cd-9075-909e2b7cb427 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087600 Sep 02 10:05:32.223021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1002/2083] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:33.244055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-54f47637-38ce-4d72-8e14-c9c759619aed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:33.244613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-54f47637-38ce-4d72-8e14-c9c759619aed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:33.251863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f47637-38ce-4d72-8e14-c9c759619aed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:33.252363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f47637-38ce-4d72-8e14-c9c759619aed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:33.252792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f47637-38ce-4d72-8e14-c9c759619aed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:33.253466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f47637-38ce-4d72-8e14-c9c759619aed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:33.253914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f47637-38ce-4d72-8e14-c9c759619aed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:33.254333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-54f47637-38ce-4d72-8e14-c9c759619aed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:33.316076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-54f47637-38ce-4d72-8e14-c9c759619aed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:33.324765 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-54f47637-38ce-4d72-8e14-c9c759619aed tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085238 Sep 02 10:05:33.325329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1082/2084] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:34.345361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-11f32d3c-1029-4603-aa60-11f6a2047aff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:34.346003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-11f32d3c-1029-4603-aa60-11f6a2047aff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:34.352593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f32d3c-1029-4603-aa60-11f6a2047aff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:34.353078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f32d3c-1029-4603-aa60-11f6a2047aff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:34.353513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f32d3c-1029-4603-aa60-11f6a2047aff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:34.354196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f32d3c-1029-4603-aa60-11f6a2047aff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:34.354647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f32d3c-1029-4603-aa60-11f6a2047aff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:34.355112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f32d3c-1029-4603-aa60-11f6a2047aff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:34.414919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-11f32d3c-1029-4603-aa60-11f6a2047aff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:34.422881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-11f32d3c-1029-4603-aa60-11f6a2047aff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081372 Sep 02 10:05:34.423456 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1003/2085] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:35.442774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3aa1b07f-fbe3-4bbc-b162-db6c1dfad4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:35.443389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3aa1b07f-fbe3-4bbc-b162-db6c1dfad4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:35.449786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aa1b07f-fbe3-4bbc-b162-db6c1dfad4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:35.450267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aa1b07f-fbe3-4bbc-b162-db6c1dfad4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:35.450719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aa1b07f-fbe3-4bbc-b162-db6c1dfad4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:35.451415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aa1b07f-fbe3-4bbc-b162-db6c1dfad4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:35.451869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aa1b07f-fbe3-4bbc-b162-db6c1dfad4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:35.452316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3aa1b07f-fbe3-4bbc-b162-db6c1dfad4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:35.513378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3aa1b07f-fbe3-4bbc-b162-db6c1dfad4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:35.521420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3aa1b07f-fbe3-4bbc-b162-db6c1dfad4d8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082542 Sep 02 10:05:35.522482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1083/2086] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:36.542167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-793088c2-aa5e-41f3-9a94-3b3939a4aec2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:36.542794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-793088c2-aa5e-41f3-9a94-3b3939a4aec2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:36.549234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-793088c2-aa5e-41f3-9a94-3b3939a4aec2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:36.549715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-793088c2-aa5e-41f3-9a94-3b3939a4aec2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:36.550146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-793088c2-aa5e-41f3-9a94-3b3939a4aec2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:36.550853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-793088c2-aa5e-41f3-9a94-3b3939a4aec2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:36.551304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-793088c2-aa5e-41f3-9a94-3b3939a4aec2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:36.551721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-793088c2-aa5e-41f3-9a94-3b3939a4aec2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:36.611896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-793088c2-aa5e-41f3-9a94-3b3939a4aec2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:36.620053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-793088c2-aa5e-41f3-9a94-3b3939a4aec2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081788 Sep 02 10:05:36.620630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1004/2087] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:36 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:37.640520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0b35badb-940c-43ae-890f-6a6af73247ff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:37.641108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0b35badb-940c-43ae-890f-6a6af73247ff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:37.647686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b35badb-940c-43ae-890f-6a6af73247ff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:37.648167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b35badb-940c-43ae-890f-6a6af73247ff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:37.648599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b35badb-940c-43ae-890f-6a6af73247ff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:37.649270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b35badb-940c-43ae-890f-6a6af73247ff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:37.649717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b35badb-940c-43ae-890f-6a6af73247ff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:37.650133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0b35badb-940c-43ae-890f-6a6af73247ff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:37.712127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0b35badb-940c-43ae-890f-6a6af73247ff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:37.720276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0b35badb-940c-43ae-890f-6a6af73247ff tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083575 Sep 02 10:05:37.720833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1084/2088] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:38.742022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e86d94e0-ff80-408d-ae3f-af667913d68a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:38.742636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e86d94e0-ff80-408d-ae3f-af667913d68a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:38.749520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e86d94e0-ff80-408d-ae3f-af667913d68a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:38.749999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e86d94e0-ff80-408d-ae3f-af667913d68a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:38.750428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e86d94e0-ff80-408d-ae3f-af667913d68a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:38.751143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e86d94e0-ff80-408d-ae3f-af667913d68a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:38.751585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e86d94e0-ff80-408d-ae3f-af667913d68a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:38.752004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e86d94e0-ff80-408d-ae3f-af667913d68a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:38.812929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e86d94e0-ff80-408d-ae3f-af667913d68a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:38.821392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e86d94e0-ff80-408d-ae3f-af667913d68a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083887 Sep 02 10:05:38.821974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1005/2089] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:39.842732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b81fe6b7-3d32-4ecb-ae70-fe41f56e6e04 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:39.843344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b81fe6b7-3d32-4ecb-ae70-fe41f56e6e04 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:39.849954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b81fe6b7-3d32-4ecb-ae70-fe41f56e6e04 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:39.850438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b81fe6b7-3d32-4ecb-ae70-fe41f56e6e04 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:39.850912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b81fe6b7-3d32-4ecb-ae70-fe41f56e6e04 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:39.851636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b81fe6b7-3d32-4ecb-ae70-fe41f56e6e04 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:39.852087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b81fe6b7-3d32-4ecb-ae70-fe41f56e6e04 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:39.852512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b81fe6b7-3d32-4ecb-ae70-fe41f56e6e04 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:39.916084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b81fe6b7-3d32-4ecb-ae70-fe41f56e6e04 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:39.924357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b81fe6b7-3d32-4ecb-ae70-fe41f56e6e04 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085519 Sep 02 10:05:39.924937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1085/2090] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:40.945357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7cc16861-f8cb-472d-8842-f1fe821ed6f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:40.945973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7cc16861-f8cb-472d-8842-f1fe821ed6f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:40.952498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cc16861-f8cb-472d-8842-f1fe821ed6f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:40.952983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cc16861-f8cb-472d-8842-f1fe821ed6f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:40.953424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cc16861-f8cb-472d-8842-f1fe821ed6f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:40.954109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cc16861-f8cb-472d-8842-f1fe821ed6f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:40.954567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cc16861-f8cb-472d-8842-f1fe821ed6f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:40.955022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7cc16861-f8cb-472d-8842-f1fe821ed6f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:41.021872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7cc16861-f8cb-472d-8842-f1fe821ed6f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:41.031036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7cc16861-f8cb-472d-8842-f1fe821ed6f9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.089461 Sep 02 10:05:41.031612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1006/2091] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:42.056379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-24f6dce5-c8d9-48a4-a6c1-a6a345731926 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:42.056997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-24f6dce5-c8d9-48a4-a6c1-a6a345731926 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:42.063642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24f6dce5-c8d9-48a4-a6c1-a6a345731926 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:42.064126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24f6dce5-c8d9-48a4-a6c1-a6a345731926 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:42.064570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24f6dce5-c8d9-48a4-a6c1-a6a345731926 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:42.065257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24f6dce5-c8d9-48a4-a6c1-a6a345731926 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:42.065705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24f6dce5-c8d9-48a4-a6c1-a6a345731926 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:42.066125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-24f6dce5-c8d9-48a4-a6c1-a6a345731926 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:42.126236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-24f6dce5-c8d9-48a4-a6c1-a6a345731926 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:42.134228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-24f6dce5-c8d9-48a4-a6c1-a6a345731926 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082327 Sep 02 10:05:42.134814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1086/2092] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:05:43.154665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e071b17-3046-41c6-abc4-0ad8c3b361c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:43.155234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e071b17-3046-41c6-abc4-0ad8c3b361c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:43.161698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e071b17-3046-41c6-abc4-0ad8c3b361c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:43.162182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e071b17-3046-41c6-abc4-0ad8c3b361c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:43.162619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e071b17-3046-41c6-abc4-0ad8c3b361c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:43.163408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e071b17-3046-41c6-abc4-0ad8c3b361c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:43.163864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e071b17-3046-41c6-abc4-0ad8c3b361c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:43.164288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e071b17-3046-41c6-abc4-0ad8c3b361c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:43.224502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1e071b17-3046-41c6-abc4-0ad8c3b361c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:43.233156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e071b17-3046-41c6-abc4-0ad8c3b361c6 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082437 Sep 02 10:05:43.233717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1007/2093] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:44.254746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-205abf60-034e-48f8-baa1-e856c938a27e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:44.255285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-205abf60-034e-48f8-baa1-e856c938a27e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:44.262621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-205abf60-034e-48f8-baa1-e856c938a27e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:44.263163 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-205abf60-034e-48f8-baa1-e856c938a27e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:44.263603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-205abf60-034e-48f8-baa1-e856c938a27e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:44.264291 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-205abf60-034e-48f8-baa1-e856c938a27e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:44.264751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-205abf60-034e-48f8-baa1-e856c938a27e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:44.265175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-205abf60-034e-48f8-baa1-e856c938a27e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:44.325505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-205abf60-034e-48f8-baa1-e856c938a27e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:44.333536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-205abf60-034e-48f8-baa1-e856c938a27e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082820 Sep 02 10:05:44.334096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1087/2094] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:45.355416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1bd83300-8562-4137-847c-995e6ee49179 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:45.356029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1bd83300-8562-4137-847c-995e6ee49179 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:45.362519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bd83300-8562-4137-847c-995e6ee49179 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:45.363031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bd83300-8562-4137-847c-995e6ee49179 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:45.363466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bd83300-8562-4137-847c-995e6ee49179 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:45.364146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bd83300-8562-4137-847c-995e6ee49179 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:45.364627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bd83300-8562-4137-847c-995e6ee49179 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:45.365048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1bd83300-8562-4137-847c-995e6ee49179 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:45.425010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1bd83300-8562-4137-847c-995e6ee49179 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:45.433085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1bd83300-8562-4137-847c-995e6ee49179 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082161 Sep 02 10:05:45.433651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1008/2095] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:46.453435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c7e3bd75-f05f-45d6-8f14-a65550369c20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:46.454053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c7e3bd75-f05f-45d6-8f14-a65550369c20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:46.460764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e3bd75-f05f-45d6-8f14-a65550369c20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:46.461244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e3bd75-f05f-45d6-8f14-a65550369c20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:46.461677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e3bd75-f05f-45d6-8f14-a65550369c20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:46.462358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e3bd75-f05f-45d6-8f14-a65550369c20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:46.462839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e3bd75-f05f-45d6-8f14-a65550369c20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:46.463264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c7e3bd75-f05f-45d6-8f14-a65550369c20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:46.525260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c7e3bd75-f05f-45d6-8f14-a65550369c20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:46.533253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c7e3bd75-f05f-45d6-8f14-a65550369c20 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083732 Sep 02 10:05:46.533817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1088/2096] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:46 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:47.554916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-070f590f-a322-45cf-99d9-d79984077af1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:47.555522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-070f590f-a322-45cf-99d9-d79984077af1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:47.561935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-070f590f-a322-45cf-99d9-d79984077af1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:47.562415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-070f590f-a322-45cf-99d9-d79984077af1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:47.562888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-070f590f-a322-45cf-99d9-d79984077af1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:47.563576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-070f590f-a322-45cf-99d9-d79984077af1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:47.564027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-070f590f-a322-45cf-99d9-d79984077af1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:47.564452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-070f590f-a322-45cf-99d9-d79984077af1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:47.624816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-070f590f-a322-45cf-99d9-d79984077af1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:47.633490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-070f590f-a322-45cf-99d9-d79984077af1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082998 Sep 02 10:05:47.634053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1009/2097] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:48.653947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-40ed0100-10b6-4226-92a0-b3b463867429 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:48.654552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-40ed0100-10b6-4226-92a0-b3b463867429 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:48.660984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40ed0100-10b6-4226-92a0-b3b463867429 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:48.661462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40ed0100-10b6-4226-92a0-b3b463867429 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:48.661893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40ed0100-10b6-4226-92a0-b3b463867429 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:48.662568 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40ed0100-10b6-4226-92a0-b3b463867429 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:48.663047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40ed0100-10b6-4226-92a0-b3b463867429 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:48.663471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-40ed0100-10b6-4226-92a0-b3b463867429 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:48.725313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-40ed0100-10b6-4226-92a0-b3b463867429 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:48.733562 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-40ed0100-10b6-4226-92a0-b3b463867429 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083523 Sep 02 10:05:48.734128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1089/2098] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:49.754886 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c35bdbc9-e2e8-474b-a89a-d6aa2ca9f815 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:49.755513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c35bdbc9-e2e8-474b-a89a-d6aa2ca9f815 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:49.761743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c35bdbc9-e2e8-474b-a89a-d6aa2ca9f815 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:49.762215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c35bdbc9-e2e8-474b-a89a-d6aa2ca9f815 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:49.762644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c35bdbc9-e2e8-474b-a89a-d6aa2ca9f815 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:49.763346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c35bdbc9-e2e8-474b-a89a-d6aa2ca9f815 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:49.764064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c35bdbc9-e2e8-474b-a89a-d6aa2ca9f815 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:49.764489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c35bdbc9-e2e8-474b-a89a-d6aa2ca9f815 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:49.831824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c35bdbc9-e2e8-474b-a89a-d6aa2ca9f815 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:49.837059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c35bdbc9-e2e8-474b-a89a-d6aa2ca9f815 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086202 Sep 02 10:05:49.837625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1010/2099] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:50.857778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9a09f373-a194-43f7-9d36-c3ba17e877f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:50.858397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9a09f373-a194-43f7-9d36-c3ba17e877f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:50.864873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a09f373-a194-43f7-9d36-c3ba17e877f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:50.865362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a09f373-a194-43f7-9d36-c3ba17e877f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:50.865809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a09f373-a194-43f7-9d36-c3ba17e877f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:50.866499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a09f373-a194-43f7-9d36-c3ba17e877f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:50.866982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a09f373-a194-43f7-9d36-c3ba17e877f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:50.867413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a09f373-a194-43f7-9d36-c3ba17e877f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:50.928331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9a09f373-a194-43f7-9d36-c3ba17e877f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:50.936715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9a09f373-a194-43f7-9d36-c3ba17e877f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082969 Sep 02 10:05:50.937297 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1090/2100] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:51.957454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f5e4fe1c-909c-4d11-ac97-baa2da77bbad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:51.962215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f5e4fe1c-909c-4d11-ac97-baa2da77bbad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:51.965087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5e4fe1c-909c-4d11-ac97-baa2da77bbad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:51.965565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5e4fe1c-909c-4d11-ac97-baa2da77bbad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:51.966064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5e4fe1c-909c-4d11-ac97-baa2da77bbad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:51.966771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5e4fe1c-909c-4d11-ac97-baa2da77bbad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:51.967223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5e4fe1c-909c-4d11-ac97-baa2da77bbad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:51.967645 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5e4fe1c-909c-4d11-ac97-baa2da77bbad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:52.029087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f5e4fe1c-909c-4d11-ac97-baa2da77bbad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:52.037257 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f5e4fe1c-909c-4d11-ac97-baa2da77bbad tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083746 Sep 02 10:05:52.037841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1011/2101] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:53.058842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-49fff950-e873-49b1-a4ae-c7e0019b596e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:53.059448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-49fff950-e873-49b1-a4ae-c7e0019b596e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:53.065708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49fff950-e873-49b1-a4ae-c7e0019b596e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:53.066187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49fff950-e873-49b1-a4ae-c7e0019b596e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:53.066621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49fff950-e873-49b1-a4ae-c7e0019b596e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:53.067326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49fff950-e873-49b1-a4ae-c7e0019b596e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:53.067776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49fff950-e873-49b1-a4ae-c7e0019b596e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:53.068199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-49fff950-e873-49b1-a4ae-c7e0019b596e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:53.070727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=84 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:05:53.130231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-49fff950-e873-49b1-a4ae-c7e0019b596e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:53.138470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-49fff950-e873-49b1-a4ae-c7e0019b596e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084169 Sep 02 10:05:53.139263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1091/2102] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:54.158850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e27c2e02-b005-4935-b170-a7037a947ca5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:54.159399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e27c2e02-b005-4935-b170-a7037a947ca5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:54.165908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e27c2e02-b005-4935-b170-a7037a947ca5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:54.166394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e27c2e02-b005-4935-b170-a7037a947ca5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:54.166859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e27c2e02-b005-4935-b170-a7037a947ca5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:54.167548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e27c2e02-b005-4935-b170-a7037a947ca5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:54.168002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e27c2e02-b005-4935-b170-a7037a947ca5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:54.168432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e27c2e02-b005-4935-b170-a7037a947ca5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:54.228641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e27c2e02-b005-4935-b170-a7037a947ca5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:54.236874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e27c2e02-b005-4935-b170-a7037a947ca5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081987 Sep 02 10:05:54.237445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1012/2103] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:55.258235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-45161d9f-8a14-4d90-8324-8a698df64516 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:55.259358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-45161d9f-8a14-4d90-8324-8a698df64516 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:55.261682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=28 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:05:55.266349 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-45161d9f-8a14-4d90-8324-8a698df64516 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:55.266864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-45161d9f-8a14-4d90-8324-8a698df64516 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:55.267300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-45161d9f-8a14-4d90-8324-8a698df64516 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:55.267977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-45161d9f-8a14-4d90-8324-8a698df64516 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:55.268425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-45161d9f-8a14-4d90-8324-8a698df64516 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:55.268843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-45161d9f-8a14-4d90-8324-8a698df64516 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:55.329552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-45161d9f-8a14-4d90-8324-8a698df64516 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:55.338323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-45161d9f-8a14-4d90-8324-8a698df64516 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083917 Sep 02 10:05:55.338899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1092/2104] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:56.358626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-27f0cc71-7582-44eb-ac62-467743333748 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:56.359263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-27f0cc71-7582-44eb-ac62-467743333748 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:56.365724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27f0cc71-7582-44eb-ac62-467743333748 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:56.366202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27f0cc71-7582-44eb-ac62-467743333748 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:56.366633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27f0cc71-7582-44eb-ac62-467743333748 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:56.367330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27f0cc71-7582-44eb-ac62-467743333748 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:56.368274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27f0cc71-7582-44eb-ac62-467743333748 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:56.368689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-27f0cc71-7582-44eb-ac62-467743333748 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:56.429751 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-27f0cc71-7582-44eb-ac62-467743333748 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:56.438346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-27f0cc71-7582-44eb-ac62-467743333748 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083528 Sep 02 10:05:56.438937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1013/2105] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:57.459358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-387eb976-018c-4006-adeb-522e09322ff5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:57.459970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-387eb976-018c-4006-adeb-522e09322ff5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:57.467043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387eb976-018c-4006-adeb-522e09322ff5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:57.467526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387eb976-018c-4006-adeb-522e09322ff5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:57.467965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387eb976-018c-4006-adeb-522e09322ff5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:57.468646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387eb976-018c-4006-adeb-522e09322ff5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:57.469099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387eb976-018c-4006-adeb-522e09322ff5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:57.469524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-387eb976-018c-4006-adeb-522e09322ff5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:57.532169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-387eb976-018c-4006-adeb-522e09322ff5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:57.540353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-387eb976-018c-4006-adeb-522e09322ff5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084888 Sep 02 10:05:57.540921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1093/2106] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:57 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:58.561489 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6097bd97-bd88-477d-b9ac-e59ba99edb57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:58.562103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6097bd97-bd88-477d-b9ac-e59ba99edb57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:58.568578 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6097bd97-bd88-477d-b9ac-e59ba99edb57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:58.569062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6097bd97-bd88-477d-b9ac-e59ba99edb57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:58.569500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6097bd97-bd88-477d-b9ac-e59ba99edb57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:58.570184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6097bd97-bd88-477d-b9ac-e59ba99edb57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:58.570639 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6097bd97-bd88-477d-b9ac-e59ba99edb57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:58.571091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6097bd97-bd88-477d-b9ac-e59ba99edb57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:58.634395 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6097bd97-bd88-477d-b9ac-e59ba99edb57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:58.642552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6097bd97-bd88-477d-b9ac-e59ba99edb57 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085006 Sep 02 10:05:58.643148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1014/2107] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:05:59.663570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-96b8160a-2720-4461-9965-bab15f7a4989 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:05:59.664175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-96b8160a-2720-4461-9965-bab15f7a4989 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:05:59.670520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96b8160a-2720-4461-9965-bab15f7a4989 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:59.671042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96b8160a-2720-4461-9965-bab15f7a4989 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:59.671472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96b8160a-2720-4461-9965-bab15f7a4989 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:59.672150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96b8160a-2720-4461-9965-bab15f7a4989 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:05:59.672595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96b8160a-2720-4461-9965-bab15f7a4989 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:05:59.673011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96b8160a-2720-4461-9965-bab15f7a4989 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:05:59.733046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-96b8160a-2720-4461-9965-bab15f7a4989 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:05:59.740958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-96b8160a-2720-4461-9965-bab15f7a4989 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081232 Sep 02 10:05:59.741513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1094/2108] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:05:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:00.763435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d55fb564-d6dd-4985-b539-5cdc122ad076 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:00.764047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d55fb564-d6dd-4985-b539-5cdc122ad076 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:00.766337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=28 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:06:00.772114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d55fb564-d6dd-4985-b539-5cdc122ad076 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:00.772597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d55fb564-d6dd-4985-b539-5cdc122ad076 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:00.773034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d55fb564-d6dd-4985-b539-5cdc122ad076 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:00.773721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d55fb564-d6dd-4985-b539-5cdc122ad076 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:00.774809 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d55fb564-d6dd-4985-b539-5cdc122ad076 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:00.775234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d55fb564-d6dd-4985-b539-5cdc122ad076 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:00.835225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d55fb564-d6dd-4985-b539-5cdc122ad076 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:00.843773 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d55fb564-d6dd-4985-b539-5cdc122ad076 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084238 Sep 02 10:06:00.846682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1015/2109] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:01.864962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1ee2dccd-547b-47d4-968e-743f8b33c5bb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:01.865574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1ee2dccd-547b-47d4-968e-743f8b33c5bb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:01.872305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ee2dccd-547b-47d4-968e-743f8b33c5bb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:01.872791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ee2dccd-547b-47d4-968e-743f8b33c5bb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:01.873256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ee2dccd-547b-47d4-968e-743f8b33c5bb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:01.873952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ee2dccd-547b-47d4-968e-743f8b33c5bb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:01.874398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ee2dccd-547b-47d4-968e-743f8b33c5bb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:01.874841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1ee2dccd-547b-47d4-968e-743f8b33c5bb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:01.937289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1ee2dccd-547b-47d4-968e-743f8b33c5bb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:01.945319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1ee2dccd-547b-47d4-968e-743f8b33c5bb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084271 Sep 02 10:06:01.946390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1095/2110] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:02.966321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-45479be5-1be8-4744-a662-d3db64ef7f44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:02.966970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-45479be5-1be8-4744-a662-d3db64ef7f44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:02.973005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45479be5-1be8-4744-a662-d3db64ef7f44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:02.973485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45479be5-1be8-4744-a662-d3db64ef7f44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:02.973941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45479be5-1be8-4744-a662-d3db64ef7f44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:02.974627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45479be5-1be8-4744-a662-d3db64ef7f44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:02.975102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45479be5-1be8-4744-a662-d3db64ef7f44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:02.975527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-45479be5-1be8-4744-a662-d3db64ef7f44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:02.978581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=84 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:06:03.036591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-45479be5-1be8-4744-a662-d3db64ef7f44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:03.045093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-45479be5-1be8-4744-a662-d3db64ef7f44 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082889 Sep 02 10:06:03.045656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1016/2111] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:04.066096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-741fea0a-dfba-4ac2-ad2f-57de5c6924b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:04.066722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-741fea0a-dfba-4ac2-ad2f-57de5c6924b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:04.073069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-741fea0a-dfba-4ac2-ad2f-57de5c6924b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:04.073545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-741fea0a-dfba-4ac2-ad2f-57de5c6924b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:04.073974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-741fea0a-dfba-4ac2-ad2f-57de5c6924b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:04.074647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-741fea0a-dfba-4ac2-ad2f-57de5c6924b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:04.075121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-741fea0a-dfba-4ac2-ad2f-57de5c6924b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:04.075541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-741fea0a-dfba-4ac2-ad2f-57de5c6924b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:04.136939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-741fea0a-dfba-4ac2-ad2f-57de5c6924b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:04.145391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-741fea0a-dfba-4ac2-ad2f-57de5c6924b2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083096 Sep 02 10:06:04.145958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1096/2112] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:05.165849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d9da398d-a1b3-4e4c-98c2-7ca0ca060c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:05.166453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d9da398d-a1b3-4e4c-98c2-7ca0ca060c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:05.172952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9da398d-a1b3-4e4c-98c2-7ca0ca060c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:05.173438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9da398d-a1b3-4e4c-98c2-7ca0ca060c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:05.173872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9da398d-a1b3-4e4c-98c2-7ca0ca060c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:05.174566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9da398d-a1b3-4e4c-98c2-7ca0ca060c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:05.175053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9da398d-a1b3-4e4c-98c2-7ca0ca060c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:05.175475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d9da398d-a1b3-4e4c-98c2-7ca0ca060c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:05.241539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d9da398d-a1b3-4e4c-98c2-7ca0ca060c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:05.250650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d9da398d-a1b3-4e4c-98c2-7ca0ca060c38 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.089201 Sep 02 10:06:05.251240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1017/2113] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:06.271063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9f5f9bc0-7a5f-4975-a130-a36ed07278b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:06.271611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9f5f9bc0-7a5f-4975-a130-a36ed07278b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:06.278055 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f5f9bc0-7a5f-4975-a130-a36ed07278b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:06.278535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f5f9bc0-7a5f-4975-a130-a36ed07278b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:06.279001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f5f9bc0-7a5f-4975-a130-a36ed07278b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:06.279687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f5f9bc0-7a5f-4975-a130-a36ed07278b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:06.280142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f5f9bc0-7a5f-4975-a130-a36ed07278b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:06.280569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9f5f9bc0-7a5f-4975-a130-a36ed07278b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:06.341251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9f5f9bc0-7a5f-4975-a130-a36ed07278b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:06.349243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9f5f9bc0-7a5f-4975-a130-a36ed07278b8 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082148 Sep 02 10:06:06.349809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1097/2114] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:07.369621 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-591b6270-6a57-491e-9541-65ec563225e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:07.370495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-591b6270-6a57-491e-9541-65ec563225e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:07.377076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-591b6270-6a57-491e-9541-65ec563225e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:07.377553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-591b6270-6a57-491e-9541-65ec563225e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:07.377985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-591b6270-6a57-491e-9541-65ec563225e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:07.378663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-591b6270-6a57-491e-9541-65ec563225e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:07.379140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-591b6270-6a57-491e-9541-65ec563225e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:07.379570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-591b6270-6a57-491e-9541-65ec563225e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:07.442060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-591b6270-6a57-491e-9541-65ec563225e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:07.450670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-591b6270-6a57-491e-9541-65ec563225e7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084895 Sep 02 10:06:07.451254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1018/2115] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:08.471614 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3378ff16-a86a-4a13-b32a-538408c0ce0e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:08.472231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3378ff16-a86a-4a13-b32a-538408c0ce0e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:08.478210 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3378ff16-a86a-4a13-b32a-538408c0ce0e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:08.478699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3378ff16-a86a-4a13-b32a-538408c0ce0e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:08.479177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3378ff16-a86a-4a13-b32a-538408c0ce0e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:08.479866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3378ff16-a86a-4a13-b32a-538408c0ce0e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:08.480325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3378ff16-a86a-4a13-b32a-538408c0ce0e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:08.480755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3378ff16-a86a-4a13-b32a-538408c0ce0e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:08.542143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3378ff16-a86a-4a13-b32a-538408c0ce0e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:08.551731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3378ff16-a86a-4a13-b32a-538408c0ce0e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084130 Sep 02 10:06:08.560397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1098/2116] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:08 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:09.572765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-94131328-2aa7-4210-91ec-34e9352a5893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:09.573374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-94131328-2aa7-4210-91ec-34e9352a5893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:09.579743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94131328-2aa7-4210-91ec-34e9352a5893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:09.580221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94131328-2aa7-4210-91ec-34e9352a5893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:09.580650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94131328-2aa7-4210-91ec-34e9352a5893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:09.581320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94131328-2aa7-4210-91ec-34e9352a5893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:09.581772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94131328-2aa7-4210-91ec-34e9352a5893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:09.582189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94131328-2aa7-4210-91ec-34e9352a5893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:09.644202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94131328-2aa7-4210-91ec-34e9352a5893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:09.652308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-94131328-2aa7-4210-91ec-34e9352a5893 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083460 Sep 02 10:06:09.652862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1019/2117] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:10.673373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1d380ed5-486e-413e-bc6c-d25afe4fe024 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:10.674004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1d380ed5-486e-413e-bc6c-d25afe4fe024 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:10.680883 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d380ed5-486e-413e-bc6c-d25afe4fe024 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:10.681370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d380ed5-486e-413e-bc6c-d25afe4fe024 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:10.681812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d380ed5-486e-413e-bc6c-d25afe4fe024 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:10.684286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d380ed5-486e-413e-bc6c-d25afe4fe024 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:10.684286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d380ed5-486e-413e-bc6c-d25afe4fe024 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:10.684286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1d380ed5-486e-413e-bc6c-d25afe4fe024 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:10.743179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1d380ed5-486e-413e-bc6c-d25afe4fe024 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:10.751418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1d380ed5-486e-413e-bc6c-d25afe4fe024 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081934 Sep 02 10:06:10.751981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1099/2118] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:11.772982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a57560eb-cc94-442c-ae60-2cf9ff9be4b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:11.774260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a57560eb-cc94-442c-ae60-2cf9ff9be4b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:11.780690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a57560eb-cc94-442c-ae60-2cf9ff9be4b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:11.781173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a57560eb-cc94-442c-ae60-2cf9ff9be4b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:11.781604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a57560eb-cc94-442c-ae60-2cf9ff9be4b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:11.782277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a57560eb-cc94-442c-ae60-2cf9ff9be4b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:11.782785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a57560eb-cc94-442c-ae60-2cf9ff9be4b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:11.783210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a57560eb-cc94-442c-ae60-2cf9ff9be4b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:11.847074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a57560eb-cc94-442c-ae60-2cf9ff9be4b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:11.855339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a57560eb-cc94-442c-ae60-2cf9ff9be4b7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086303 Sep 02 10:06:11.855908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1020/2119] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:12.876335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2088323a-c27f-498e-9b0c-f44157851e95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:12.876985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2088323a-c27f-498e-9b0c-f44157851e95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:12.883725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2088323a-c27f-498e-9b0c-f44157851e95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:12.884206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2088323a-c27f-498e-9b0c-f44157851e95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:12.884638 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2088323a-c27f-498e-9b0c-f44157851e95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:12.885319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2088323a-c27f-498e-9b0c-f44157851e95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:12.885767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2088323a-c27f-498e-9b0c-f44157851e95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:12.886186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2088323a-c27f-498e-9b0c-f44157851e95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:12.951714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2088323a-c27f-498e-9b0c-f44157851e95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:12.959832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2088323a-c27f-498e-9b0c-f44157851e95 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087595 Sep 02 10:06:12.960397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1100/2120] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:13.980189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-12d009ed-9540-4ad8-8b84-4581a6a165b1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:13.980798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-12d009ed-9540-4ad8-8b84-4581a6a165b1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:13.987243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d009ed-9540-4ad8-8b84-4581a6a165b1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:13.987727 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d009ed-9540-4ad8-8b84-4581a6a165b1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:13.988167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d009ed-9540-4ad8-8b84-4581a6a165b1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:13.988875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d009ed-9540-4ad8-8b84-4581a6a165b1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:13.989328 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d009ed-9540-4ad8-8b84-4581a6a165b1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:13.989750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12d009ed-9540-4ad8-8b84-4581a6a165b1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:14.050842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-12d009ed-9540-4ad8-8b84-4581a6a165b1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:14.059078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-12d009ed-9540-4ad8-8b84-4581a6a165b1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082794 Sep 02 10:06:14.059637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1021/2121] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:15.080229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-95eb7c8a-b1bc-47e7-92c1-4d5df8bc9976 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:15.080812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-95eb7c8a-b1bc-47e7-92c1-4d5df8bc9976 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:15.087777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95eb7c8a-b1bc-47e7-92c1-4d5df8bc9976 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:15.088258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95eb7c8a-b1bc-47e7-92c1-4d5df8bc9976 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:15.088694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95eb7c8a-b1bc-47e7-92c1-4d5df8bc9976 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:15.089412 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95eb7c8a-b1bc-47e7-92c1-4d5df8bc9976 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:15.089865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95eb7c8a-b1bc-47e7-92c1-4d5df8bc9976 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:15.090290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95eb7c8a-b1bc-47e7-92c1-4d5df8bc9976 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:15.150676 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-95eb7c8a-b1bc-47e7-92c1-4d5df8bc9976 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:15.158824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-95eb7c8a-b1bc-47e7-92c1-4d5df8bc9976 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082458 Sep 02 10:06:15.159384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1101/2122] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:16.180441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-da01ce7b-e05c-498c-ae99-884f20cd4f32 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:16.181012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-da01ce7b-e05c-498c-ae99-884f20cd4f32 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:16.187427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da01ce7b-e05c-498c-ae99-884f20cd4f32 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:16.187913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da01ce7b-e05c-498c-ae99-884f20cd4f32 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:16.188349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da01ce7b-e05c-498c-ae99-884f20cd4f32 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:16.189035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da01ce7b-e05c-498c-ae99-884f20cd4f32 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:16.189495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da01ce7b-e05c-498c-ae99-884f20cd4f32 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:16.189918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da01ce7b-e05c-498c-ae99-884f20cd4f32 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:16.253969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da01ce7b-e05c-498c-ae99-884f20cd4f32 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:16.262243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-da01ce7b-e05c-498c-ae99-884f20cd4f32 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086237 Sep 02 10:06:16.262828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1022/2123] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:17.283046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0496eca0-9d99-4849-ab32-7c738a0eac1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:17.283607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0496eca0-9d99-4849-ab32-7c738a0eac1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:17.290071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0496eca0-9d99-4849-ab32-7c738a0eac1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:17.290548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0496eca0-9d99-4849-ab32-7c738a0eac1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:17.291020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0496eca0-9d99-4849-ab32-7c738a0eac1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:17.291700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0496eca0-9d99-4849-ab32-7c738a0eac1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:17.292154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0496eca0-9d99-4849-ab32-7c738a0eac1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:17.292580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0496eca0-9d99-4849-ab32-7c738a0eac1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:17.353905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0496eca0-9d99-4849-ab32-7c738a0eac1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:17.361934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0496eca0-9d99-4849-ab32-7c738a0eac1c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082949 Sep 02 10:06:17.362498 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1102/2124] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:18.383249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e25f21f3-da56-4817-9498-58f62f765ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:18.383864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e25f21f3-da56-4817-9498-58f62f765ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:18.390903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e25f21f3-da56-4817-9498-58f62f765ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:18.391654 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e25f21f3-da56-4817-9498-58f62f765ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:18.391814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e25f21f3-da56-4817-9498-58f62f765ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:18.392499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e25f21f3-da56-4817-9498-58f62f765ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:18.392949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e25f21f3-da56-4817-9498-58f62f765ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:18.393372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e25f21f3-da56-4817-9498-58f62f765ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:18.453589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e25f21f3-da56-4817-9498-58f62f765ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:18.461757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e25f21f3-da56-4817-9498-58f62f765ef0 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082405 Sep 02 10:06:18.462991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1023/2125] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:19.482271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b18f4ffb-4c36-4d91-877e-f3d836f9061f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:19.483004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b18f4ffb-4c36-4d91-877e-f3d836f9061f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:19.489360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b18f4ffb-4c36-4d91-877e-f3d836f9061f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:19.489839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b18f4ffb-4c36-4d91-877e-f3d836f9061f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:19.490272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b18f4ffb-4c36-4d91-877e-f3d836f9061f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:19.490981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b18f4ffb-4c36-4d91-877e-f3d836f9061f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:19.491429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b18f4ffb-4c36-4d91-877e-f3d836f9061f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:19.491848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b18f4ffb-4c36-4d91-877e-f3d836f9061f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:19.552558 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b18f4ffb-4c36-4d91-877e-f3d836f9061f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:19.560716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b18f4ffb-4c36-4d91-877e-f3d836f9061f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082767 Sep 02 10:06:19.561278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1103/2126] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:19 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:20.581348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-44596761-d8f9-49b8-8bba-9e671ec656de tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:20.581888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-44596761-d8f9-49b8-8bba-9e671ec656de tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:20.588271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44596761-d8f9-49b8-8bba-9e671ec656de tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:20.588799 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44596761-d8f9-49b8-8bba-9e671ec656de tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:20.589235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44596761-d8f9-49b8-8bba-9e671ec656de tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:20.589912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44596761-d8f9-49b8-8bba-9e671ec656de tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:20.590363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44596761-d8f9-49b8-8bba-9e671ec656de tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:20.590804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-44596761-d8f9-49b8-8bba-9e671ec656de tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:20.650473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-44596761-d8f9-49b8-8bba-9e671ec656de tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:20.658495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-44596761-d8f9-49b8-8bba-9e671ec656de tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081199 Sep 02 10:06:20.659106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1024/2127] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:20 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:21.679400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-641a0997-dd63-403a-a6ad-5356597bc8be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:21.680015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-641a0997-dd63-403a-a6ad-5356597bc8be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:21.687126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-641a0997-dd63-403a-a6ad-5356597bc8be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:21.687613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-641a0997-dd63-403a-a6ad-5356597bc8be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:21.688053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-641a0997-dd63-403a-a6ad-5356597bc8be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:21.688730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-641a0997-dd63-403a-a6ad-5356597bc8be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:21.689180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-641a0997-dd63-403a-a6ad-5356597bc8be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:21.689602 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-641a0997-dd63-403a-a6ad-5356597bc8be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:21.752141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-641a0997-dd63-403a-a6ad-5356597bc8be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:21.760235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-641a0997-dd63-403a-a6ad-5356597bc8be tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084724 Sep 02 10:06:21.760800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1104/2128] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:21 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:22.781014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-94f816f5-5a76-49a9-bb29-cf68b117bc35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:22.781658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-94f816f5-5a76-49a9-bb29-cf68b117bc35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:22.788117 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f816f5-5a76-49a9-bb29-cf68b117bc35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:22.788594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f816f5-5a76-49a9-bb29-cf68b117bc35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:22.789027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f816f5-5a76-49a9-bb29-cf68b117bc35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:22.789709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f816f5-5a76-49a9-bb29-cf68b117bc35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:22.790161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f816f5-5a76-49a9-bb29-cf68b117bc35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:22.790585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f816f5-5a76-49a9-bb29-cf68b117bc35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:22.853280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94f816f5-5a76-49a9-bb29-cf68b117bc35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:22.862199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-94f816f5-5a76-49a9-bb29-cf68b117bc35 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085109 Sep 02 10:06:22.862775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1025/2129] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:22 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:23.883618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dbb45e5d-b6c5-443d-bc2d-91ddb7ccf541 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:23.884227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dbb45e5d-b6c5-443d-bc2d-91ddb7ccf541 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:23.891195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbb45e5d-b6c5-443d-bc2d-91ddb7ccf541 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:23.891674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbb45e5d-b6c5-443d-bc2d-91ddb7ccf541 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:23.892109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbb45e5d-b6c5-443d-bc2d-91ddb7ccf541 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:23.892786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbb45e5d-b6c5-443d-bc2d-91ddb7ccf541 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:23.893235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbb45e5d-b6c5-443d-bc2d-91ddb7ccf541 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:23.893657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dbb45e5d-b6c5-443d-bc2d-91ddb7ccf541 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:23.896211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=84 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:06:23.955299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dbb45e5d-b6c5-443d-bc2d-91ddb7ccf541 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:23.964351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dbb45e5d-b6c5-443d-bc2d-91ddb7ccf541 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084403 Sep 02 10:06:23.964954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1105/2130] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:23 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:24.985474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dab22830-186d-4285-acc8-9652e69e312a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:24.986082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dab22830-186d-4285-acc8-9652e69e312a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:24.992445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab22830-186d-4285-acc8-9652e69e312a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:24.992920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab22830-186d-4285-acc8-9652e69e312a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:24.993350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab22830-186d-4285-acc8-9652e69e312a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:24.994026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab22830-186d-4285-acc8-9652e69e312a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:24.994473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab22830-186d-4285-acc8-9652e69e312a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:24.995184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dab22830-186d-4285-acc8-9652e69e312a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:25.060438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dab22830-186d-4285-acc8-9652e69e312a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:25.068630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dab22830-186d-4285-acc8-9652e69e312a tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087672 Sep 02 10:06:25.069195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1026/2131] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:24 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:26.089156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4576a1db-bf95-49df-9e98-5955e1c00757 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:26.089772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4576a1db-bf95-49df-9e98-5955e1c00757 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:26.092589 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=28 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:06:26.097286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4576a1db-bf95-49df-9e98-5955e1c00757 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:26.097707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4576a1db-bf95-49df-9e98-5955e1c00757 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:26.098145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4576a1db-bf95-49df-9e98-5955e1c00757 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:26.098871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4576a1db-bf95-49df-9e98-5955e1c00757 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:26.099326 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4576a1db-bf95-49df-9e98-5955e1c00757 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:26.103036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4576a1db-bf95-49df-9e98-5955e1c00757 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:26.160451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4576a1db-bf95-49df-9e98-5955e1c00757 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:26.168479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4576a1db-bf95-49df-9e98-5955e1c00757 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083196 Sep 02 10:06:26.169066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1106/2132] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:26 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:27.190057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e44c719-de9b-4913-922b-dc43f1065edf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:27.190692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e44c719-de9b-4913-922b-dc43f1065edf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:27.197097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e44c719-de9b-4913-922b-dc43f1065edf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:27.197573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e44c719-de9b-4913-922b-dc43f1065edf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:27.197999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e44c719-de9b-4913-922b-dc43f1065edf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:27.198671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e44c719-de9b-4913-922b-dc43f1065edf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:27.199137 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e44c719-de9b-4913-922b-dc43f1065edf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:27.199551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e44c719-de9b-4913-922b-dc43f1065edf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:27.259133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1e44c719-de9b-4913-922b-dc43f1065edf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:27.267264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e44c719-de9b-4913-922b-dc43f1065edf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081610 Sep 02 10:06:27.267830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1027/2133] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:27 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:28.288611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-77d1d3ad-dc8c-4850-b9aa-f8593f09e014 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:28.289149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-77d1d3ad-dc8c-4850-b9aa-f8593f09e014 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:28.295652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-77d1d3ad-dc8c-4850-b9aa-f8593f09e014 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:28.296140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-77d1d3ad-dc8c-4850-b9aa-f8593f09e014 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:28.296579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-77d1d3ad-dc8c-4850-b9aa-f8593f09e014 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:28.297262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-77d1d3ad-dc8c-4850-b9aa-f8593f09e014 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:28.297743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-77d1d3ad-dc8c-4850-b9aa-f8593f09e014 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:28.298170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-77d1d3ad-dc8c-4850-b9aa-f8593f09e014 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:28.358689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-77d1d3ad-dc8c-4850-b9aa-f8593f09e014 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:28.366816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-77d1d3ad-dc8c-4850-b9aa-f8593f09e014 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082178 Sep 02 10:06:28.367378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1107/2134] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:28 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:29.387494 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-405cea2b-10c9-4fb6-9681-c4afb0c1db79 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:29.388095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-405cea2b-10c9-4fb6-9681-c4afb0c1db79 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:29.395134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405cea2b-10c9-4fb6-9681-c4afb0c1db79 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:29.395620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405cea2b-10c9-4fb6-9681-c4afb0c1db79 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:29.396055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405cea2b-10c9-4fb6-9681-c4afb0c1db79 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:29.396743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405cea2b-10c9-4fb6-9681-c4afb0c1db79 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:29.397199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405cea2b-10c9-4fb6-9681-c4afb0c1db79 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:29.397622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-405cea2b-10c9-4fb6-9681-c4afb0c1db79 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:29.458062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-405cea2b-10c9-4fb6-9681-c4afb0c1db79 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:29.466181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-405cea2b-10c9-4fb6-9681-c4afb0c1db79 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082639 Sep 02 10:06:29.467437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1028/2135] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:29 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:30.487578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b998c19a-0e8b-42c3-99d6-ef464dfa2c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:30.488261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b998c19a-0e8b-42c3-99d6-ef464dfa2c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:30.494994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b998c19a-0e8b-42c3-99d6-ef464dfa2c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:30.495483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b998c19a-0e8b-42c3-99d6-ef464dfa2c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:30.495925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b998c19a-0e8b-42c3-99d6-ef464dfa2c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:30.496617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b998c19a-0e8b-42c3-99d6-ef464dfa2c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:30.497069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b998c19a-0e8b-42c3-99d6-ef464dfa2c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:30.497495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b998c19a-0e8b-42c3-99d6-ef464dfa2c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:30.563327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b998c19a-0e8b-42c3-99d6-ef464dfa2c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:30.571404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b998c19a-0e8b-42c3-99d6-ef464dfa2c87 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087726 Sep 02 10:06:30.571972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1108/2136] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:30 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:31.593180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b9a28b1c-7ac3-4651-aa1d-6ee1d5973350 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:31.593817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b9a28b1c-7ac3-4651-aa1d-6ee1d5973350 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:31.600332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9a28b1c-7ac3-4651-aa1d-6ee1d5973350 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:31.600810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9a28b1c-7ac3-4651-aa1d-6ee1d5973350 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:31.601243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9a28b1c-7ac3-4651-aa1d-6ee1d5973350 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:31.601925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9a28b1c-7ac3-4651-aa1d-6ee1d5973350 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:31.602374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9a28b1c-7ac3-4651-aa1d-6ee1d5973350 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:31.602815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9a28b1c-7ac3-4651-aa1d-6ee1d5973350 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:31.662968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b9a28b1c-7ac3-4651-aa1d-6ee1d5973350 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:31.671033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b9a28b1c-7ac3-4651-aa1d-6ee1d5973350 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082272 Sep 02 10:06:31.671589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1029/2137] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:31 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:32.691152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-61b24d53-f878-4256-9f53-643c437e8b00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:32.691746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-61b24d53-f878-4256-9f53-643c437e8b00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:32.697886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b24d53-f878-4256-9f53-643c437e8b00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:32.698367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b24d53-f878-4256-9f53-643c437e8b00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:32.698834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b24d53-f878-4256-9f53-643c437e8b00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:32.699513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b24d53-f878-4256-9f53-643c437e8b00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:32.699965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b24d53-f878-4256-9f53-643c437e8b00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:32.700389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-61b24d53-f878-4256-9f53-643c437e8b00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:32.760133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-61b24d53-f878-4256-9f53-643c437e8b00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:32.768054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-61b24d53-f878-4256-9f53-643c437e8b00 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.080996 Sep 02 10:06:32.768609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1109/2138] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:32 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:33.789060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-505383a5-5263-4961-9479-2f489d513942 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:33.789674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-505383a5-5263-4961-9479-2f489d513942 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:33.791999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=30 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:06:33.797152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505383a5-5263-4961-9479-2f489d513942 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:33.797629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505383a5-5263-4961-9479-2f489d513942 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:33.798066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505383a5-5263-4961-9479-2f489d513942 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:33.798773 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505383a5-5263-4961-9479-2f489d513942 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:33.799230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505383a5-5263-4961-9479-2f489d513942 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:33.805734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-505383a5-5263-4961-9479-2f489d513942 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:33.805734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=84 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:06:33.864130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-505383a5-5263-4961-9479-2f489d513942 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:33.872502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-505383a5-5263-4961-9479-2f489d513942 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087301 Sep 02 10:06:33.873765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1030/2139] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:33 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:34.894245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-84ef08a7-3a0c-4282-ac09-7de5556d66ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:34.894884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-84ef08a7-3a0c-4282-ac09-7de5556d66ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:34.901416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-84ef08a7-3a0c-4282-ac09-7de5556d66ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:34.901902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-84ef08a7-3a0c-4282-ac09-7de5556d66ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:34.902342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-84ef08a7-3a0c-4282-ac09-7de5556d66ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:34.903061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-84ef08a7-3a0c-4282-ac09-7de5556d66ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:34.903518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-84ef08a7-3a0c-4282-ac09-7de5556d66ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:34.903945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-84ef08a7-3a0c-4282-ac09-7de5556d66ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:34.964286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-84ef08a7-3a0c-4282-ac09-7de5556d66ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:34.972425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-84ef08a7-3a0c-4282-ac09-7de5556d66ac tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082132 Sep 02 10:06:34.972986 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1110/2140] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:34 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:35.992819 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e69f5b05-5ae3-4ebb-926e-70884a1af74f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:35.993425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e69f5b05-5ae3-4ebb-926e-70884a1af74f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:36.000695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e69f5b05-5ae3-4ebb-926e-70884a1af74f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:36.001173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e69f5b05-5ae3-4ebb-926e-70884a1af74f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:36.001604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e69f5b05-5ae3-4ebb-926e-70884a1af74f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:36.002281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e69f5b05-5ae3-4ebb-926e-70884a1af74f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:36.002748 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e69f5b05-5ae3-4ebb-926e-70884a1af74f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:36.003170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e69f5b05-5ae3-4ebb-926e-70884a1af74f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:36.064564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e69f5b05-5ae3-4ebb-926e-70884a1af74f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:36.072720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e69f5b05-5ae3-4ebb-926e-70884a1af74f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083775 Sep 02 10:06:36.073277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1031/2141] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:35 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:37.093815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5dcfdac0-af9f-4e5f-991e-e06a0f29a916 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:37.094426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5dcfdac0-af9f-4e5f-991e-e06a0f29a916 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:37.100865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5dcfdac0-af9f-4e5f-991e-e06a0f29a916 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:37.101295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5dcfdac0-af9f-4e5f-991e-e06a0f29a916 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:37.101729 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5dcfdac0-af9f-4e5f-991e-e06a0f29a916 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:37.102408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5dcfdac0-af9f-4e5f-991e-e06a0f29a916 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:37.102885 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5dcfdac0-af9f-4e5f-991e-e06a0f29a916 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:37.103305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5dcfdac0-af9f-4e5f-991e-e06a0f29a916 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:37.163228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5dcfdac0-af9f-4e5f-991e-e06a0f29a916 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:37.171877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5dcfdac0-af9f-4e5f-991e-e06a0f29a916 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082490 Sep 02 10:06:37.172433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1111/2142] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:37 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:38.192229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-eeff64c9-c732-4cc8-9e46-803b16def921 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:38.192840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-eeff64c9-c732-4cc8-9e46-803b16def921 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:38.199261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeff64c9-c732-4cc8-9e46-803b16def921 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:38.199743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeff64c9-c732-4cc8-9e46-803b16def921 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:38.200196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeff64c9-c732-4cc8-9e46-803b16def921 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:38.200904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeff64c9-c732-4cc8-9e46-803b16def921 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:38.201362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeff64c9-c732-4cc8-9e46-803b16def921 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:38.201787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eeff64c9-c732-4cc8-9e46-803b16def921 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:38.262078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-eeff64c9-c732-4cc8-9e46-803b16def921 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:38.270195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-eeff64c9-c732-4cc8-9e46-803b16def921 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081833 Sep 02 10:06:38.270783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1032/2143] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:38 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:39.290938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c71cd4ba-94c9-4897-8e19-2206a4485d2c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:39.291500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c71cd4ba-94c9-4897-8e19-2206a4485d2c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:39.293434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:06:39.293572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 10:06:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 (ip 10.222.0.57) !!! Sep 02 10:06:39.299378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71cd4ba-94c9-4897-8e19-2206a4485d2c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:39.299857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71cd4ba-94c9-4897-8e19-2206a4485d2c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:39.300290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71cd4ba-94c9-4897-8e19-2206a4485d2c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:39.300970 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71cd4ba-94c9-4897-8e19-2206a4485d2c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:39.301423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71cd4ba-94c9-4897-8e19-2206a4485d2c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:39.301845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c71cd4ba-94c9-4897-8e19-2206a4485d2c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:39.369087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c71cd4ba-94c9-4897-8e19-2206a4485d2c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:39.378259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c71cd4ba-94c9-4897-8e19-2206a4485d2c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.091371 Sep 02 10:06:39.379547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1112/2144] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:39 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:40.399323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dc758d6d-0be9-4d39-aff4-83b9d03bc727 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:40.399929 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dc758d6d-0be9-4d39-aff4-83b9d03bc727 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:40.407268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc758d6d-0be9-4d39-aff4-83b9d03bc727 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:40.407742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc758d6d-0be9-4d39-aff4-83b9d03bc727 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:40.408174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc758d6d-0be9-4d39-aff4-83b9d03bc727 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:40.408849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc758d6d-0be9-4d39-aff4-83b9d03bc727 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:40.409296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc758d6d-0be9-4d39-aff4-83b9d03bc727 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:40.409712 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc758d6d-0be9-4d39-aff4-83b9d03bc727 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:40.472248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dc758d6d-0be9-4d39-aff4-83b9d03bc727 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:40.481070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dc758d6d-0be9-4d39-aff4-83b9d03bc727 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085683 Sep 02 10:06:40.481636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1033/2145] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:40 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:41.502170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-186bde88-257d-40d4-93f9-90c8b138b9bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:41.502839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-186bde88-257d-40d4-93f9-90c8b138b9bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:41.509414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186bde88-257d-40d4-93f9-90c8b138b9bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:41.509929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186bde88-257d-40d4-93f9-90c8b138b9bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:41.510370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186bde88-257d-40d4-93f9-90c8b138b9bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:41.511082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186bde88-257d-40d4-93f9-90c8b138b9bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:41.511564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186bde88-257d-40d4-93f9-90c8b138b9bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:41.511991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-186bde88-257d-40d4-93f9-90c8b138b9bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:41.572109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-186bde88-257d-40d4-93f9-90c8b138b9bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:41.580263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-186bde88-257d-40d4-93f9-90c8b138b9bd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082638 Sep 02 10:06:41.580823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1113/2146] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:41 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:42.601446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c599c4fb-5d9c-4d1d-a1e9-1fe5680799e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:42.602033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c599c4fb-5d9c-4d1d-a1e9-1fe5680799e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:42.609800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c599c4fb-5d9c-4d1d-a1e9-1fe5680799e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:42.610281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c599c4fb-5d9c-4d1d-a1e9-1fe5680799e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:42.610724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c599c4fb-5d9c-4d1d-a1e9-1fe5680799e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:42.611415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c599c4fb-5d9c-4d1d-a1e9-1fe5680799e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:42.611862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c599c4fb-5d9c-4d1d-a1e9-1fe5680799e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:42.612279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c599c4fb-5d9c-4d1d-a1e9-1fe5680799e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:42.676383 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c599c4fb-5d9c-4d1d-a1e9-1fe5680799e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:42.684534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c599c4fb-5d9c-4d1d-a1e9-1fe5680799e1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.087317 Sep 02 10:06:42.689421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1034/2147] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:42 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:43.705018 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0709830e-4bda-490e-b0fb-10c2fa9cbdf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:43.705639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0709830e-4bda-490e-b0fb-10c2fa9cbdf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:43.712515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0709830e-4bda-490e-b0fb-10c2fa9cbdf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:43.713005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0709830e-4bda-490e-b0fb-10c2fa9cbdf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:43.713449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0709830e-4bda-490e-b0fb-10c2fa9cbdf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:43.714517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0709830e-4bda-490e-b0fb-10c2fa9cbdf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:43.715000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0709830e-4bda-490e-b0fb-10c2fa9cbdf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:43.715432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0709830e-4bda-490e-b0fb-10c2fa9cbdf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:43.775230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0709830e-4bda-490e-b0fb-10c2fa9cbdf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:43.783891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0709830e-4bda-490e-b0fb-10c2fa9cbdf2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083254 Sep 02 10:06:43.784448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1114/2148] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:43 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:44.804397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-52d12f68-ce97-4a17-aae2-1c2ea091302d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:44.805003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-52d12f68-ce97-4a17-aae2-1c2ea091302d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:44.811891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52d12f68-ce97-4a17-aae2-1c2ea091302d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:44.812373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52d12f68-ce97-4a17-aae2-1c2ea091302d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:44.812811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52d12f68-ce97-4a17-aae2-1c2ea091302d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:44.813496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52d12f68-ce97-4a17-aae2-1c2ea091302d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:44.813958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52d12f68-ce97-4a17-aae2-1c2ea091302d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:44.814381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-52d12f68-ce97-4a17-aae2-1c2ea091302d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:44.875352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-52d12f68-ce97-4a17-aae2-1c2ea091302d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:44.883595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-52d12f68-ce97-4a17-aae2-1c2ea091302d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083053 Sep 02 10:06:44.884168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1035/2149] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:44 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:45.905311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-585a1aab-867a-442f-a6b3-7338568027bc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:45.905920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-585a1aab-867a-442f-a6b3-7338568027bc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:45.912461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-585a1aab-867a-442f-a6b3-7338568027bc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:45.912949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-585a1aab-867a-442f-a6b3-7338568027bc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:45.913386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-585a1aab-867a-442f-a6b3-7338568027bc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:45.914067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-585a1aab-867a-442f-a6b3-7338568027bc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:45.914520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-585a1aab-867a-442f-a6b3-7338568027bc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:45.914973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-585a1aab-867a-442f-a6b3-7338568027bc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:45.977165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-585a1aab-867a-442f-a6b3-7338568027bc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:45.985240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-585a1aab-867a-442f-a6b3-7338568027bc tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084455 Sep 02 10:06:45.985797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1115/2150] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:45 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:47.005900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3c7eee3f-d2ef-499e-a5ba-d5cf87e126a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:47.006526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3c7eee3f-d2ef-499e-a5ba-d5cf87e126a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:47.013540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c7eee3f-d2ef-499e-a5ba-d5cf87e126a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:47.014014 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c7eee3f-d2ef-499e-a5ba-d5cf87e126a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:47.014446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c7eee3f-d2ef-499e-a5ba-d5cf87e126a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:47.015153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c7eee3f-d2ef-499e-a5ba-d5cf87e126a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:47.015600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c7eee3f-d2ef-499e-a5ba-d5cf87e126a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:47.016020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3c7eee3f-d2ef-499e-a5ba-d5cf87e126a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:47.077227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3c7eee3f-d2ef-499e-a5ba-d5cf87e126a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:47.086336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3c7eee3f-d2ef-499e-a5ba-d5cf87e126a9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084256 Sep 02 10:06:47.087282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1036/2151] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:47 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:48.108408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ca5fd8a5-9248-43e3-94dc-850ea4223f41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:48.109133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ca5fd8a5-9248-43e3-94dc-850ea4223f41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:48.115898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5fd8a5-9248-43e3-94dc-850ea4223f41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:48.116379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5fd8a5-9248-43e3-94dc-850ea4223f41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:48.116811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5fd8a5-9248-43e3-94dc-850ea4223f41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:48.117489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5fd8a5-9248-43e3-94dc-850ea4223f41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:48.117933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5fd8a5-9248-43e3-94dc-850ea4223f41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:48.118353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca5fd8a5-9248-43e3-94dc-850ea4223f41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:48.183237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ca5fd8a5-9248-43e3-94dc-850ea4223f41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:48.192095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ca5fd8a5-9248-43e3-94dc-850ea4223f41 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.088410 Sep 02 10:06:48.192661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1116/2152] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:48 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:49.212746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3a6b024-b7a5-4cc2-a41f-92ed62081fe7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:49.213293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3a6b024-b7a5-4cc2-a41f-92ed62081fe7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:49.221712 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a6b024-b7a5-4cc2-a41f-92ed62081fe7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:49.222195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a6b024-b7a5-4cc2-a41f-92ed62081fe7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:49.222626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a6b024-b7a5-4cc2-a41f-92ed62081fe7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:49.223339 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a6b024-b7a5-4cc2-a41f-92ed62081fe7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:49.223790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a6b024-b7a5-4cc2-a41f-92ed62081fe7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:49.224210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3a6b024-b7a5-4cc2-a41f-92ed62081fe7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:49.285333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e3a6b024-b7a5-4cc2-a41f-92ed62081fe7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:49.293321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3a6b024-b7a5-4cc2-a41f-92ed62081fe7 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084564 Sep 02 10:06:49.293880 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1037/2153] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:49 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:50.314275 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d4a98142-7772-4305-85cf-ae40054de56e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:50.314835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d4a98142-7772-4305-85cf-ae40054de56e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:50.321232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d4a98142-7772-4305-85cf-ae40054de56e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:50.321711 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d4a98142-7772-4305-85cf-ae40054de56e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:50.322145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d4a98142-7772-4305-85cf-ae40054de56e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:50.322862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d4a98142-7772-4305-85cf-ae40054de56e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:50.323311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d4a98142-7772-4305-85cf-ae40054de56e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:50.323748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d4a98142-7772-4305-85cf-ae40054de56e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:50.384071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d4a98142-7772-4305-85cf-ae40054de56e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:50.392267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d4a98142-7772-4305-85cf-ae40054de56e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082500 Sep 02 10:06:50.392833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1117/2154] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:50 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:51.412645 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-73db9858-fa91-4d8b-8045-00defc0a0812 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:51.413255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-73db9858-fa91-4d8b-8045-00defc0a0812 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:51.420426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73db9858-fa91-4d8b-8045-00defc0a0812 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:51.420900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73db9858-fa91-4d8b-8045-00defc0a0812 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:51.421335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73db9858-fa91-4d8b-8045-00defc0a0812 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:51.422013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73db9858-fa91-4d8b-8045-00defc0a0812 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:51.422464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73db9858-fa91-4d8b-8045-00defc0a0812 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:51.422920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-73db9858-fa91-4d8b-8045-00defc0a0812 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:51.485975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-73db9858-fa91-4d8b-8045-00defc0a0812 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:51.494481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-73db9858-fa91-4d8b-8045-00defc0a0812 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085473 Sep 02 10:06:51.495088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1038/2155] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:51 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:52.515199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4aa5298d-11b9-418f-8830-9a926d616fb9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:52.515812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4aa5298d-11b9-418f-8830-9a926d616fb9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:52.522240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aa5298d-11b9-418f-8830-9a926d616fb9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:52.522755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aa5298d-11b9-418f-8830-9a926d616fb9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:52.523200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aa5298d-11b9-418f-8830-9a926d616fb9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:52.523889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aa5298d-11b9-418f-8830-9a926d616fb9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:52.524338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aa5298d-11b9-418f-8830-9a926d616fb9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:52.524763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4aa5298d-11b9-418f-8830-9a926d616fb9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:52.585642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4aa5298d-11b9-418f-8830-9a926d616fb9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:52.593702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4aa5298d-11b9-418f-8830-9a926d616fb9 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082419 Sep 02 10:06:52.594257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1118/2156] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:52 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:53.614635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aa554133-2a8b-4f33-a929-72099d9b11a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:53.615274 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aa554133-2a8b-4f33-a929-72099d9b11a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:53.622047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa554133-2a8b-4f33-a929-72099d9b11a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:53.622522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa554133-2a8b-4f33-a929-72099d9b11a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:53.622990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa554133-2a8b-4f33-a929-72099d9b11a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:53.623670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa554133-2a8b-4f33-a929-72099d9b11a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:53.624118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa554133-2a8b-4f33-a929-72099d9b11a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:53.624535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa554133-2a8b-4f33-a929-72099d9b11a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:53.686437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-aa554133-2a8b-4f33-a929-72099d9b11a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:53.694510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aa554133-2a8b-4f33-a929-72099d9b11a2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083721 Sep 02 10:06:53.695096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1039/2157] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:53 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:54.714873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e7af9ed8-633b-4f64-8212-28fa1752f78c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:54.715484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e7af9ed8-633b-4f64-8212-28fa1752f78c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:54.721902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7af9ed8-633b-4f64-8212-28fa1752f78c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:54.722386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7af9ed8-633b-4f64-8212-28fa1752f78c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:54.722848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7af9ed8-633b-4f64-8212-28fa1752f78c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:54.723584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7af9ed8-633b-4f64-8212-28fa1752f78c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:54.724039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7af9ed8-633b-4f64-8212-28fa1752f78c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:54.724464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e7af9ed8-633b-4f64-8212-28fa1752f78c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:54.726975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=84 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:06:54.785999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e7af9ed8-633b-4f64-8212-28fa1752f78c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:54.796475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e7af9ed8-633b-4f64-8212-28fa1752f78c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085395 Sep 02 10:06:54.801642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1119/2158] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:54 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:55.817678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6777a5e9-69c4-4a15-b157-b626b0de2a4f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:55.818316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6777a5e9-69c4-4a15-b157-b626b0de2a4f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:55.824898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6777a5e9-69c4-4a15-b157-b626b0de2a4f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:55.825380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6777a5e9-69c4-4a15-b157-b626b0de2a4f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:55.825814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6777a5e9-69c4-4a15-b157-b626b0de2a4f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:55.826522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6777a5e9-69c4-4a15-b157-b626b0de2a4f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:55.827087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6777a5e9-69c4-4a15-b157-b626b0de2a4f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:55.827511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6777a5e9-69c4-4a15-b157-b626b0de2a4f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:55.889092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6777a5e9-69c4-4a15-b157-b626b0de2a4f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:55.897320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6777a5e9-69c4-4a15-b157-b626b0de2a4f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083871 Sep 02 10:06:55.897893 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1040/2159] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:55 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:56.918600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d897d712-40ef-4abb-b583-f3e370e1adcd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:56.919798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d897d712-40ef-4abb-b583-f3e370e1adcd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:56.922143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=28 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:06:56.926777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d897d712-40ef-4abb-b583-f3e370e1adcd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:56.930312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d897d712-40ef-4abb-b583-f3e370e1adcd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:56.930312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d897d712-40ef-4abb-b583-f3e370e1adcd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:56.930312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d897d712-40ef-4abb-b583-f3e370e1adcd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:56.930312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d897d712-40ef-4abb-b583-f3e370e1adcd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:56.930935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d897d712-40ef-4abb-b583-f3e370e1adcd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:56.992584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d897d712-40ef-4abb-b583-f3e370e1adcd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:57.001577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d897d712-40ef-4abb-b583-f3e370e1adcd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086876 Sep 02 10:06:57.002143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1120/2160] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:56 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:58.021649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d1980bda-a9bb-4745-b28e-8f113b3d9e7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:58.022261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d1980bda-a9bb-4745-b28e-8f113b3d9e7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:58.029329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1980bda-a9bb-4745-b28e-8f113b3d9e7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:58.029813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1980bda-a9bb-4745-b28e-8f113b3d9e7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:58.030248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1980bda-a9bb-4745-b28e-8f113b3d9e7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:58.030972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1980bda-a9bb-4745-b28e-8f113b3d9e7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:58.031429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1980bda-a9bb-4745-b28e-8f113b3d9e7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:58.031856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1980bda-a9bb-4745-b28e-8f113b3d9e7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:58.092372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d1980bda-a9bb-4745-b28e-8f113b3d9e7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:58.100605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d1980bda-a9bb-4745-b28e-8f113b3d9e7e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082795 Sep 02 10:06:58.101109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1041/2161] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:58 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:06:59.121336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-15002dfe-8ba9-425b-ad88-505c7612ba0b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:06:59.121924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-15002dfe-8ba9-425b-ad88-505c7612ba0b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:06:59.128869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15002dfe-8ba9-425b-ad88-505c7612ba0b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:59.129353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15002dfe-8ba9-425b-ad88-505c7612ba0b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:59.129807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15002dfe-8ba9-425b-ad88-505c7612ba0b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:59.130466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15002dfe-8ba9-425b-ad88-505c7612ba0b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:06:59.130952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15002dfe-8ba9-425b-ad88-505c7612ba0b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:06:59.131379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-15002dfe-8ba9-425b-ad88-505c7612ba0b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:06:59.195146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-15002dfe-8ba9-425b-ad88-505c7612ba0b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:06:59.203278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-15002dfe-8ba9-425b-ad88-505c7612ba0b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086172 Sep 02 10:06:59.203854 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1121/2162] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:06:59 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:00.226238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dfc36ebb-2957-40df-a7a0-14fb2c2de84b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:00.226812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dfc36ebb-2957-40df-a7a0-14fb2c2de84b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:00.233260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfc36ebb-2957-40df-a7a0-14fb2c2de84b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:00.233743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfc36ebb-2957-40df-a7a0-14fb2c2de84b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:00.234180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfc36ebb-2957-40df-a7a0-14fb2c2de84b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:00.234914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfc36ebb-2957-40df-a7a0-14fb2c2de84b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:00.235367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfc36ebb-2957-40df-a7a0-14fb2c2de84b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:00.235792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfc36ebb-2957-40df-a7a0-14fb2c2de84b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:00.298653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dfc36ebb-2957-40df-a7a0-14fb2c2de84b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:00.306729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dfc36ebb-2957-40df-a7a0-14fb2c2de84b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084454 Sep 02 10:07:00.307292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1042/2163] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:00 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:01.328160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-71be9540-659f-42f1-bb2a-794102792dae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:01.328689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-71be9540-659f-42f1-bb2a-794102792dae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:01.335041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71be9540-659f-42f1-bb2a-794102792dae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:01.335521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71be9540-659f-42f1-bb2a-794102792dae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:01.335954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71be9540-659f-42f1-bb2a-794102792dae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:01.336628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71be9540-659f-42f1-bb2a-794102792dae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:01.337076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71be9540-659f-42f1-bb2a-794102792dae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:01.337494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71be9540-659f-42f1-bb2a-794102792dae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:01.397768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-71be9540-659f-42f1-bb2a-794102792dae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:01.406023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-71be9540-659f-42f1-bb2a-794102792dae tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082312 Sep 02 10:07:01.406595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1122/2164] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:01 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:02.427204 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b9b91efa-3f14-4cd0-9635-d7d13765505b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:02.427843 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b9b91efa-3f14-4cd0-9635-d7d13765505b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:02.433896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9b91efa-3f14-4cd0-9635-d7d13765505b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:02.434378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9b91efa-3f14-4cd0-9635-d7d13765505b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:02.434841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9b91efa-3f14-4cd0-9635-d7d13765505b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:02.435522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9b91efa-3f14-4cd0-9635-d7d13765505b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:02.435972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9b91efa-3f14-4cd0-9635-d7d13765505b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:02.436393 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b9b91efa-3f14-4cd0-9635-d7d13765505b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:02.497490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b9b91efa-3f14-4cd0-9635-d7d13765505b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:02.505985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b9b91efa-3f14-4cd0-9635-d7d13765505b tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082791 Sep 02 10:07:02.506554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1043/2165] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:02 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:03.527365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ccac76bc-1dca-499b-8440-ed9cf049716c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:03.527979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ccac76bc-1dca-499b-8440-ed9cf049716c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:03.534863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccac76bc-1dca-499b-8440-ed9cf049716c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:03.535346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccac76bc-1dca-499b-8440-ed9cf049716c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:03.535791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccac76bc-1dca-499b-8440-ed9cf049716c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:03.536471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccac76bc-1dca-499b-8440-ed9cf049716c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:03.536924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccac76bc-1dca-499b-8440-ed9cf049716c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:03.537348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ccac76bc-1dca-499b-8440-ed9cf049716c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:03.597973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ccac76bc-1dca-499b-8440-ed9cf049716c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:03.606036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ccac76bc-1dca-499b-8440-ed9cf049716c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082560 Sep 02 10:07:03.607319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1123/2166] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:03 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:04.628073 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-42e86bf5-858b-4650-90c4-cb561e8a7997 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:04.628696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-42e86bf5-858b-4650-90c4-cb561e8a7997 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:04.631003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=28 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:07:04.635783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42e86bf5-858b-4650-90c4-cb561e8a7997 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:04.636265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42e86bf5-858b-4650-90c4-cb561e8a7997 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:04.636700 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42e86bf5-858b-4650-90c4-cb561e8a7997 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:04.637379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42e86bf5-858b-4650-90c4-cb561e8a7997 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:04.637828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42e86bf5-858b-4650-90c4-cb561e8a7997 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:04.638250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42e86bf5-858b-4650-90c4-cb561e8a7997 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:04.640808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=84 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:07:04.700347 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-42e86bf5-858b-4650-90c4-cb561e8a7997 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:04.708330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-42e86bf5-858b-4650-90c4-cb561e8a7997 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.084098 Sep 02 10:07:04.708889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1044/2167] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:04 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:05.728385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fcc99aa5-b9bd-4250-902b-ff2d9c931abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:05.729004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fcc99aa5-b9bd-4250-902b-ff2d9c931abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:05.736167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcc99aa5-b9bd-4250-902b-ff2d9c931abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:05.736656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcc99aa5-b9bd-4250-902b-ff2d9c931abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:05.737096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcc99aa5-b9bd-4250-902b-ff2d9c931abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:05.737787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcc99aa5-b9bd-4250-902b-ff2d9c931abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:05.738242 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcc99aa5-b9bd-4250-902b-ff2d9c931abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:05.738668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fcc99aa5-b9bd-4250-902b-ff2d9c931abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:05.799226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fcc99aa5-b9bd-4250-902b-ff2d9c931abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:05.807487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fcc99aa5-b9bd-4250-902b-ff2d9c931abb tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082978 Sep 02 10:07:05.808060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1124/2168] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:05 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:06.828306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-17c20b60-d6cd-4958-a77c-ae802ee48ace tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:06.828919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-17c20b60-d6cd-4958-a77c-ae802ee48ace tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:06.835425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17c20b60-d6cd-4958-a77c-ae802ee48ace tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:06.850532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17c20b60-d6cd-4958-a77c-ae802ee48ace tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:06.850532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17c20b60-d6cd-4958-a77c-ae802ee48ace tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:06.850532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17c20b60-d6cd-4958-a77c-ae802ee48ace tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:06.850532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17c20b60-d6cd-4958-a77c-ae802ee48ace tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:06.851620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-17c20b60-d6cd-4958-a77c-ae802ee48ace tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:06.899350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-17c20b60-d6cd-4958-a77c-ae802ee48ace tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:06.907648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-17c20b60-d6cd-4958-a77c-ae802ee48ace tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083272 Sep 02 10:07:06.908207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1045/2169] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:06 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:07.929110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b52bb26b-3491-4008-ac73-2997596dc2e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:07.929717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b52bb26b-3491-4008-ac73-2997596dc2e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:07.935962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b52bb26b-3491-4008-ac73-2997596dc2e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:07.936444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b52bb26b-3491-4008-ac73-2997596dc2e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:07.936875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b52bb26b-3491-4008-ac73-2997596dc2e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:07.937843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b52bb26b-3491-4008-ac73-2997596dc2e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:07.938296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b52bb26b-3491-4008-ac73-2997596dc2e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:07.938728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b52bb26b-3491-4008-ac73-2997596dc2e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:07.998754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b52bb26b-3491-4008-ac73-2997596dc2e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:08.006878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b52bb26b-3491-4008-ac73-2997596dc2e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.081616 Sep 02 10:07:08.007420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1125/2170] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:07 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:09.026762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e22cbfa7-0078-4d40-a05f-702335d6afbf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:09.027312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e22cbfa7-0078-4d40-a05f-702335d6afbf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:09.033800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e22cbfa7-0078-4d40-a05f-702335d6afbf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:09.034283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e22cbfa7-0078-4d40-a05f-702335d6afbf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:09.034741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e22cbfa7-0078-4d40-a05f-702335d6afbf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:09.035427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e22cbfa7-0078-4d40-a05f-702335d6afbf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:09.035909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e22cbfa7-0078-4d40-a05f-702335d6afbf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:09.036336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e22cbfa7-0078-4d40-a05f-702335d6afbf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:09.101283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e22cbfa7-0078-4d40-a05f-702335d6afbf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:09.109511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e22cbfa7-0078-4d40-a05f-702335d6afbf tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.086732 Sep 02 10:07:09.110074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1046/2171] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:09 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:10.130391 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b71d71e3-887f-4884-846c-f75eeeb3c758 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:10.130965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b71d71e3-887f-4884-846c-f75eeeb3c758 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:10.137368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b71d71e3-887f-4884-846c-f75eeeb3c758 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:10.137852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b71d71e3-887f-4884-846c-f75eeeb3c758 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:10.138285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b71d71e3-887f-4884-846c-f75eeeb3c758 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:10.139056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b71d71e3-887f-4884-846c-f75eeeb3c758 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:10.139504 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b71d71e3-887f-4884-846c-f75eeeb3c758 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:10.139922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b71d71e3-887f-4884-846c-f75eeeb3c758 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:10.201302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b71d71e3-887f-4884-846c-f75eeeb3c758 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:10.209601 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b71d71e3-887f-4884-846c-f75eeeb3c758 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083117 Sep 02 10:07:10.210119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1126/2172] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:10 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:11.230786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d4ae9be-600e-4233-bfa9-a9d86cfc61c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:11.231343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5d4ae9be-600e-4233-bfa9-a9d86cfc61c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:11.234065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:07:11.234236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 (ip 10.222.0.57) !!! Sep 02 10:07:11.243606 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d4ae9be-600e-4233-bfa9-a9d86cfc61c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:11.244081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d4ae9be-600e-4233-bfa9-a9d86cfc61c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:11.244516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d4ae9be-600e-4233-bfa9-a9d86cfc61c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:11.245193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d4ae9be-600e-4233-bfa9-a9d86cfc61c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:11.245640 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d4ae9be-600e-4233-bfa9-a9d86cfc61c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:11.246063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5d4ae9be-600e-4233-bfa9-a9d86cfc61c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:11.307608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5d4ae9be-600e-4233-bfa9-a9d86cfc61c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:11.316156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5d4ae9be-600e-4233-bfa9-a9d86cfc61c1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.089425 Sep 02 10:07:11.316712 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1047/2173] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:11 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:12.336822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bcd5eed1-02b5-466b-a867-ca3177b3a43d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:12.337370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bcd5eed1-02b5-466b-a867-ca3177b3a43d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:12.343947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd5eed1-02b5-466b-a867-ca3177b3a43d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:12.344431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd5eed1-02b5-466b-a867-ca3177b3a43d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:12.344868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd5eed1-02b5-466b-a867-ca3177b3a43d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:12.345549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd5eed1-02b5-466b-a867-ca3177b3a43d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:12.345999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd5eed1-02b5-466b-a867-ca3177b3a43d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:12.346423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcd5eed1-02b5-466b-a867-ca3177b3a43d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:12.410062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bcd5eed1-02b5-466b-a867-ca3177b3a43d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:12.418378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bcd5eed1-02b5-466b-a867-ca3177b3a43d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085459 Sep 02 10:07:12.418982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1127/2174] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:12 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:07:13.439162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-00b5ba4f-3e55-4aaf-a905-ab003af23b06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:13.439769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-00b5ba4f-3e55-4aaf-a905-ab003af23b06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:13.446218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00b5ba4f-3e55-4aaf-a905-ab003af23b06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:13.446699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00b5ba4f-3e55-4aaf-a905-ab003af23b06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:13.447158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00b5ba4f-3e55-4aaf-a905-ab003af23b06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:13.447844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00b5ba4f-3e55-4aaf-a905-ab003af23b06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:13.448298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00b5ba4f-3e55-4aaf-a905-ab003af23b06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:13.448741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00b5ba4f-3e55-4aaf-a905-ab003af23b06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:13.509823 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-00b5ba4f-3e55-4aaf-a905-ab003af23b06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:13.518165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-00b5ba4f-3e55-4aaf-a905-ab003af23b06 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082852 Sep 02 10:07:13.518786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1048/2175] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:13 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:14.539181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e11e71fd-41e3-4bec-bf42-7714887d6647 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:14.539798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e11e71fd-41e3-4bec-bf42-7714887d6647 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:14.542036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:07:14.542166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 10:07:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 (ip 10.222.0.57) !!! Sep 02 10:07:14.548933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e11e71fd-41e3-4bec-bf42-7714887d6647 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:14.549406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e11e71fd-41e3-4bec-bf42-7714887d6647 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:14.549864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e11e71fd-41e3-4bec-bf42-7714887d6647 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:14.550543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e11e71fd-41e3-4bec-bf42-7714887d6647 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:14.551701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e11e71fd-41e3-4bec-bf42-7714887d6647 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:14.552127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e11e71fd-41e3-4bec-bf42-7714887d6647 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:14.618358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e11e71fd-41e3-4bec-bf42-7714887d6647 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:14.626651 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e11e71fd-41e3-4bec-bf42-7714887d6647 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.091347 Sep 02 10:07:14.627241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1128/2176] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:14 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:15.647643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e15502e2-24fa-48e6-90cf-cf607d4c03c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:15.648273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e15502e2-24fa-48e6-90cf-cf607d4c03c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:15.655139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e15502e2-24fa-48e6-90cf-cf607d4c03c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:15.655614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e15502e2-24fa-48e6-90cf-cf607d4c03c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:15.656048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e15502e2-24fa-48e6-90cf-cf607d4c03c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:15.656717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e15502e2-24fa-48e6-90cf-cf607d4c03c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:15.657164 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e15502e2-24fa-48e6-90cf-cf607d4c03c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:15.657581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e15502e2-24fa-48e6-90cf-cf607d4c03c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:15.717872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e15502e2-24fa-48e6-90cf-cf607d4c03c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:15.725836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e15502e2-24fa-48e6-90cf-cf607d4c03c2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.082089 Sep 02 10:07:15.726390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1049/2177] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:15 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:16.747378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c95efb42-904a-468f-b99b-e7787d3a1f62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:16.748461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c95efb42-904a-468f-b99b-e7787d3a1f62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:16.754967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c95efb42-904a-468f-b99b-e7787d3a1f62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:16.755451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c95efb42-904a-468f-b99b-e7787d3a1f62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:16.755886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c95efb42-904a-468f-b99b-e7787d3a1f62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:16.756561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c95efb42-904a-468f-b99b-e7787d3a1f62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:16.757006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c95efb42-904a-468f-b99b-e7787d3a1f62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:16.757427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c95efb42-904a-468f-b99b-e7787d3a1f62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:16.818682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c95efb42-904a-468f-b99b-e7787d3a1f62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:16.826763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c95efb42-904a-468f-b99b-e7787d3a1f62 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083456 Sep 02 10:07:16.831914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1129/2178] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:16 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:17.848476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fe152ae3-a347-4602-adcd-606d6c9bbedd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:17.849176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fe152ae3-a347-4602-adcd-606d6c9bbedd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:17.855609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe152ae3-a347-4602-adcd-606d6c9bbedd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:17.856085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe152ae3-a347-4602-adcd-606d6c9bbedd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:17.856513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe152ae3-a347-4602-adcd-606d6c9bbedd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:17.857218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe152ae3-a347-4602-adcd-606d6c9bbedd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:17.857663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe152ae3-a347-4602-adcd-606d6c9bbedd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:17.858079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fe152ae3-a347-4602-adcd-606d6c9bbedd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:17.921716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fe152ae3-a347-4602-adcd-606d6c9bbedd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:17.929880 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fe152ae3-a347-4602-adcd-606d6c9bbedd tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.085225 Sep 02 10:07:17.930442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1050/2179] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:17 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:18.950427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6f4a58d4-bc35-4577-b990-b16007fd795e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:18.951053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6f4a58d4-bc35-4577-b990-b16007fd795e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: a2bccc75-d837-4a98-8a78-841b2edb8ce5] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:07:18.957425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4a58d4-bc35-4577-b990-b16007fd795e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:18.957977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4a58d4-bc35-4577-b990-b16007fd795e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:18.958410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4a58d4-bc35-4577-b990-b16007fd795e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:18.959121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4a58d4-bc35-4577-b990-b16007fd795e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:07:18.959587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4a58d4-bc35-4577-b990-b16007fd795e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:07:18.959993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f4a58d4-bc35-4577-b990-b16007fd795e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:07:19.022232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6f4a58d4-bc35-4577-b990-b16007fd795e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:07:19.030367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6f4a58d4-bc35-4577-b990-b16007fd795e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5" status: 200 len: 1376 microversion: 2.1 time: 0.083817 Sep 02 10:07:19.030955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1130/2180] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:07:18 2022] GET /compute/v2.1/servers/a2bccc75-d837-4a98-8a78-841b2edb8ce5 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:07:19.050214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-56568851-b83b-4f47-a831-5b1b2f924f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '.version_select at 0x7f4e5c3f7d30>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:07:19.114595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-56568851-b83b-4f47-a831-5b1b2f924f2e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-160664394" status: 202 len: 0 microversion: 2.1 time: 0.068075 Sep 02 10:07:19.115117 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1051/2181] 10.222.0.57 () {58 vars in 1218 bytes} [Fri Sep 2 10:07:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-160664394 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:08:48.139602 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=21 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:08:48.140483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=71 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:08:48.145031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10889638-3b1f-4745-9169-cce449300a7e"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:08:48.147578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:48.153500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:48.154087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:48.154574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:48.155352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:48.155804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:48.156236 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:48.358726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [302f5a15-9235-4699-9c0f-3c55b75ae57c] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 10:08:49.365755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [302f5a15-9235-4699-9c0f-3c55b75ae57c] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 57360. Sep 02 10:08:50.227818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e9ad9878-e3a9-4520-a97e-ed1013440e38 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "POST /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.086096 Sep 02 10:08:50.227818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1131/2182] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 10:08:48 2022] POST /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments => generated 194 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:08:50.686940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=41 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:08:50.687916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:08:50.691864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:50.692469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:50.699386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:50.699866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:50.700295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:50.700974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:50.701420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:50.701845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:50.726518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:08:50.921254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [cbd594e0-924f-4e7a-936b-b12f86fd11e1] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 10:08:51.091750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-3ff1bd03-19d2-438b-b8ce-f607b342af4a req-77a1ec63-d1b9-4836-bdfe-0ccf29431741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94dc7b98-31d1-406f-9070-26ccfe00e15b", "name": "network-vif-deleted", "tag": "6b7348aa-d687-4af3-a6bc-a5bf38d3cb42"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:08:51.104990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3ff1bd03-19d2-438b-b8ce-f607b342af4a req-77a1ec63-d1b9-4836-bdfe-0ccf29431741 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:51.104990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3ff1bd03-19d2-438b-b8ce-f607b342af4a req-77a1ec63-d1b9-4836-bdfe-0ccf29431741 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:51.104990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3ff1bd03-19d2-438b-b8ce-f607b342af4a req-77a1ec63-d1b9-4836-bdfe-0ccf29431741 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:51.113577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-3ff1bd03-19d2-438b-b8ce-f607b342af4a req-77a1ec63-d1b9-4836-bdfe-0ccf29431741 service nova] Creating event network-vif-deleted:6b7348aa-d687-4af3-a6bc-a5bf38d3cb42 for instance 94dc7b98-31d1-406f-9070-26ccfe00e15b on hv-cinder-85083 Sep 02 10:08:51.119336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-3ff1bd03-19d2-438b-b8ce-f607b342af4a req-77a1ec63-d1b9-4836-bdfe-0ccf29431741 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144834 Sep 02 10:08:51.119927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1132/2183] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:08:51.239546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:08:51.239865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:08:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e (ip 10.222.0.57) !!! Sep 02 10:08:51.928662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [cbd594e0-924f-4e7a-936b-b12f86fd11e1] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 57396. Sep 02 10:08:52.030691 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3a25bac4-83e2-4b06-8820-f0cd352eaa96 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 204 len: 0 microversion: 2.1 time: 1.345749 Sep 02 10:08:52.031325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1052/2184] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:08:50 2022] DELETE /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 0 bytes in 1347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:08:52.039924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0f27f7de-04a9-42b6-8b0a-83a366723e7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:52.040615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0f27f7de-04a9-42b6-8b0a-83a366723e7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:52.047352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f27f7de-04a9-42b6-8b0a-83a366723e7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:52.047869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f27f7de-04a9-42b6-8b0a-83a366723e7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:52.048312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f27f7de-04a9-42b6-8b0a-83a366723e7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:52.049032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f27f7de-04a9-42b6-8b0a-83a366723e7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:52.049485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f27f7de-04a9-42b6-8b0a-83a366723e7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:52.049912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0f27f7de-04a9-42b6-8b0a-83a366723e7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:52.183200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0f27f7de-04a9-42b6-8b0a-83a366723e7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:08:52.190727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0f27f7de-04a9-42b6-8b0a-83a366723e7f tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1509 microversion: 2.1 time: 0.155155 Sep 02 10:08:52.191302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1133/2185] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:52 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:08:53.211081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-00ed578b-633a-42e2-a9e4-279dd07731fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:53.212261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-00ed578b-633a-42e2-a9e4-279dd07731fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:53.218619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00ed578b-633a-42e2-a9e4-279dd07731fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:53.219120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00ed578b-633a-42e2-a9e4-279dd07731fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:53.219550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00ed578b-633a-42e2-a9e4-279dd07731fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:53.220217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00ed578b-633a-42e2-a9e4-279dd07731fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:53.220662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00ed578b-633a-42e2-a9e4-279dd07731fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:53.221078 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00ed578b-633a-42e2-a9e4-279dd07731fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:53.352096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-00ed578b-633a-42e2-a9e4-279dd07731fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:08:53.360636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-00ed578b-633a-42e2-a9e4-279dd07731fe tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1509 microversion: 2.1 time: 0.153796 Sep 02 10:08:53.361244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1053/2186] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:53 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:08:54.381235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-051c270a-baba-4cc8-b21d-42f58e19d33e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:54.381789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-051c270a-baba-4cc8-b21d-42f58e19d33e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:54.388204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-051c270a-baba-4cc8-b21d-42f58e19d33e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:54.388687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-051c270a-baba-4cc8-b21d-42f58e19d33e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:54.389130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-051c270a-baba-4cc8-b21d-42f58e19d33e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:54.389813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-051c270a-baba-4cc8-b21d-42f58e19d33e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:54.390260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-051c270a-baba-4cc8-b21d-42f58e19d33e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:54.390682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-051c270a-baba-4cc8-b21d-42f58e19d33e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:54.517320 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-051c270a-baba-4cc8-b21d-42f58e19d33e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:08:54.525020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-051c270a-baba-4cc8-b21d-42f58e19d33e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1509 microversion: 2.1 time: 0.147700 Sep 02 10:08:54.525584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1134/2187] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:54 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:08:55.546537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c1e39888-38d9-483b-8a7f-663495bcf0e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:55.547360 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c1e39888-38d9-483b-8a7f-663495bcf0e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:55.555311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1e39888-38d9-483b-8a7f-663495bcf0e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:55.555975 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1e39888-38d9-483b-8a7f-663495bcf0e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:55.556420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1e39888-38d9-483b-8a7f-663495bcf0e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:55.557521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1e39888-38d9-483b-8a7f-663495bcf0e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:55.558013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1e39888-38d9-483b-8a7f-663495bcf0e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:55.558449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c1e39888-38d9-483b-8a7f-663495bcf0e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:55.690427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c1e39888-38d9-483b-8a7f-663495bcf0e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:08:55.698031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c1e39888-38d9-483b-8a7f-663495bcf0e2 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1509 microversion: 2.1 time: 0.155805 Sep 02 10:08:55.698584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1054/2188] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:55 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:08:56.545035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1227064218", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "networks": [{"uuid": "f7abc83e-41de-4b14-a83d-2791ce6d6171"}]}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:08:56.617933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.network.neutron [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] validate_networks() for [('f7abc83e-41de-4b14-a83d-2791ce6d6171', None, None, None, None, None)] {{(pid=127533) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 10:08:56.718569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-24044245-62bd-40cc-9df0-fff174518d25 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:56.719214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-24044245-62bd-40cc-9df0-fff174518d25 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:56.725621 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24044245-62bd-40cc-9df0-fff174518d25 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:56.726104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24044245-62bd-40cc-9df0-fff174518d25 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:56.726537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24044245-62bd-40cc-9df0-fff174518d25 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:56.727252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24044245-62bd-40cc-9df0-fff174518d25 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:56.728600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24044245-62bd-40cc-9df0-fff174518d25 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:56.728737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24044245-62bd-40cc-9df0-fff174518d25 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:56.870102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-24044245-62bd-40cc-9df0-fff174518d25 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:08:56.883375 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-24044245-62bd-40cc-9df0-fff174518d25 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1509 microversion: 2.1 time: 0.168632 Sep 02 10:08:56.883949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1055/2189] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:56 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:08:57.083310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-8184affa-a2ac-4f30-838f-5c6e2ae01513 req-4d42b2d0-96f0-416d-ab1b-5b13936ae581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba2a7e8-15a8-4066-9554-49c48ea52a5e", "name": "network-vif-deleted", "tag": "71a514a3-ca0b-42e8-b44f-cede338a5920"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:08:57.093761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-8184affa-a2ac-4f30-838f-5c6e2ae01513 req-4d42b2d0-96f0-416d-ab1b-5b13936ae581 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:57.094742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-8184affa-a2ac-4f30-838f-5c6e2ae01513 req-4d42b2d0-96f0-416d-ab1b-5b13936ae581 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:57.095267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-8184affa-a2ac-4f30-838f-5c6e2ae01513 req-4d42b2d0-96f0-416d-ab1b-5b13936ae581 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:57.107005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-8184affa-a2ac-4f30-838f-5c6e2ae01513 req-4d42b2d0-96f0-416d-ab1b-5b13936ae581 service nova] Creating event network-vif-deleted:71a514a3-ca0b-42e8-b44f-cede338a5920 for instance 7ba2a7e8-15a8-4066-9554-49c48ea52a5e on hv-cinder-85083 Sep 02 10:08:57.112298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-8184affa-a2ac-4f30-838f-5c6e2ae01513 req-4d42b2d0-96f0-416d-ab1b-5b13936ae581 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033684 Sep 02 10:08:57.113048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1056/2190] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:08:57.196201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Flavor limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 10:08:57.196495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Image limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 10:08:57.197010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Flavor pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 10:08:57.197425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Image pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 10:08:57.197842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 10:08:57.206730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:57.207240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:57.207672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:57.208397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:57.208846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:57.209270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:57.226284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Getting quotas for project 7232d6277f26496ab552afa4abe13ad5. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:08:57.230921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Getting quotas for user 889d4c60870447bda2926106026a0537 and project 7232d6277f26496ab552afa4abe13ad5. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:08:57.242099 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Going to run 1 instances... {{(pid=127533) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 10:08:57.244404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127533) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 10:08:57.361205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-47eee9a6-f8f7-4af0-ba78-8679a7755c62 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820238 Sep 02 10:08:57.368132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1135/2191] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 10:08:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 10:08:57.374285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a610f29d-6bb4-4a01-9ada-4f0637105589 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:57.375021 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a610f29d-6bb4-4a01-9ada-4f0637105589 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:57.438637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a610f29d-6bb4-4a01-9ada-4f0637105589 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:08:57.448002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a610f29d-6bb4-4a01-9ada-4f0637105589 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1219 microversion: 2.1 time: 0.077863 Sep 02 10:08:57.449240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1057/2192] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:57 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:08:57.905144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:57.905950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:57.913359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:57.913937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:57.914510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:57.915264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:57.915721 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:57.916156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:57.948177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:57.948689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:57.949121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:57.949613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'fault' on Instance uuid 7ba2a7e8-15a8-4066-9554-49c48ea52a5e {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:08:57.992712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:08:57.999385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ca21f140-e025-4b77-bccb-7dd051ed858c tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 200 len: 1312 microversion: 2.1 time: 0.098802 Sep 02 10:08:58.000255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1136/2193] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:57 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:08:58.468895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-42a7c0c2-01fd-4201-acd6-cfa3a49086b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:58.469609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-42a7c0c2-01fd-4201-acd6-cfa3a49086b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:58.477965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42a7c0c2-01fd-4201-acd6-cfa3a49086b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:58.478453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42a7c0c2-01fd-4201-acd6-cfa3a49086b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:58.478916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42a7c0c2-01fd-4201-acd6-cfa3a49086b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:58.479593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42a7c0c2-01fd-4201-acd6-cfa3a49086b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:58.480040 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42a7c0c2-01fd-4201-acd6-cfa3a49086b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:58.480461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-42a7c0c2-01fd-4201-acd6-cfa3a49086b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:58.793420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-42a7c0c2-01fd-4201-acd6-cfa3a49086b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:08:58.801862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-42a7c0c2-01fd-4201-acd6-cfa3a49086b9 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1223 microversion: 2.1 time: 0.336761 Sep 02 10:08:58.802441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1058/2194] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:58 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1223 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:08:59.021096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:59.021723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 7ba2a7e8-15a8-4066-9554-49c48ea52a5e] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:59.028884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:59.029357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:59.029826 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:59.030512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:59.031022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:59.031451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:59.045091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Instance 7ba2a7e8-15a8-4066-9554-49c48ea52a5e could not be found. Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e HTTP/1.1 Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:08:59.046756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance 7ba2a7e8-15a8-4066-9554-49c48ea52a5e could not be found. Sep 02 10:08:59.051203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '7ba2a7e8-15a8-4066-9554-49c48ea52a5e'} Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba2a7e8-15a8-4066-9554-49c48ea52a5e could not be found. Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:08:59.052101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba2a7e8-15a8-4066-9554-49c48ea52a5e could not be found. Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba2a7e8-15a8-4066-9554-49c48ea52a5e could not be found. Sep 02 10:08:59.053609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:08:59.054973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 404 to user: Instance 7ba2a7e8-15a8-4066-9554-49c48ea52a5e could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:08:59.054973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0092b00b-d9a3-4b0e-90cf-3911b72260f3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e" status: 404 len: 111 microversion: 2.1 time: 0.031113 Sep 02 10:08:59.054973 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1137/2195] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:59 2022] GET /compute/v2.1/servers/7ba2a7e8-15a8-4066-9554-49c48ea52a5e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:08:59.057192 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5550d9ca-e572-444d-9832-652a873704a1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:59.057689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5550d9ca-e572-444d-9832-652a873704a1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:59.063665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5550d9ca-e572-444d-9832-652a873704a1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:59.064144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5550d9ca-e572-444d-9832-652a873704a1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:59.064574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5550d9ca-e572-444d-9832-652a873704a1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:59.065249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5550d9ca-e572-444d-9832-652a873704a1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:59.065695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5550d9ca-e572-444d-9832-652a873704a1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:59.066116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5550d9ca-e572-444d-9832-652a873704a1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:59.091753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5550d9ca-e572-444d-9832-652a873704a1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:08:59.384889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5550d9ca-e572-444d-9832-652a873704a1 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 204 len: 0 microversion: 2.1 time: 0.331481 Sep 02 10:08:59.385505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1059/2196] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:08:59 2022] DELETE /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 10:08:59.393378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-266e9307-d0cc-4f66-b3e2-c76684662be5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:59.393995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-266e9307-d0cc-4f66-b3e2-c76684662be5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:59.400010 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-266e9307-d0cc-4f66-b3e2-c76684662be5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:59.400493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-266e9307-d0cc-4f66-b3e2-c76684662be5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:59.400931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-266e9307-d0cc-4f66-b3e2-c76684662be5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:59.401617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-266e9307-d0cc-4f66-b3e2-c76684662be5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:59.402070 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-266e9307-d0cc-4f66-b3e2-c76684662be5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:59.402497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-266e9307-d0cc-4f66-b3e2-c76684662be5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:59.531772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-266e9307-d0cc-4f66-b3e2-c76684662be5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:08:59.539380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-266e9307-d0cc-4f66-b3e2-c76684662be5 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.149815 Sep 02 10:08:59.540096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1138/2197] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:59 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:08:59.822484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-718a8c03-bfa7-40bf-b0e5-d0f4163dc00b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:08:59.823206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-718a8c03-bfa7-40bf-b0e5-d0f4163dc00b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:08:59.829795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-718a8c03-bfa7-40bf-b0e5-d0f4163dc00b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:59.830297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-718a8c03-bfa7-40bf-b0e5-d0f4163dc00b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:59.830752 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-718a8c03-bfa7-40bf-b0e5-d0f4163dc00b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:59.831434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-718a8c03-bfa7-40bf-b0e5-d0f4163dc00b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:08:59.831881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-718a8c03-bfa7-40bf-b0e5-d0f4163dc00b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:08:59.832299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-718a8c03-bfa7-40bf-b0e5-d0f4163dc00b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:08:59.897454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-718a8c03-bfa7-40bf-b0e5-d0f4163dc00b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:08:59.905023 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-718a8c03-bfa7-40bf-b0e5-d0f4163dc00b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1271 microversion: 2.1 time: 0.086798 Sep 02 10:08:59.905579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1060/2198] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:08:59 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:00.560494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-65e9aea5-9745-4d5e-b485-779a092b49e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:00.561070 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-65e9aea5-9745-4d5e-b485-779a092b49e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:00.567411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65e9aea5-9745-4d5e-b485-779a092b49e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:00.567899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65e9aea5-9745-4d5e-b485-779a092b49e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:00.568338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65e9aea5-9745-4d5e-b485-779a092b49e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:00.569029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65e9aea5-9745-4d5e-b485-779a092b49e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:00.569483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65e9aea5-9745-4d5e-b485-779a092b49e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:00.569911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-65e9aea5-9745-4d5e-b485-779a092b49e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:00.801249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-65e9aea5-9745-4d5e-b485-779a092b49e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:00.809350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-65e9aea5-9745-4d5e-b485-779a092b49e3 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1523 microversion: 2.1 time: 0.252827 Sep 02 10:09:00.809923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1139/2199] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:00 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:00.925381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bbe73f21-faf9-49da-9e08-1874d9cbae86 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:00.925992 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bbe73f21-faf9-49da-9e08-1874d9cbae86 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:00.933013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbe73f21-faf9-49da-9e08-1874d9cbae86 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:00.933491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbe73f21-faf9-49da-9e08-1874d9cbae86 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:00.933919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbe73f21-faf9-49da-9e08-1874d9cbae86 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:00.934591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbe73f21-faf9-49da-9e08-1874d9cbae86 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:00.935063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbe73f21-faf9-49da-9e08-1874d9cbae86 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:00.935482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bbe73f21-faf9-49da-9e08-1874d9cbae86 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:01.176556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bbe73f21-faf9-49da-9e08-1874d9cbae86 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:01.184930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bbe73f21-faf9-49da-9e08-1874d9cbae86 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1319 microversion: 2.1 time: 0.263393 Sep 02 10:09:01.185490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1061/2200] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:00 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:01.577947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-795a826b-f552-406c-9686-00c129f9db85 req-e663515c-83e7-4637-8953-ca75fcceff7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a68cef6-8c2a-42a1-9943-63f884381755", "name": "network-vif-deleted", "tag": "d8b74e21-08e3-4af5-9fc4-a78c1a42ff4c"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:01.588455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-795a826b-f552-406c-9686-00c129f9db85 req-e663515c-83e7-4637-8953-ca75fcceff7e service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:01.588969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-795a826b-f552-406c-9686-00c129f9db85 req-e663515c-83e7-4637-8953-ca75fcceff7e service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:01.589403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-795a826b-f552-406c-9686-00c129f9db85 req-e663515c-83e7-4637-8953-ca75fcceff7e service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:01.601316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-795a826b-f552-406c-9686-00c129f9db85 req-e663515c-83e7-4637-8953-ca75fcceff7e service nova] Creating event network-vif-deleted:d8b74e21-08e3-4af5-9fc4-a78c1a42ff4c for instance 5a68cef6-8c2a-42a1-9943-63f884381755 on hv-cinder-85083 Sep 02 10:09:01.607095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-795a826b-f552-406c-9686-00c129f9db85 req-e663515c-83e7-4637-8953-ca75fcceff7e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086590 Sep 02 10:09:01.607704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1140/2201] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:01.831422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4cb1cf9b-b290-44b0-9bfb-c7f471d8a12e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:01.832035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4cb1cf9b-b290-44b0-9bfb-c7f471d8a12e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:01.838692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4cb1cf9b-b290-44b0-9bfb-c7f471d8a12e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:01.839766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4cb1cf9b-b290-44b0-9bfb-c7f471d8a12e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:01.840407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4cb1cf9b-b290-44b0-9bfb-c7f471d8a12e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:01.841270 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4cb1cf9b-b290-44b0-9bfb-c7f471d8a12e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:01.842008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4cb1cf9b-b290-44b0-9bfb-c7f471d8a12e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:01.842614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4cb1cf9b-b290-44b0-9bfb-c7f471d8a12e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:01.925652 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4cb1cf9b-b290-44b0-9bfb-c7f471d8a12e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:01.940702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4cb1cf9b-b290-44b0-9bfb-c7f471d8a12e tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1481 microversion: 2.1 time: 0.112370 Sep 02 10:09:01.942077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1062/2202] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:01 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1481 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:09:02.020606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-68c1e7ea-bf64-4646-8a32-54c79f27ef8c req-0ace2cba-bb31-4046-bbf3-2949f14cac08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a86dc04-b6ca-442f-9a4c-eb9c7da928c0", "tag": "63624fb5-a715-45e4-a1b6-1fd48b7c86bf"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:02.030076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-68c1e7ea-bf64-4646-8a32-54c79f27ef8c req-0ace2cba-bb31-4046-bbf3-2949f14cac08 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:02.030564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-68c1e7ea-bf64-4646-8a32-54c79f27ef8c req-0ace2cba-bb31-4046-bbf3-2949f14cac08 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:02.031015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-68c1e7ea-bf64-4646-8a32-54c79f27ef8c req-0ace2cba-bb31-4046-bbf3-2949f14cac08 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:02.041948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-68c1e7ea-bf64-4646-8a32-54c79f27ef8c req-0ace2cba-bb31-4046-bbf3-2949f14cac08 service nova] Creating event network-changed:63624fb5-a715-45e4-a1b6-1fd48b7c86bf for instance 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 on hv-cinder-85083 Sep 02 10:09:02.046943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-68c1e7ea-bf64-4646-8a32-54c79f27ef8c req-0ace2cba-bb31-4046-bbf3-2949f14cac08 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030340 Sep 02 10:09:02.047612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1141/2203] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:02.205606 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-60ad031f-431f-4191-9325-90652c919a51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:02.206217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-60ad031f-431f-4191-9325-90652c919a51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:02.212794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60ad031f-431f-4191-9325-90652c919a51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:02.213268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60ad031f-431f-4191-9325-90652c919a51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:02.213726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60ad031f-431f-4191-9325-90652c919a51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:02.214400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60ad031f-431f-4191-9325-90652c919a51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:02.214874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60ad031f-431f-4191-9325-90652c919a51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:02.215294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60ad031f-431f-4191-9325-90652c919a51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:02.345105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-60ad031f-431f-4191-9325-90652c919a51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:02.353311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-60ad031f-431f-4191-9325-90652c919a51 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1319 microversion: 2.1 time: 0.151569 Sep 02 10:09:02.353871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1063/2204] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:02 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:02.962957 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-608d02ab-506b-468e-8e03-ad527aaf5a76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:02.963656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-608d02ab-506b-468e-8e03-ad527aaf5a76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:02.969689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-608d02ab-506b-468e-8e03-ad527aaf5a76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:02.970171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-608d02ab-506b-468e-8e03-ad527aaf5a76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:02.970611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-608d02ab-506b-468e-8e03-ad527aaf5a76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:02.971336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-608d02ab-506b-468e-8e03-ad527aaf5a76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:02.971789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-608d02ab-506b-468e-8e03-ad527aaf5a76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:02.972216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-608d02ab-506b-468e-8e03-ad527aaf5a76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:03.033759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-608d02ab-506b-468e-8e03-ad527aaf5a76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:03.042040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-608d02ab-506b-468e-8e03-ad527aaf5a76 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1307 microversion: 2.1 time: 0.084227 Sep 02 10:09:03.042930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1142/2205] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:02 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1307 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:03.373599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8872c125-2fb6-4d19-8045-30410f6f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:03.374276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8872c125-2fb6-4d19-8045-30410f6f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:03.382453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8872c125-2fb6-4d19-8045-30410f6f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:03.387448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8872c125-2fb6-4d19-8045-30410f6f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:03.387448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8872c125-2fb6-4d19-8045-30410f6f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:03.387448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8872c125-2fb6-4d19-8045-30410f6f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:03.387448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8872c125-2fb6-4d19-8045-30410f6f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:03.388091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8872c125-2fb6-4d19-8045-30410f6f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:03.525916 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8872c125-2fb6-4d19-8045-30410f6f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:03.536684 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8872c125-2fb6-4d19-8045-30410f6f20e0 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1319 microversion: 2.1 time: 0.164239 Sep 02 10:09:03.536684 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1064/2206] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:03 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:04.062633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:04.063302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:04.069854 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:04.070337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:04.070801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:04.072009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:04.072461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:04.072927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:04.109831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:04.110331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:04.110802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:04.111294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'fault' on Instance uuid 5a68cef6-8c2a-42a1-9943-63f884381755 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:09:04.122699 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9db2944d-ffea-4886-91ea-0603216ae86f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:04.125076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9db2944d-ffea-4886-91ea-0603216ae86f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:04.131668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db2944d-ffea-4886-91ea-0603216ae86f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:04.132244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db2944d-ffea-4886-91ea-0603216ae86f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:04.132855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db2944d-ffea-4886-91ea-0603216ae86f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:04.134121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db2944d-ffea-4886-91ea-0603216ae86f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:04.134637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db2944d-ffea-4886-91ea-0603216ae86f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:04.135085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9db2944d-ffea-4886-91ea-0603216ae86f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:04.155104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:04.162984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-17eb288a-6880-4237-90f8-fe110c3670e4 tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1312 microversion: 2.1 time: 0.104791 Sep 02 10:09:04.163547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1143/2207] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:04 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:04.164888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9db2944d-ffea-4886-91ea-0603216ae86f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046718 Sep 02 10:09:04.165443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1065/2208] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:09:04 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:09:04.182877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3219b88b-2614-46da-8938-9888be9914ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:04.183365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3219b88b-2614-46da-8938-9888be9914ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:04.189154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3219b88b-2614-46da-8938-9888be9914ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:04.189629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3219b88b-2614-46da-8938-9888be9914ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:04.190066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3219b88b-2614-46da-8938-9888be9914ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:04.190764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3219b88b-2614-46da-8938-9888be9914ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:04.191217 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3219b88b-2614-46da-8938-9888be9914ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:04.191637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3219b88b-2614-46da-8938-9888be9914ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:04.221607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3219b88b-2614-46da-8938-9888be9914ce tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments/10889638-3b1f-4745-9169-cce449300a7e" status: 200 len: 194 microversion: 2.1 time: 0.042472 Sep 02 10:09:04.222173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1144/2209] 10.222.0.57 () {58 vars in 1413 bytes} [Fri Sep 2 10:09:04 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments/10889638-3b1f-4745-9169-cce449300a7e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:09:04.554892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-956e09e5-bb93-44af-a7a2-816a2a62c0d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:04.556102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-956e09e5-bb93-44af-a7a2-816a2a62c0d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:04.562350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-956e09e5-bb93-44af-a7a2-816a2a62c0d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:04.562859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-956e09e5-bb93-44af-a7a2-816a2a62c0d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:04.563294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-956e09e5-bb93-44af-a7a2-816a2a62c0d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:04.563972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-956e09e5-bb93-44af-a7a2-816a2a62c0d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:04.564417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-956e09e5-bb93-44af-a7a2-816a2a62c0d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:04.564833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-956e09e5-bb93-44af-a7a2-816a2a62c0d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:04.695404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-956e09e5-bb93-44af-a7a2-816a2a62c0d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:04.699900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:04.704268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-956e09e5-bb93-44af-a7a2-816a2a62c0d6 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1319 microversion: 2.1 time: 0.153187 Sep 02 10:09:04.705092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1066/2210] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:04 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:05.184406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:05.185028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:05.191392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:05.191878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:05.192318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:05.193000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:05.193456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:05.193883 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:05.224374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:05.224848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:05.225283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:05.225724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lazy-loading 'fault' on Instance uuid 5a68cef6-8c2a-42a1-9943-63f884381755 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:09:05.265358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c79aaf1f72634eefb5e89c8005afe54b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2945ae512e14bfbb7d02dedc4de7cd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:05.272804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6ae2e645-3539-49bf-b1cc-c04703c3729d tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 200 len: 1312 microversion: 2.1 time: 0.092909 Sep 02 10:09:05.273365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1145/2211] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:05 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:05.724756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ca3466c6-6b75-4402-9ad0-942443fe47ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:05.725418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ca3466c6-6b75-4402-9ad0-942443fe47ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:05.732928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca3466c6-6b75-4402-9ad0-942443fe47ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:05.733414 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca3466c6-6b75-4402-9ad0-942443fe47ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:05.733854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca3466c6-6b75-4402-9ad0-942443fe47ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:05.734534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca3466c6-6b75-4402-9ad0-942443fe47ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:05.735015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca3466c6-6b75-4402-9ad0-942443fe47ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:05.739210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ca3466c6-6b75-4402-9ad0-942443fe47ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:05.836400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-91bb0eb0-97d8-44ff-b799-0c9fe26aaa51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e04105d3-883f-43ad-9ccd-902c75a1f434"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:05.843203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-91bb0eb0-97d8-44ff-b799-0c9fe26aaa51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:05.849459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bb0eb0-97d8-44ff-b799-0c9fe26aaa51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:05.849459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bb0eb0-97d8-44ff-b799-0c9fe26aaa51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:05.849459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bb0eb0-97d8-44ff-b799-0c9fe26aaa51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:05.849459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bb0eb0-97d8-44ff-b799-0c9fe26aaa51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:05.850483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bb0eb0-97d8-44ff-b799-0c9fe26aaa51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:05.850483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-91bb0eb0-97d8-44ff-b799-0c9fe26aaa51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:05.875405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ca3466c6-6b75-4402-9ad0-942443fe47ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:05.885766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ca3466c6-6b75-4402-9ad0-942443fe47ae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1319 microversion: 2.1 time: 0.164857 Sep 02 10:09:05.886828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1067/2212] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:05 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:06.294245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:06.294791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] [instance: 5a68cef6-8c2a-42a1-9943-63f884381755] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:06.300595 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:06.301076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:06.301506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:06.302215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:06.302665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:06.303111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:06.317173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] HTTP exception thrown: Instance 5a68cef6-8c2a-42a1-9943-63f884381755 could not be found. Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Request method failure captured: Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 HTTP/1.1 Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc22eZk4NvLRUYaEIS4H25VGVBiM42yFiK7xF_VUoXOo4u4MiAKUKJwSMXyaht-MnZih7UJiMLLCjNmShoo_p6MCkWEtJGbSihXAUyhtBdHuTJ4j_uxbQH6ZDDizz1gtyg0L1nuoy7l0-tuEsqDamats31z4IYzP5hsKBGE58yr1OGk Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:09:06.318878 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2945ae512e14bfbb7d02dedc4de7cd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2945ae512e14bfbb7d02dedc4de7cd4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: c2945ae512e14bfbb7d02dedc4de7cd4 Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1245485257 Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: c79aaf1f72634eefb5e89c8005afe54b Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1245485257-project Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 5a68cef6-8c2a-42a1-9943-63f884381755 could not be found. Sep 02 10:09:06.320933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '5a68cef6-8c2a-42a1-9943-63f884381755'} Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a68cef6-8c2a-42a1-9943-63f884381755 could not be found. Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:09:06.322767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a68cef6-8c2a-42a1-9943-63f884381755 could not be found. Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a68cef6-8c2a-42a1-9943-63f884381755 could not be found. Sep 02 10:09:06.324548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:06.326667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] Returning 404 to user: Instance 5a68cef6-8c2a-42a1-9943-63f884381755 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:09:06.326667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cf29adf5-fe23-43c0-a026-d23bbaf13cce tempest-ServerRescueNegativeTestJSON-1245485257 tempest-ServerRescueNegativeTestJSON-1245485257-project] 10.222.0.57 "GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755" status: 404 len: 111 microversion: 2.1 time: 0.030632 Sep 02 10:09:06.326667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1068/2213] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:06 2022] GET /compute/v2.1/servers/5a68cef6-8c2a-42a1-9943-63f884381755 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 10:09:06.578670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-91bb0eb0-97d8-44ff-b799-0c9fe26aaa51 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "POST /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745970 Sep 02 10:09:06.579558 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1146/2214] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 10:09:05 2022] POST /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:09:06.906778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-909c16ad-6997-43d5-a21e-9f1beea01bae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:06.907412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-909c16ad-6997-43d5-a21e-9f1beea01bae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:06.913771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-909c16ad-6997-43d5-a21e-9f1beea01bae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:06.914255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-909c16ad-6997-43d5-a21e-9f1beea01bae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:06.914692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-909c16ad-6997-43d5-a21e-9f1beea01bae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:06.915957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-909c16ad-6997-43d5-a21e-9f1beea01bae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:06.916416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-909c16ad-6997-43d5-a21e-9f1beea01bae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:06.916838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-909c16ad-6997-43d5-a21e-9f1beea01bae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:07.050948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-909c16ad-6997-43d5-a21e-9f1beea01bae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:07.058806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-909c16ad-6997-43d5-a21e-9f1beea01bae tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1319 microversion: 2.1 time: 0.155890 Sep 02 10:09:07.059396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1069/2215] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:06 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:08.078148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:08.079153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=6 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:08.083327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fdec7318-cc46-4015-b394-0ff78538568b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:08.084148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fdec7318-cc46-4015-b394-0ff78538568b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:08.091246 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdec7318-cc46-4015-b394-0ff78538568b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:08.098872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdec7318-cc46-4015-b394-0ff78538568b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:08.098872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdec7318-cc46-4015-b394-0ff78538568b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:08.098872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdec7318-cc46-4015-b394-0ff78538568b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:08.098872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdec7318-cc46-4015-b394-0ff78538568b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:08.099335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdec7318-cc46-4015-b394-0ff78538568b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:08.109780 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:08.319560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fdec7318-cc46-4015-b394-0ff78538568b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:08.333703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fdec7318-cc46-4015-b394-0ff78538568b tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1319 microversion: 2.1 time: 0.256864 Sep 02 10:09:08.339176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1147/2216] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:08 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:09.355169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-76cd5181-2f31-4315-9e09-d81c42b0d697 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:09.356359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-76cd5181-2f31-4315-9e09-d81c42b0d697 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:09.358321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:09.378190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76cd5181-2f31-4315-9e09-d81c42b0d697 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:09.378190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76cd5181-2f31-4315-9e09-d81c42b0d697 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:09.378190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76cd5181-2f31-4315-9e09-d81c42b0d697 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:09.378190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76cd5181-2f31-4315-9e09-d81c42b0d697 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:09.378576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76cd5181-2f31-4315-9e09-d81c42b0d697 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:09.378576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-76cd5181-2f31-4315-9e09-d81c42b0d697 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:09.509211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-76cd5181-2f31-4315-9e09-d81c42b0d697 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:09.519184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-76cd5181-2f31-4315-9e09-d81c42b0d697 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1319 microversion: 2.1 time: 0.167931 Sep 02 10:09:09.533164 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1070/2217] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:09 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:09.938146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-4a16c202-5cfd-4a01-8de5-96640f494fe3 req-be69226b-bd57-4a3c-8b88-6d1f6f0d2a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a86dc04-b6ca-442f-9a4c-eb9c7da928c0", "name": "network-vif-plugged", "status": "completed", "tag": "63624fb5-a715-45e4-a1b6-1fd48b7c86bf"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:09.949591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4a16c202-5cfd-4a01-8de5-96640f494fe3 req-be69226b-bd57-4a3c-8b88-6d1f6f0d2a6c service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:09.950068 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4a16c202-5cfd-4a01-8de5-96640f494fe3 req-be69226b-bd57-4a3c-8b88-6d1f6f0d2a6c service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:09.950558 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-4a16c202-5cfd-4a01-8de5-96640f494fe3 req-be69226b-bd57-4a3c-8b88-6d1f6f0d2a6c service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:09.963076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-4a16c202-5cfd-4a01-8de5-96640f494fe3 req-be69226b-bd57-4a3c-8b88-6d1f6f0d2a6c service nova] Creating event network-vif-plugged:63624fb5-a715-45e4-a1b6-1fd48b7c86bf for instance 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 on hv-cinder-85083 Sep 02 10:09:09.968879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-4a16c202-5cfd-4a01-8de5-96640f494fe3 req-be69226b-bd57-4a3c-8b88-6d1f6f0d2a6c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098366 Sep 02 10:09:09.970369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1148/2218] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:10.540655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-49a208a9-0152-4549-a8d1-0754e6159caa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:10.541194 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-49a208a9-0152-4549-a8d1-0754e6159caa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:10.548238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49a208a9-0152-4549-a8d1-0754e6159caa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:10.548722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49a208a9-0152-4549-a8d1-0754e6159caa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:10.549225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49a208a9-0152-4549-a8d1-0754e6159caa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:10.549911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49a208a9-0152-4549-a8d1-0754e6159caa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:10.550367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49a208a9-0152-4549-a8d1-0754e6159caa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:10.550820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-49a208a9-0152-4549-a8d1-0754e6159caa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:10.682070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-49a208a9-0152-4549-a8d1-0754e6159caa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:10.691157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-49a208a9-0152-4549-a8d1-0754e6159caa tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1319 microversion: 2.1 time: 0.154493 Sep 02 10:09:10.691747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1071/2219] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:10 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:11.712406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7a7d3880-16bc-4a62-a59d-3f339bcbdffb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:11.713129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7a7d3880-16bc-4a62-a59d-3f339bcbdffb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:11.719840 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a7d3880-16bc-4a62-a59d-3f339bcbdffb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:11.723907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a7d3880-16bc-4a62-a59d-3f339bcbdffb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:11.723907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a7d3880-16bc-4a62-a59d-3f339bcbdffb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:11.723907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a7d3880-16bc-4a62-a59d-3f339bcbdffb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:11.723907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a7d3880-16bc-4a62-a59d-3f339bcbdffb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:11.724323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a7d3880-16bc-4a62-a59d-3f339bcbdffb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:11.852646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7a7d3880-16bc-4a62-a59d-3f339bcbdffb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:11.860308 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7a7d3880-16bc-4a62-a59d-3f339bcbdffb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1319 microversion: 2.1 time: 0.152581 Sep 02 10:09:11.860864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1149/2220] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:11 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:09:12.881054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-89a1157d-eada-4853-97d5-bb179c1e0dd3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:12.881694 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-89a1157d-eada-4853-97d5-bb179c1e0dd3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:12.888540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89a1157d-eada-4853-97d5-bb179c1e0dd3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:12.889006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89a1157d-eada-4853-97d5-bb179c1e0dd3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:12.889439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89a1157d-eada-4853-97d5-bb179c1e0dd3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:12.890114 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89a1157d-eada-4853-97d5-bb179c1e0dd3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:12.890565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89a1157d-eada-4853-97d5-bb179c1e0dd3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:12.891013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-89a1157d-eada-4853-97d5-bb179c1e0dd3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:13.036687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-89a1157d-eada-4853-97d5-bb179c1e0dd3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:13.044308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-89a1157d-eada-4853-97d5-bb179c1e0dd3 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1508 microversion: 2.1 time: 0.167103 Sep 02 10:09:13.044877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1072/2221] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:12 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:13.064267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b23e9f25-a285-4473-9704-482d3eb12321 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b6f4f94-c5bf-41b5-bf0e-efa9d0b9dfa5", "device": "/dev/sdb"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:13.066634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b23e9f25-a285-4473-9704-482d3eb12321 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:13.073614 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b23e9f25-a285-4473-9704-482d3eb12321 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:13.074100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b23e9f25-a285-4473-9704-482d3eb12321 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:13.074534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b23e9f25-a285-4473-9704-482d3eb12321 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:13.075457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b23e9f25-a285-4473-9704-482d3eb12321 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:13.075913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b23e9f25-a285-4473-9704-482d3eb12321 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:13.076337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b23e9f25-a285-4473-9704-482d3eb12321 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:14.005714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b23e9f25-a285-4473-9704-482d3eb12321 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "POST /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945209 Sep 02 10:09:14.015444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1150/2222] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 10:09:13 2022] POST /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0/os-volume_attachments => generated 194 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:15.267062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e56c7517-1a12-4788-af30-5c60d387da5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:15.269986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e56c7517-1a12-4788-af30-5c60d387da5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:15.277190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e56c7517-1a12-4788-af30-5c60d387da5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:15.277681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e56c7517-1a12-4788-af30-5c60d387da5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:15.278108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e56c7517-1a12-4788-af30-5c60d387da5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:15.279029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e56c7517-1a12-4788-af30-5c60d387da5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:15.279479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e56c7517-1a12-4788-af30-5c60d387da5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:15.280080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e56c7517-1a12-4788-af30-5c60d387da5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:15.311604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e56c7517-1a12-4788-af30-5c60d387da5f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048625 Sep 02 10:09:15.312176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1073/2223] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:09:15 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:15.453155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7ea51f7c-8af5-44d6-a26e-5c5d9bdf9918 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:15.453733 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7ea51f7c-8af5-44d6-a26e-5c5d9bdf9918 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:15.462170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ea51f7c-8af5-44d6-a26e-5c5d9bdf9918 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:15.462668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ea51f7c-8af5-44d6-a26e-5c5d9bdf9918 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:15.463139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ea51f7c-8af5-44d6-a26e-5c5d9bdf9918 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:15.464530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ea51f7c-8af5-44d6-a26e-5c5d9bdf9918 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:15.464997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ea51f7c-8af5-44d6-a26e-5c5d9bdf9918 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:15.465431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7ea51f7c-8af5-44d6-a26e-5c5d9bdf9918 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:15.503524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7ea51f7c-8af5-44d6-a26e-5c5d9bdf9918 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments/10889638-3b1f-4745-9169-cce449300a7e" status: 200 len: 194 microversion: 2.1 time: 0.055189 Sep 02 10:09:15.504410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1151/2224] 10.222.0.57 () {58 vars in 1413 bytes} [Fri Sep 2 10:09:15 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments/10889638-3b1f-4745-9169-cce449300a7e => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:15.520536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c081f1f5-4f6f-4e00-97ef-aa489ea0b3c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:15.521046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c081f1f5-4f6f-4e00-97ef-aa489ea0b3c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:15.527200 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c081f1f5-4f6f-4e00-97ef-aa489ea0b3c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:15.527687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c081f1f5-4f6f-4e00-97ef-aa489ea0b3c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:15.528127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c081f1f5-4f6f-4e00-97ef-aa489ea0b3c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:15.528815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c081f1f5-4f6f-4e00-97ef-aa489ea0b3c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:15.529503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c081f1f5-4f6f-4e00-97ef-aa489ea0b3c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:15.530006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c081f1f5-4f6f-4e00-97ef-aa489ea0b3c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:15.628657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-c081f1f5-4f6f-4e00-97ef-aa489ea0b3c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lazy-loading 'services' on Instance uuid cdc0b1ef-0647-403b-82ca-28334d3627fa {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:09:15.884160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c081f1f5-4f6f-4e00-97ef-aa489ea0b3c9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments/10889638-3b1f-4745-9169-cce449300a7e" status: 202 len: 0 microversion: 2.1 time: 0.371615 Sep 02 10:09:15.885036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1074/2225] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 10:09:15 2022] DELETE /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments/10889638-3b1f-4745-9169-cce449300a7e => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:09:17.694905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-12ed90ac-7dfa-4b76-82d1-7445b3971c47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Action: 'create', calling method: .version_select at 0x7f4e5fbecdc0>, body: {"keypair": {"name": "tempest-keypair-1460988981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRfKGq0bgh0YZlqOBt6Q16QlrM5ZId4O04LvvxL9VnRkQZmneFA+L+rDJXP6k5dS1gi69DKuabZqgiebB39qSu5r//fW2CzFboBq+TovUc1+29BLeu1jPM/+TiEUscX4Q=="}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:17.711557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-12ed90ac-7dfa-4b76-82d1-7445b3971c47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Getting quotas for project 78a4f092ae254358b4e54190c2c4a1a1. Resources: {'key_pairs'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:09:17.715913 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-12ed90ac-7dfa-4b76-82d1-7445b3971c47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Getting quotas for user cf7d0cc498e94ba49f258c38a3c4c410 and project 78a4f092ae254358b4e54190c2c4a1a1. Resources: {'key_pairs'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:09:17.849943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-12ed90ac-7dfa-4b76-82d1-7445b3971c47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.273494 Sep 02 10:09:17.850565 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1152/2226] 10.222.0.57 () {62 vars in 1200 bytes} [Fri Sep 2 10:09:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 275 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 02 10:09:20.104129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1051658888", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c1ab8b3-34a9-48f1-a2e8-4025f9f1071d"}], "security_groups": [{"name": "tempest-securitygroup--62260494"}], "key_name": "tempest-keypair-1460988981", "user_data": "}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:20.240654 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] validate_networks() for [('1c1ab8b3-34a9-48f1-a2e8-4025f9f1071d', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 10:09:20.727170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 10:09:20.727591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 10:09:20.728094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 10:09:20.728500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 10:09:20.728907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 10:09:20.739508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:20.740061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:20.740502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:20.741250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:20.741720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:20.742219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:20.762209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Getting quotas for project 78a4f092ae254358b4e54190c2c4a1a1. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:09:20.766620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Getting quotas for user cf7d0cc498e94ba49f258c38a3c4c410 and project 78a4f092ae254358b4e54190c2c4a1a1. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:09:20.778067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 10:09:20.780615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 10:09:20.888476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-837b8c3d-96ab-4b17-8696-836d75e810ad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.789433 Sep 02 10:09:20.888476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1075/2227] 10.222.0.57 () {62 vars in 1188 bytes} [Fri Sep 2 10:09:20 2022] POST /compute/v2.1/servers => generated 400 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 10:09:20.900120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-67961be3-7998-4fde-b0fb-0133a5d88ee8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:20.900829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-67961be3-7998-4fde-b0fb-0133a5d88ee8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:20.904009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:20.963239 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67961be3-7998-4fde-b0fb-0133a5d88ee8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:20.971842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67961be3-7998-4fde-b0fb-0133a5d88ee8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:20.973310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67961be3-7998-4fde-b0fb-0133a5d88ee8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:20.974449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-67961be3-7998-4fde-b0fb-0133a5d88ee8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1282 microversion: 2.20 time: 0.078910 Sep 02 10:09:20.975293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1153/2228] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:20 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:21.998203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2424d736-248d-4be2-a8da-f7a2af734c1f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:21.998953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2424d736-248d-4be2-a8da-f7a2af734c1f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:22.001428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:22.052519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2424d736-248d-4be2-a8da-f7a2af734c1f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:22.059610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2424d736-248d-4be2-a8da-f7a2af734c1f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:22.061036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2424d736-248d-4be2-a8da-f7a2af734c1f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:22.062129 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2424d736-248d-4be2-a8da-f7a2af734c1f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1282 microversion: 2.20 time: 0.068037 Sep 02 10:09:22.062729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1076/2229] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:21 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1282 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:23.085124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6c633ccf-92fa-4bc5-8c21-b857ef80aa4d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:23.086347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6c633ccf-92fa-4bc5-8c21-b857ef80aa4d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:23.141069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6c633ccf-92fa-4bc5-8c21-b857ef80aa4d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:23.148315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6c633ccf-92fa-4bc5-8c21-b857ef80aa4d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:23.149779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6c633ccf-92fa-4bc5-8c21-b857ef80aa4d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:23.151419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6c633ccf-92fa-4bc5-8c21-b857ef80aa4d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1282 microversion: 2.20 time: 0.069848 Sep 02 10:09:23.151980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1154/2230] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:23 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:23.394750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-00f58d37-34a3-4744-bd5d-5fff90be7912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:23.395283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-00f58d37-34a3-4744-bd5d-5fff90be7912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:23.402135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f58d37-34a3-4744-bd5d-5fff90be7912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:23.409348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f58d37-34a3-4744-bd5d-5fff90be7912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:23.409348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f58d37-34a3-4744-bd5d-5fff90be7912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:23.409348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f58d37-34a3-4744-bd5d-5fff90be7912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:23.409348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f58d37-34a3-4744-bd5d-5fff90be7912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:23.409774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-00f58d37-34a3-4744-bd5d-5fff90be7912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:23.433723 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-00f58d37-34a3-4744-bd5d-5fff90be7912 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments/e04105d3-883f-43ad-9ccd-902c75a1f434" status: 200 len: 194 microversion: 2.1 time: 0.043231 Sep 02 10:09:23.437987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1077/2231] 10.222.0.57 () {58 vars in 1413 bytes} [Fri Sep 2 10:09:23 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments/e04105d3-883f-43ad-9ccd-902c75a1f434 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:23.444762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-aed6f21e-9e9c-4e50-9384-161a817cf714 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:23.445288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-aed6f21e-9e9c-4e50-9384-161a817cf714 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:23.451814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aed6f21e-9e9c-4e50-9384-161a817cf714 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:23.452295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aed6f21e-9e9c-4e50-9384-161a817cf714 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:23.452730 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aed6f21e-9e9c-4e50-9384-161a817cf714 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:23.453410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aed6f21e-9e9c-4e50-9384-161a817cf714 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:23.453858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aed6f21e-9e9c-4e50-9384-161a817cf714 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:23.454288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aed6f21e-9e9c-4e50-9384-161a817cf714 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:23.537112 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-aed6f21e-9e9c-4e50-9384-161a817cf714 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lazy-loading 'services' on Instance uuid cdc0b1ef-0647-403b-82ca-28334d3627fa {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:09:23.778289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-aed6f21e-9e9c-4e50-9384-161a817cf714 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments/e04105d3-883f-43ad-9ccd-902c75a1f434" status: 202 len: 0 microversion: 2.1 time: 0.337359 Sep 02 10:09:23.778933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1155/2232] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 10:09:23 2022] DELETE /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments/e04105d3-883f-43ad-9ccd-902c75a1f434 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:09:24.173730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2c4ef8fe-e266-43e3-bd52-4f0d90ef3d6f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:24.174280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2c4ef8fe-e266-43e3-bd52-4f0d90ef3d6f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:24.226053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2c4ef8fe-e266-43e3-bd52-4f0d90ef3d6f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:24.233272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2c4ef8fe-e266-43e3-bd52-4f0d90ef3d6f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:24.234741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2c4ef8fe-e266-43e3-bd52-4f0d90ef3d6f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:24.235840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2c4ef8fe-e266-43e3-bd52-4f0d90ef3d6f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1282 microversion: 2.20 time: 0.066406 Sep 02 10:09:24.236389 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1078/2233] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:24 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1282 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:25.258757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:25.259456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:25.266153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:25.266637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:25.267103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:25.267792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:25.268248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:25.268672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:25.330287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:25.338971 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:25.340429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:25.341523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cf5e3430-1930-430e-be8f-36696915373f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1286 microversion: 2.20 time: 0.087554 Sep 02 10:09:25.342081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1156/2234] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:25 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:26.362898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:26.363438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:26.370136 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:26.370618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:26.371086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:26.371771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:26.372227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:26.372651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:26.431876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:26.439818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:26.441267 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:26.442381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-91a6b086-183e-4a6d-b203-d0551c601cee tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1286 microversion: 2.20 time: 0.083585 Sep 02 10:09:26.442960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1079/2235] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:26 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:27.464186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:27.464708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:27.471136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:27.471619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:27.472060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:27.472740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:27.473209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:27.473620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:27.534334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:27.542940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:27.544380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:27.545471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d51ba7fc-19c7-4351-99cd-bc37286a8ef4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1286 microversion: 2.20 time: 0.085380 Sep 02 10:09:27.546027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1157/2236] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:27 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:28.573663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:28.573663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:28.577213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:28.577213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:28.577545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:28.578234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:28.578689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:28.579141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:28.643261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:28.651553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:28.652899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:28.653988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5a14f3cd-dea8-40d4-8eaf-b24a88fa409b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1286 microversion: 2.20 time: 0.089457 Sep 02 10:09:28.654548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1080/2237] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:28 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:29.173807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b43b4f7a-c04d-498a-aafb-f116c5cdfb8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:29.176110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b43b4f7a-c04d-498a-aafb-f116c5cdfb8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:29.184502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b43b4f7a-c04d-498a-aafb-f116c5cdfb8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:29.185093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b43b4f7a-c04d-498a-aafb-f116c5cdfb8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:29.185812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b43b4f7a-c04d-498a-aafb-f116c5cdfb8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:29.187728 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b43b4f7a-c04d-498a-aafb-f116c5cdfb8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:29.188278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b43b4f7a-c04d-498a-aafb-f116c5cdfb8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:29.188750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b43b4f7a-c04d-498a-aafb-f116c5cdfb8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:29.221056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b43b4f7a-c04d-498a-aafb-f116c5cdfb8e tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051074 Sep 02 10:09:29.221621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1158/2238] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:09:29 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 10:09:29.341421 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7d4ba1ac-cf03-46bc-b895-71a0b2004777 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:29.343711 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7d4ba1ac-cf03-46bc-b895-71a0b2004777 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:29.349603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4ba1ac-cf03-46bc-b895-71a0b2004777 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:29.350077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4ba1ac-cf03-46bc-b895-71a0b2004777 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:29.350509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4ba1ac-cf03-46bc-b895-71a0b2004777 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:29.351285 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4ba1ac-cf03-46bc-b895-71a0b2004777 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:29.351663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4ba1ac-cf03-46bc-b895-71a0b2004777 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:29.352079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7d4ba1ac-cf03-46bc-b895-71a0b2004777 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:29.381666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7d4ba1ac-cf03-46bc-b895-71a0b2004777 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044433 Sep 02 10:09:29.382221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1081/2239] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:09:29 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 10:09:29.443091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-784dd771-60c9-448d-a7b7-79945bd9c3e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:29.443624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-784dd771-60c9-448d-a7b7-79945bd9c3e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:29.450169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-784dd771-60c9-448d-a7b7-79945bd9c3e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:29.450652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-784dd771-60c9-448d-a7b7-79945bd9c3e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:29.451111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-784dd771-60c9-448d-a7b7-79945bd9c3e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:29.451789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-784dd771-60c9-448d-a7b7-79945bd9c3e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:29.452238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-784dd771-60c9-448d-a7b7-79945bd9c3e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:29.452655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-784dd771-60c9-448d-a7b7-79945bd9c3e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:29.482686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-784dd771-60c9-448d-a7b7-79945bd9c3e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Going to try to terminate instance {{(pid=127533) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:09:29.676611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:29.677246 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:29.684249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:29.684725 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:29.685156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:29.685832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:29.686279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:29.686697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:29.750645 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:29.758876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:29.760496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:29.761599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ba237bc6-854c-4445-972f-fbf3332566a1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1334 microversion: 2.20 time: 0.088945 Sep 02 10:09:29.762155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1082/2240] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:29 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:09:29.915313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-784dd771-60c9-448d-a7b7-79945bd9c3e7 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 204 len: 0 microversion: 2.1 time: 0.476053 Sep 02 10:09:29.915890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1159/2241] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:09:29 2022] DELETE /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:09:29.924647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-903aa7b2-d593-4486-94cc-a9c24a38c5e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:29.925338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-903aa7b2-d593-4486-94cc-a9c24a38c5e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:29.931511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-903aa7b2-d593-4486-94cc-a9c24a38c5e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:29.932083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-903aa7b2-d593-4486-94cc-a9c24a38c5e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:29.932646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-903aa7b2-d593-4486-94cc-a9c24a38c5e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:29.933443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-903aa7b2-d593-4486-94cc-a9c24a38c5e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:29.933963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-903aa7b2-d593-4486-94cc-a9c24a38c5e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:29.934455 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-903aa7b2-d593-4486-94cc-a9c24a38c5e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:30.065313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-903aa7b2-d593-4486-94cc-a9c24a38c5e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:30.072939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-903aa7b2-d593-4486-94cc-a9c24a38c5e5 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1673 microversion: 2.1 time: 0.152163 Sep 02 10:09:30.073496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1083/2242] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:29 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:30.785180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:30.785875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:30.792850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:30.793348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:30.793818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:30.794972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:30.795440 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:30.795868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:30.857537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:30.865809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:30.867292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:30.868393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d70be719-8ac7-44db-8a36-caf72cb3d574 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1352 microversion: 2.20 time: 0.087790 Sep 02 10:09:30.868947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1160/2243] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:30 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:31.097808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-99dfb546-dbfa-485d-ac07-c5d9f178ee79 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:31.097808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-99dfb546-dbfa-485d-ac07-c5d9f178ee79 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:31.097808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:31.101597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99dfb546-dbfa-485d-ac07-c5d9f178ee79 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:31.102075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99dfb546-dbfa-485d-ac07-c5d9f178ee79 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:31.102562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99dfb546-dbfa-485d-ac07-c5d9f178ee79 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:31.103301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99dfb546-dbfa-485d-ac07-c5d9f178ee79 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:31.103746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99dfb546-dbfa-485d-ac07-c5d9f178ee79 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:31.104164 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-99dfb546-dbfa-485d-ac07-c5d9f178ee79 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:31.234473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-99dfb546-dbfa-485d-ac07-c5d9f178ee79 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:31.242794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-99dfb546-dbfa-485d-ac07-c5d9f178ee79 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1673 microversion: 2.1 time: 0.152922 Sep 02 10:09:31.243355 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1084/2244] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:31 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:31.890996 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:31.891613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:31.898089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:31.898573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:31.899059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:31.899749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:31.900205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:31.900631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:31.960556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:31.969331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:31.970809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:31.971897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-609b2478-e0dd-4269-8220-8a6f5bc5f664 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1352 microversion: 2.20 time: 0.085289 Sep 02 10:09:31.972453 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1161/2245] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:31 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:09:32.264774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7b43d90c-dbbd-45c3-bcb5-6f3854c8c7e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:32.265315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7b43d90c-dbbd-45c3-bcb5-6f3854c8c7e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:32.271453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b43d90c-dbbd-45c3-bcb5-6f3854c8c7e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:32.271935 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b43d90c-dbbd-45c3-bcb5-6f3854c8c7e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:32.272368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b43d90c-dbbd-45c3-bcb5-6f3854c8c7e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:32.273101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b43d90c-dbbd-45c3-bcb5-6f3854c8c7e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:32.273547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b43d90c-dbbd-45c3-bcb5-6f3854c8c7e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:32.273967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7b43d90c-dbbd-45c3-bcb5-6f3854c8c7e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:32.401043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7b43d90c-dbbd-45c3-bcb5-6f3854c8c7e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:32.409170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7b43d90c-dbbd-45c3-bcb5-6f3854c8c7e2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1673 microversion: 2.1 time: 0.148548 Sep 02 10:09:32.409734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1085/2246] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:32 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:32.993808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:32.994333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:33.001298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:33.001778 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:33.002215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:33.002924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:33.003380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:33.003811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:33.145113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=8 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:33.303232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:33.312081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:33.313556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:33.314678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-93ded59c-6eda-4e94-8a38-80970b057d47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1352 microversion: 2.20 time: 0.324873 Sep 02 10:09:33.315257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1162/2247] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:32 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1352 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:33.429616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d8afed1c-dfb9-4b54-a1dc-50fdfc826bb2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:33.430225 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d8afed1c-dfb9-4b54-a1dc-50fdfc826bb2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:33.437261 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8afed1c-dfb9-4b54-a1dc-50fdfc826bb2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:33.437743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8afed1c-dfb9-4b54-a1dc-50fdfc826bb2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:33.438180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8afed1c-dfb9-4b54-a1dc-50fdfc826bb2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:33.438896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8afed1c-dfb9-4b54-a1dc-50fdfc826bb2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:33.439353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8afed1c-dfb9-4b54-a1dc-50fdfc826bb2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:33.439774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d8afed1c-dfb9-4b54-a1dc-50fdfc826bb2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:33.443705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:33.564433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d8afed1c-dfb9-4b54-a1dc-50fdfc826bb2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:33.572198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d8afed1c-dfb9-4b54-a1dc-50fdfc826bb2 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1673 microversion: 2.1 time: 0.146405 Sep 02 10:09:33.572769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1086/2248] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:33 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:34.336932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:34.337635 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:34.344661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:34.345429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:34.345553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:34.346237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:34.346693 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:34.347135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:34.521846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:34.525294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:34.530607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:34.532073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:34.533168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-73dbd226-5b25-4965-b812-7e13269ae733 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1406 microversion: 2.20 time: 0.200192 Sep 02 10:09:34.533717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1163/2249] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:34 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:34.592938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c8bd539d-1a1f-4042-bd82-e62cdeec5498 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:34.593452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c8bd539d-1a1f-4042-bd82-e62cdeec5498 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:34.595535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=10 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:34.601082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8bd539d-1a1f-4042-bd82-e62cdeec5498 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:34.601651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8bd539d-1a1f-4042-bd82-e62cdeec5498 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:34.602354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8bd539d-1a1f-4042-bd82-e62cdeec5498 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:34.603167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8bd539d-1a1f-4042-bd82-e62cdeec5498 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:34.603690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8bd539d-1a1f-4042-bd82-e62cdeec5498 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:34.604204 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c8bd539d-1a1f-4042-bd82-e62cdeec5498 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:34.741701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c8bd539d-1a1f-4042-bd82-e62cdeec5498 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:34.750376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c8bd539d-1a1f-4042-bd82-e62cdeec5498 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1673 microversion: 2.1 time: 0.161822 Sep 02 10:09:34.753609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1087/2250] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:34 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:35.311958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-8b933543-a11a-4d5c-a4fe-6c5b055f2504 req-2e8ae842-8ad5-4217-b024-eb68a431dd18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7800ab6f-02d9-4d8f-a038-32b2676ec781", "tag": "37fe2545-9daa-4fdb-8240-493d506d5ff6"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:35.323358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-8b933543-a11a-4d5c-a4fe-6c5b055f2504 req-2e8ae842-8ad5-4217-b024-eb68a431dd18 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:35.323992 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-8b933543-a11a-4d5c-a4fe-6c5b055f2504 req-2e8ae842-8ad5-4217-b024-eb68a431dd18 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:35.325363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-8b933543-a11a-4d5c-a4fe-6c5b055f2504 req-2e8ae842-8ad5-4217-b024-eb68a431dd18 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:35.337325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-8b933543-a11a-4d5c-a4fe-6c5b055f2504 req-2e8ae842-8ad5-4217-b024-eb68a431dd18 service nova] Creating event network-changed:37fe2545-9daa-4fdb-8240-493d506d5ff6 for instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 on hv-cinder-85083 Sep 02 10:09:35.342358 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-8b933543-a11a-4d5c-a4fe-6c5b055f2504 req-2e8ae842-8ad5-4217-b024-eb68a431dd18 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034775 Sep 02 10:09:35.343150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1164/2251] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:35.555876 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:35.556579 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:35.566911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:35.566911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:35.566911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:35.566911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:35.567345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:35.567345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:35.772375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4cbde7e3-44d3-4a9c-99e1-374ff82785b0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:35.773101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4cbde7e3-44d3-4a9c-99e1-374ff82785b0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:35.781265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cbde7e3-44d3-4a9c-99e1-374ff82785b0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:35.781470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cbde7e3-44d3-4a9c-99e1-374ff82785b0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:35.781972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cbde7e3-44d3-4a9c-99e1-374ff82785b0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:35.782886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cbde7e3-44d3-4a9c-99e1-374ff82785b0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:35.783330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cbde7e3-44d3-4a9c-99e1-374ff82785b0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:35.783811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4cbde7e3-44d3-4a9c-99e1-374ff82785b0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:35.876745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:35.887191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:35.889289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:35.890637 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a31c16bd-8dd8-467f-b2c1-c3fe6044cfdb tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1406 microversion: 2.20 time: 0.338915 Sep 02 10:09:35.891611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1088/2252] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:35 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:09:36.043377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4cbde7e3-44d3-4a9c-99e1-374ff82785b0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:36.051180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4cbde7e3-44d3-4a9c-99e1-374ff82785b0 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1673 microversion: 2.1 time: 0.283512 Sep 02 10:09:36.051829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1165/2253] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:35 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1673 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:09:36.408254 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-3e4b142f-0f48-402c-97fa-56c7d2b46489 req-288f05d3-4bf3-4376-8850-a1905fa63d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc0b1ef-0647-403b-82ca-28334d3627fa", "name": "network-vif-deleted", "tag": "721d248f-b99f-4e94-be59-bd5e36eb217e"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:36.418332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-3e4b142f-0f48-402c-97fa-56c7d2b46489 req-288f05d3-4bf3-4376-8850-a1905fa63d80 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:36.418969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-3e4b142f-0f48-402c-97fa-56c7d2b46489 req-288f05d3-4bf3-4376-8850-a1905fa63d80 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:36.419492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-3e4b142f-0f48-402c-97fa-56c7d2b46489 req-288f05d3-4bf3-4376-8850-a1905fa63d80 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:36.430810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-3e4b142f-0f48-402c-97fa-56c7d2b46489 req-288f05d3-4bf3-4376-8850-a1905fa63d80 service nova] Creating event network-vif-deleted:721d248f-b99f-4e94-be59-bd5e36eb217e for instance cdc0b1ef-0647-403b-82ca-28334d3627fa on hv-cinder-85083 Sep 02 10:09:36.437685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-3e4b142f-0f48-402c-97fa-56c7d2b46489 req-288f05d3-4bf3-4376-8850-a1905fa63d80 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032393 Sep 02 10:09:36.446106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1089/2254] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:36.914087 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:36.914757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:36.922280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:36.922801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:36.923243 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:36.923945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:36.924414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:36.924826 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:37.054131 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:37.062476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:37.064000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:37.065133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c43864e2-241b-44ba-ab8d-22fe4ae4d3a8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1406 microversion: 2.20 time: 0.155233 Sep 02 10:09:37.065689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1166/2255] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:36 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:37.084660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e362ae93-f327-4606-ac9b-6a3b12bdea2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:37.085354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e362ae93-f327-4606-ac9b-6a3b12bdea2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:37.092747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e362ae93-f327-4606-ac9b-6a3b12bdea2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:37.093234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e362ae93-f327-4606-ac9b-6a3b12bdea2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:37.093673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e362ae93-f327-4606-ac9b-6a3b12bdea2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:37.094357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e362ae93-f327-4606-ac9b-6a3b12bdea2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:37.094838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e362ae93-f327-4606-ac9b-6a3b12bdea2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:37.095265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e362ae93-f327-4606-ac9b-6a3b12bdea2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:37.158625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e362ae93-f327-4606-ac9b-6a3b12bdea2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:37.166659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e362ae93-f327-4606-ac9b-6a3b12bdea2f tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1323 microversion: 2.1 time: 0.086294 Sep 02 10:09:37.167272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1090/2256] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:37 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1323 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:38.088457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:38.088972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:38.095938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:38.096418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:38.096853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:38.097531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:38.097979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:38.098396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:38.187687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ceb1b74a-0dd6-4d2b-8c33-05c215bab634 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:38.188305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ceb1b74a-0dd6-4d2b-8c33-05c215bab634 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:38.194812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ceb1b74a-0dd6-4d2b-8c33-05c215bab634 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:38.195299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ceb1b74a-0dd6-4d2b-8c33-05c215bab634 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:38.195739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ceb1b74a-0dd6-4d2b-8c33-05c215bab634 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:38.196447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ceb1b74a-0dd6-4d2b-8c33-05c215bab634 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:38.196892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ceb1b74a-0dd6-4d2b-8c33-05c215bab634 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:38.197317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ceb1b74a-0dd6-4d2b-8c33-05c215bab634 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:38.224440 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:38.233321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:38.235022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:38.236195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-29342df3-3a0d-4eb6-aa1d-a246c0231c6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1406 microversion: 2.20 time: 0.151789 Sep 02 10:09:38.236828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1167/2257] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:38 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:38.260322 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ceb1b74a-0dd6-4d2b-8c33-05c215bab634 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:38.268036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ceb1b74a-0dd6-4d2b-8c33-05c215bab634 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1323 microversion: 2.1 time: 0.084221 Sep 02 10:09:38.268602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1091/2258] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:38 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1323 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:09:38.381225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dc50fc97-4cca-4d81-b258-14d27f7e84a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:38.381726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dc50fc97-4cca-4d81-b258-14d27f7e84a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:38.387609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc50fc97-4cca-4d81-b258-14d27f7e84a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:38.388093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc50fc97-4cca-4d81-b258-14d27f7e84a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:38.388530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc50fc97-4cca-4d81-b258-14d27f7e84a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:38.389214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc50fc97-4cca-4d81-b258-14d27f7e84a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:38.389670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc50fc97-4cca-4d81-b258-14d27f7e84a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:38.390100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc50fc97-4cca-4d81-b258-14d27f7e84a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:38.468796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-dc50fc97-4cca-4d81-b258-14d27f7e84a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lazy-loading 'services' on Instance uuid 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:09:38.687198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dc50fc97-4cca-4d81-b258-14d27f7e84a5 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0/os-volume_attachments/8b6f4f94-c5bf-41b5-bf0e-efa9d0b9dfa5" status: 202 len: 0 microversion: 2.1 time: 0.309597 Sep 02 10:09:38.687719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1168/2259] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 10:09:38 2022] DELETE /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0/os-volume_attachments/8b6f4f94-c5bf-41b5-bf0e-efa9d0b9dfa5 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:09:39.259314 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:39.259925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:39.267161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:39.267651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:39.268084 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:39.268764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:39.269214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:39.269635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:39.289956 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:39.290739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:39.297104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:39.297597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:39.298080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:39.298821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:39.299279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:39.303909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:39.332768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:39.333254 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:39.333699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:39.334140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lazy-loading 'fault' on Instance uuid cdc0b1ef-0647-403b-82ca-28334d3627fa {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:09:39.380684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:39.388923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4ff21c93-af9c-46c6-a8f5-909109a8762b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1328 microversion: 2.1 time: 0.103730 Sep 02 10:09:39.389562 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1169/2260] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:39 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:09:39.407686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:39.415605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:39.417042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:39.418207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e31fbb20-659f-4b29-bec9-720131512743 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1406 microversion: 2.20 time: 0.162894 Sep 02 10:09:39.418848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1092/2261] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:39 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:40.410659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:40.411300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:40.418035 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:40.419413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:40.419917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:40.420701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:40.421221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:40.421707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:40.440764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:40.446380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:40.448193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:40.448952 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:40.449629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:40.450534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:40.451170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:40.451759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:40.479626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:40.480552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:40.481132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:40.482220 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lazy-loading 'fault' on Instance uuid cdc0b1ef-0647-403b-82ca-28334d3627fa {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:09:40.524504 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f65429de28ae41578c51a6b9099fea5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea33fe1eaf1047f78312a8e9fa9152c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:40.532486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d59cf541-75c5-41e1-b007-9b38d12831d9 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 200 len: 1328 microversion: 2.1 time: 0.125688 Sep 02 10:09:40.537988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1170/2262] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:40 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 1328 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:40.588901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:40.597778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:40.599252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:40.600350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-24d9242f-950c-4df2-9c7f-53d3c7b75600 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1406 microversion: 2.20 time: 0.163475 Sep 02 10:09:40.600905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1093/2263] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:40 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:09:40.868743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a1952bd4-6fb7-44d5-aca8-ee4a3fadddbb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:40.869237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a1952bd4-6fb7-44d5-aca8-ee4a3fadddbb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:40.875486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1952bd4-6fb7-44d5-aca8-ee4a3fadddbb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:40.875980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1952bd4-6fb7-44d5-aca8-ee4a3fadddbb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:40.876420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1952bd4-6fb7-44d5-aca8-ee4a3fadddbb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:40.877120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1952bd4-6fb7-44d5-aca8-ee4a3fadddbb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:40.877573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1952bd4-6fb7-44d5-aca8-ee4a3fadddbb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:40.877999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a1952bd4-6fb7-44d5-aca8-ee4a3fadddbb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:40.909804 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a1952bd4-6fb7-44d5-aca8-ee4a3fadddbb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Going to try to terminate instance {{(pid=127533) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:09:41.190921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a1952bd4-6fb7-44d5-aca8-ee4a3fadddbb tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 204 len: 0 microversion: 2.1 time: 0.325671 Sep 02 10:09:41.191499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1171/2264] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:09:40 2022] DELETE /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:09:41.199611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1728b254-e7aa-427e-9d51-e34f4092ac01 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:41.204903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1728b254-e7aa-427e-9d51-e34f4092ac01 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:41.206888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1728b254-e7aa-427e-9d51-e34f4092ac01 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:41.207371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1728b254-e7aa-427e-9d51-e34f4092ac01 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:41.207806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1728b254-e7aa-427e-9d51-e34f4092ac01 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:41.208485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1728b254-e7aa-427e-9d51-e34f4092ac01 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:41.208939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1728b254-e7aa-427e-9d51-e34f4092ac01 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:41.209367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1728b254-e7aa-427e-9d51-e34f4092ac01 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:41.334479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1728b254-e7aa-427e-9d51-e34f4092ac01 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:41.342138 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1728b254-e7aa-427e-9d51-e34f4092ac01 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1514 microversion: 2.1 time: 0.146434 Sep 02 10:09:41.342710 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1094/2265] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:41 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:41.553800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:41.554490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:41.561440 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:41.561925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:41.562359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:41.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:41.563518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:41.563938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:41.576985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] HTTP exception thrown: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Request method failure captured: Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa HTTP/1.1 Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc2zc-Q9BLz2klY6GTG9RC5NQHKGemM_FwRDn6Qd_pZRIYgEAe061FxBVsaii0-JV4KRPEy61Pp9yPCfS6T68Alqx3na4McUZ5fX4vLXpuhrVnIZb1uLjb6rdL2hJl-l2vVaTDRYg-dOyJlImhC3jn83OjB_bkBo9w1IneXFFubLJKw Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: ea33fe1eaf1047f78312a8e9fa9152c4 Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:09:41.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea33fe1eaf1047f78312a8e9fa9152c4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: ea33fe1eaf1047f78312a8e9fa9152c4 Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeTestJSON-1359953646-project Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: f65429de28ae41578c51a6b9099fea5c Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeTestJSON-1359953646-project Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:41.580485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': 'cdc0b1ef-0647-403b-82ca-28334d3627fa'} Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:09:41.581530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:41.583488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:09:41.585075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Returning 404 to user: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:09:41.585075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b815d55c-6a1a-48d4-92a9-b5140b78cc3d tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 404 len: 111 microversion: 2.1 time: 0.030343 Sep 02 10:09:41.585075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1172/2266] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:41 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:09:41.588785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ef481b05-7e83-4684-b30f-e01e40430c47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '.version_select at 0x7f4e5c1e1ee0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:41.623434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:41.624084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:41.630023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:41.630520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:41.630981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:41.631660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:41.632107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:41.632529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:41.706604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ef481b05-7e83-4684-b30f-e01e40430c47 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1069925461" status: 202 len: 0 microversion: 2.1 time: 0.121530 Sep 02 10:09:41.707466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1095/2267] 10.222.0.57 () {58 vars in 1221 bytes} [Fri Sep 2 10:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1069925461 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:09:41.765393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:41.773679 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:41.775169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:41.776263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4b419264-65fb-4343-aefa-1cf4d462188e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1406 microversion: 2.20 time: 0.157377 Sep 02 10:09:41.776964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1173/2268] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:41 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:09:41.983324 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-1f7a56c9-1cfb-41bd-8998-71feeb0628f5 req-0134e103-3f35-472d-b9d7-4a66539259d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7800ab6f-02d9-4d8f-a038-32b2676ec781", "name": "network-vif-plugged", "status": "completed", "tag": "37fe2545-9daa-4fdb-8240-493d506d5ff6"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:41.995200 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-1f7a56c9-1cfb-41bd-8998-71feeb0628f5 req-0134e103-3f35-472d-b9d7-4a66539259d6 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:41.996448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-1f7a56c9-1cfb-41bd-8998-71feeb0628f5 req-0134e103-3f35-472d-b9d7-4a66539259d6 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:41.996448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-1f7a56c9-1cfb-41bd-8998-71feeb0628f5 req-0134e103-3f35-472d-b9d7-4a66539259d6 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:42.006459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-1f7a56c9-1cfb-41bd-8998-71feeb0628f5 req-0134e103-3f35-472d-b9d7-4a66539259d6 service nova] Creating event network-vif-plugged:37fe2545-9daa-4fdb-8240-493d506d5ff6 for instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 on hv-cinder-85083 Sep 02 10:09:42.011750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-1f7a56c9-1cfb-41bd-8998-71feeb0628f5 req-0134e103-3f35-472d-b9d7-4a66539259d6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033235 Sep 02 10:09:42.012348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1096/2269] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:42.362531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4a526e4d-673d-4270-a6bc-ed3e28698fce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:42.363175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4a526e4d-673d-4270-a6bc-ed3e28698fce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:42.369629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a526e4d-673d-4270-a6bc-ed3e28698fce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:42.370107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a526e4d-673d-4270-a6bc-ed3e28698fce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:42.370543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a526e4d-673d-4270-a6bc-ed3e28698fce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:42.371257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a526e4d-673d-4270-a6bc-ed3e28698fce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:42.372471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a526e4d-673d-4270-a6bc-ed3e28698fce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:42.372948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4a526e4d-673d-4270-a6bc-ed3e28698fce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:42.577672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4a526e4d-673d-4270-a6bc-ed3e28698fce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:42.589941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4a526e4d-673d-4270-a6bc-ed3e28698fce tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1514 microversion: 2.1 time: 0.227803 Sep 02 10:09:42.589941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1174/2270] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:42 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:42.800546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:42.801207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:42.807498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:42.807989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:42.808431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:42.809147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:42.809604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:42.810031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:43.001932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:43.010611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:43.012087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:43.013675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5045c126-9da6-4cb6-a0b9-e1bad0df35b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1406 microversion: 2.20 time: 0.218060 Sep 02 10:09:43.014233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1097/2271] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:42 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:43.609656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4d4c329f-8adb-4d88-9291-2412b231e6b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:43.610276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4d4c329f-8adb-4d88-9291-2412b231e6b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:43.617033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4c329f-8adb-4d88-9291-2412b231e6b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:43.617525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4c329f-8adb-4d88-9291-2412b231e6b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:43.617969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4c329f-8adb-4d88-9291-2412b231e6b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:43.618655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4c329f-8adb-4d88-9291-2412b231e6b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:43.619143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4c329f-8adb-4d88-9291-2412b231e6b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:43.619571 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d4c329f-8adb-4d88-9291-2412b231e6b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:43.751408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4d4c329f-8adb-4d88-9291-2412b231e6b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:43.759207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4d4c329f-8adb-4d88-9291-2412b231e6b1 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1514 microversion: 2.1 time: 0.153490 Sep 02 10:09:43.759775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1175/2272] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:43 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:09:44.036622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:44.037233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:44.044066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:44.044542 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:44.045002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:44.045681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:44.046128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:44.046549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:44.182290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:44.190747 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:44.192513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:44.193310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6710dbd4-a6b5-488f-91d8-70f25e71d058 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1406 microversion: 2.20 time: 0.160618 Sep 02 10:09:44.193914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1098/2273] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:44 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:44.781142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ef9b230f-8434-4b89-9a87-cf5a4b0fcb49 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:44.781792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ef9b230f-8434-4b89-9a87-cf5a4b0fcb49 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:44.789054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef9b230f-8434-4b89-9a87-cf5a4b0fcb49 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:44.794138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef9b230f-8434-4b89-9a87-cf5a4b0fcb49 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:44.794138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef9b230f-8434-4b89-9a87-cf5a4b0fcb49 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:44.794138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef9b230f-8434-4b89-9a87-cf5a4b0fcb49 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:44.794138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef9b230f-8434-4b89-9a87-cf5a4b0fcb49 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:44.794958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef9b230f-8434-4b89-9a87-cf5a4b0fcb49 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:44.807573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-42a053c6-2cc8-4683-b2d6-c28f4282b0e3 req-4a00d242-32bd-43b6-b804-be9dbf27c902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a86dc04-b6ca-442f-9a4c-eb9c7da928c0", "name": "network-vif-deleted", "tag": "63624fb5-a715-45e4-a1b6-1fd48b7c86bf"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:44.818394 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-42a053c6-2cc8-4683-b2d6-c28f4282b0e3 req-4a00d242-32bd-43b6-b804-be9dbf27c902 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:44.819022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-42a053c6-2cc8-4683-b2d6-c28f4282b0e3 req-4a00d242-32bd-43b6-b804-be9dbf27c902 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:44.819531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-42a053c6-2cc8-4683-b2d6-c28f4282b0e3 req-4a00d242-32bd-43b6-b804-be9dbf27c902 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:44.834052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-42a053c6-2cc8-4683-b2d6-c28f4282b0e3 req-4a00d242-32bd-43b6-b804-be9dbf27c902 service nova] Creating event network-vif-deleted:63624fb5-a715-45e4-a1b6-1fd48b7c86bf for instance 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 on hv-cinder-85083 Sep 02 10:09:44.839418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-42a053c6-2cc8-4683-b2d6-c28f4282b0e3 req-4a00d242-32bd-43b6-b804-be9dbf27c902 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035579 Sep 02 10:09:44.840492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1099/2274] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:09:44.855178 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ef9b230f-8434-4b89-9a87-cf5a4b0fcb49 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:44.863023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ef9b230f-8434-4b89-9a87-cf5a4b0fcb49 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1472 microversion: 2.1 time: 0.086481 Sep 02 10:09:44.863987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1176/2275] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:44 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1472 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:09:45.174638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:45.180494 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:45.181722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:45.182206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:45.182643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:45.183358 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:45.183810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:45.185025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:45.198306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] HTTP exception thrown: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Request method failure captured: Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa HTTP/1.1 Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc2zc-Q9BLz2klY6GTG9RC5NQHKGemM_FwRDn6Qd_pZRIYgEAe061FxBVsaii0-JV4KRPEy61Pp9yPCfS6T68Alqx3na4McUZ5fX4vLXpuhrVnIZb1uLjb6rdL2hJl-l2vVaTDRYg-dOyJlImhC3jn83OjB_bkBo9w1IneXFFubLJKw Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: ea33fe1eaf1047f78312a8e9fa9152c4 Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:09:45.200620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea33fe1eaf1047f78312a8e9fa9152c4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: ea33fe1eaf1047f78312a8e9fa9152c4 Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeTestJSON-1359953646-project Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: f65429de28ae41578c51a6b9099fea5c Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeTestJSON-1359953646-project Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:45.202227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'cdc0b1ef-0647-403b-82ca-28334d3627fa'} Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:09:45.206887 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:45.208730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:45.211954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Returning 404 to user: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:09:45.211954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7bce4a19-a29e-437c-b78f-8a403cd48c13 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 404 len: 111 microversion: 2.1 time: 0.031554 Sep 02 10:09:45.211954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1100/2276] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:09:45 2022] DELETE /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:09:45.212189 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:45.212189 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: cdc0b1ef-0647-403b-82ca-28334d3627fa] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:45.217630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:45.217910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:45.218133 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:45.218625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:45.218813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:45.219355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:45.219812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:45.220414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:45.225501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:45.226367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:45.226788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:45.228437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:45.228889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:45.229600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:45.236543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] HTTP exception thrown: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Request method failure captured: Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa HTTP/1.1 Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEc2zc-Q9BLz2klY6GTG9RC5NQHKGemM_FwRDn6Qd_pZRIYgEAe061FxBVsaii0-JV4KRPEy61Pp9yPCfS6T68Alqx3na4McUZ5fX4vLXpuhrVnIZb1uLjb6rdL2hJl-l2vVaTDRYg-dOyJlImhC3jn83OjB_bkBo9w1IneXFFubLJKw Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: ea33fe1eaf1047f78312a8e9fa9152c4 Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:09:45.238205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea33fe1eaf1047f78312a8e9fa9152c4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: ea33fe1eaf1047f78312a8e9fa9152c4 Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeTestJSON-1359953646-project Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: f65429de28ae41578c51a6b9099fea5c Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeTestJSON-1359953646-project Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:45.240300 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': 'cdc0b1ef-0647-403b-82ca-28334d3627fa'} Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:09:45.241512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. Sep 02 10:09:45.243362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:09:45.245053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Returning 404 to user: Instance cdc0b1ef-0647-403b-82ca-28334d3627fa could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:09:45.245053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dc8e63bf-9dc9-4980-bef6-402df6a7ba9b tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa" status: 404 len: 111 microversion: 2.1 time: 0.033157 Sep 02 10:09:45.245053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1177/2277] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:45 2022] GET /compute/v2.1/servers/cdc0b1ef-0647-403b-82ca-28334d3627fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:09:45.369775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:45.378687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:45.380184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:45.381282 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dc417011-ce56-45aa-b69c-7456068164ab tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1406 microversion: 2.20 time: 0.167814 Sep 02 10:09:45.381841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1101/2278] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:45 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:09:45.884500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:45.885113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:45.891500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:45.892257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:45.892700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:45.893387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:45.893868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:45.894319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:45.927874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:45.928357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:45.928795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:45.929241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lazy-loading 'fault' on Instance uuid 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:09:45.973946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '889d4c60870447bda2926106026a0537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7232d6277f26496ab552afa4abe13ad5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:45.981739 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1c92f029-5da0-4f68-941c-ba227a8f4b64 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 200 len: 1309 microversion: 2.1 time: 0.101002 Sep 02 10:09:45.982302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1178/2279] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:45 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:09:46.403894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:46.404418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:46.411532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:46.412043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:46.412516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:46.413252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:46.413738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:46.414165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:46.542988 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:46.551087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:46.552530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:09:46.553681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-87ec41c9-a8fb-4e79-aaae-0730d72418d5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1598 microversion: 2.20 time: 0.153853 Sep 02 10:09:46.554243 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1102/2280] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:09:46 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:09:46.580477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fd0b366b-826b-426b-bc3c-42c296bb9c10 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:46.580969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fd0b366b-826b-426b-bc3c-42c296bb9c10 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:46.586961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0b366b-826b-426b-bc3c-42c296bb9c10 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:46.587446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0b366b-826b-426b-bc3c-42c296bb9c10 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:46.587908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0b366b-826b-426b-bc3c-42c296bb9c10 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:46.588656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0b366b-826b-426b-bc3c-42c296bb9c10 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:46.589295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0b366b-826b-426b-bc3c-42c296bb9c10 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:46.589718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd0b366b-826b-426b-bc3c-42c296bb9c10 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:46.591116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:46.591617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:46.593821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:46.597600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:46.601895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:46.601895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:46.601895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:46.601895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:46.602307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:46.614679 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] HTTP exception thrown: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Request method failure captured: Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f HTTP/1.1 Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc2zc-Q9BLz2klY6GTG9RC5NQHKGemM_FwRDn6Qd_pZRIYgEAe061FxBVsaii0-JV4KRPEy61Pp9yPCfS6T68Alqx3na4McUZ5fX4vLXpuhrVnIZb1uLjb6rdL2hJl-l2vVaTDRYg-dOyJlImhC3jn83OjB_bkBo9w1IneXFFubLJKw Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: ea33fe1eaf1047f78312a8e9fa9152c4 Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:09:46.616260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea33fe1eaf1047f78312a8e9fa9152c4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: ea33fe1eaf1047f78312a8e9fa9152c4 Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeTestJSON-1359953646-project Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: f65429de28ae41578c51a6b9099fea5c Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeTestJSON-1359953646-project Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. Sep 02 10:09:46.618128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'ae283fdc-e807-415c-a156-8ec24163c45f'} Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:09:46.619064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. Sep 02 10:09:46.620482 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:46.622098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Returning 404 to user: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:09:46.622098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-934b6430-1a44-4d0b-9987-55e893085e12 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 404 len: 111 microversion: 2.1 time: 0.030777 Sep 02 10:09:46.622098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1103/2281] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:09:46 2022] DELETE /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 10:09:46.630345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:46.642633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] [instance: ae283fdc-e807-415c-a156-8ec24163c45f] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:46.642633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:46.642633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:46.642633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:46.643365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:46.643812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:46.644232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:46.658302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] HTTP exception thrown: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Request method failure captured: Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f HTTP/1.1 Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc2zc-Q9BLz2klY6GTG9RC5NQHKGemM_FwRDn6Qd_pZRIYgEAe061FxBVsaii0-JV4KRPEy61Pp9yPCfS6T68Alqx3na4McUZ5fX4vLXpuhrVnIZb1uLjb6rdL2hJl-l2vVaTDRYg-dOyJlImhC3jn83OjB_bkBo9w1IneXFFubLJKw Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: ea33fe1eaf1047f78312a8e9fa9152c4 Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:09:46.659785 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ea33fe1eaf1047f78312a8e9fa9152c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ea33fe1eaf1047f78312a8e9fa9152c4", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: ea33fe1eaf1047f78312a8e9fa9152c4 Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1359953646 Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeTestJSON-1359953646-project Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: f65429de28ae41578c51a6b9099fea5c Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeTestJSON-1359953646-project Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. Sep 02 10:09:46.661602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'ae283fdc-e807-415c-a156-8ec24163c45f'} Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:09:46.663765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. Sep 02 10:09:46.665400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:46.666911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] Returning 404 to user: Instance ae283fdc-e807-415c-a156-8ec24163c45f could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:09:46.666911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ff41941f-4e8e-4aa0-89df-ea851ad34a65 tempest-AttachVolumeTestJSON-1359953646 tempest-AttachVolumeTestJSON-1359953646-project] 10.222.0.57 "GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f" status: 404 len: 111 microversion: 2.1 time: 0.034811 Sep 02 10:09:46.666911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1104/2282] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:46 2022] GET /compute/v2.1/servers/ae283fdc-e807-415c-a156-8ec24163c45f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:09:46.669472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fd0b366b-826b-426b-bc3c-42c296bb9c10 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093499 Sep 02 10:09:46.670136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1179/2283] 10.222.0.57 () {60 vars in 1316 bytes} [Fri Sep 2 10:09:46 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 10:09:47.002740 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:09:47.003388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] [instance: 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:09:47.009366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:47.009845 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:47.010276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:47.010980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:47.011429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:47.011846 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:47.025193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] HTTP exception thrown: Instance 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 could not be found. Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Request method failure captured: Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 HTTP/1.1 Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEc6mkctKvb8Nt8q4V9eZInVr2Sbj-UGTJtKm-_o856B0arFnvpiQ5HGvopgJG1L1YrGdSV31LfSZ0-ik9WrL3PfQJHXOvuqVkKoJsexNtFVdmv7hADfkgq9jZU4qryfhYYT5c81LVMvIzh1ftwPLa2Jw5omeFzuoSt2LJD8Zzu5P3ts Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 7232d6277f26496ab552afa4abe13ad5 Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:09:47.026726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7232d6277f26496ab552afa4abe13ad5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7232d6277f26496ab552afa4abe13ad5", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 7232d6277f26496ab552afa4abe13ad5 Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1505638161 Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesSnapshotTestJSON-1505638161-project Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 889d4c60870447bda2926106026a0537 Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesSnapshotTestJSON-1505638161-project Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 could not be found. Sep 02 10:09:47.028546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '1a86dc04-b6ca-442f-9a4c-eb9c7da928c0'} Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 could not be found. Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:09:47.029769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 could not be found. Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 could not be found. Sep 02 10:09:47.032495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:09:47.034229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] Returning 404 to user: Instance 1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:09:47.034229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3367d7c4-bedc-4c59-8079-f1484285a559 tempest-VolumesSnapshotTestJSON-1505638161 tempest-VolumesSnapshotTestJSON-1505638161-project] 10.222.0.57 "GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0" status: 404 len: 111 microversion: 2.1 time: 0.030075 Sep 02 10:09:47.034229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1105/2284] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:09:46 2022] GET /compute/v2.1/servers/1a86dc04-b6ca-442f-9a4c-eb9c7da928c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:09:48.535380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-ccbe7ad2-c57b-4ef7-a376-eb2cbf493f6e req-987097d4-257d-4db4-a730-81d0af7ec8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7800ab6f-02d9-4d8f-a038-32b2676ec781", "tag": "37fe2545-9daa-4fdb-8240-493d506d5ff6"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:48.546057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-ccbe7ad2-c57b-4ef7-a376-eb2cbf493f6e req-987097d4-257d-4db4-a730-81d0af7ec8a9 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:09:48.548666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-ccbe7ad2-c57b-4ef7-a376-eb2cbf493f6e req-987097d4-257d-4db4-a730-81d0af7ec8a9 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:09:48.548666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-ccbe7ad2-c57b-4ef7-a376-eb2cbf493f6e req-987097d4-257d-4db4-a730-81d0af7ec8a9 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:09:48.558606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-ccbe7ad2-c57b-4ef7-a376-eb2cbf493f6e req-987097d4-257d-4db4-a730-81d0af7ec8a9 service nova] Creating event network-changed:37fe2545-9daa-4fdb-8240-493d506d5ff6 for instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 on hv-cinder-85083 Sep 02 10:09:48.564594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-ccbe7ad2-c57b-4ef7-a376-eb2cbf493f6e req-987097d4-257d-4db4-a730-81d0af7ec8a9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033624 Sep 02 10:09:48.565200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1180/2285] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:09:59.101290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:59.102022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=84 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:09:59.231521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-598848bb-7e13-490b-9da1-72654793da11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: .version_select at 0x7f4e5c20b5e0>, body: {"keypair": {"name": "tempest-keypair-400009572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBskTaFM7bF1AMdotOJKrrSGPoMSNDuPZxYFyJB2hUoOp8etxcuYdwFR5B6LpK+dqq/wAwtXBnDREL87IC/7fUlIaqRtkIiw8Q06t7pZqgCretScQKgcZGMy4VFIuX3JFw=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:09:59.248216 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-598848bb-7e13-490b-9da1-72654793da11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:09:59.251968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-598848bb-7e13-490b-9da1-72654793da11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for user 65963d36fc4741c69534b3dde1e00857 and project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:09:59.345191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-598848bb-7e13-490b-9da1-72654793da11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.249246 Sep 02 10:09:59.345801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1106/2286] 10.222.0.57 () {60 vars in 1159 bytes} [Fri Sep 2 10:09:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:10:01.735907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1184760611", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f26589e0-f0d0-4abe-9ad1-1113f17930dd"}], "security_groups": [{"name": "tempest-securitygroup--826790852"}], "key_name": "tempest-keypair-400009572", "user_data": "}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:10:01.750072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:10:01.750743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=4 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:10:01.852451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.network.neutron [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] validate_networks() for [('f26589e0-f0d0-4abe-9ad1-1113f17930dd', None, None, None, None, None)] {{(pid=127533) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 10:10:02.240726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Flavor limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 10:10:02.241169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Image limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 10:10:02.241641 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Flavor pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 10:10:02.242042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Image pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 10:10:02.242454 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 10:10:02.252195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:02.252715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:02.253191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:02.253918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:02.254537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:02.255004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:02.272550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:10:02.276500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for user 65963d36fc4741c69534b3dde1e00857 and project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:10:02.288080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Going to run 1 instances... {{(pid=127533) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 10:10:02.290472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127533) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 10:10:02.450032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-17d47d93-6611-4c41-a417-649912f57dfd tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.719465 Sep 02 10:10:02.450688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1181/2287] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 10:10:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 10:10:02.461850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-18666bc8-41b2-45fd-85ae-8db95ccfe4c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:02.464744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-18666bc8-41b2-45fd-85ae-8db95ccfe4c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:02.518864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-18666bc8-41b2-45fd-85ae-8db95ccfe4c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:02.526824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-18666bc8-41b2-45fd-85ae-8db95ccfe4c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1241 microversion: 2.1 time: 0.068726 Sep 02 10:10:02.527821 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1107/2288] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:02 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:03.549138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f93d1f56-35d4-4c43-ad5c-80c41d4ca5a6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:03.549750 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f93d1f56-35d4-4c43-ad5c-80c41d4ca5a6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:03.556442 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f93d1f56-35d4-4c43-ad5c-80c41d4ca5a6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:03.556982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f93d1f56-35d4-4c43-ad5c-80c41d4ca5a6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:03.557427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f93d1f56-35d4-4c43-ad5c-80c41d4ca5a6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:03.558101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f93d1f56-35d4-4c43-ad5c-80c41d4ca5a6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:03.558578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f93d1f56-35d4-4c43-ad5c-80c41d4ca5a6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:03.559029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f93d1f56-35d4-4c43-ad5c-80c41d4ca5a6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:03.620795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f93d1f56-35d4-4c43-ad5c-80c41d4ca5a6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:03.628471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f93d1f56-35d4-4c43-ad5c-80c41d4ca5a6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1245 microversion: 2.1 time: 0.084352 Sep 02 10:10:03.629027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1182/2289] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:03 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:04.648695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3f6f10f-db09-4ad6-91fd-0bec9e43dd94 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:04.649302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3f6f10f-db09-4ad6-91fd-0bec9e43dd94 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:04.655944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3f6f10f-db09-4ad6-91fd-0bec9e43dd94 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:04.656436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3f6f10f-db09-4ad6-91fd-0bec9e43dd94 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:04.656867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3f6f10f-db09-4ad6-91fd-0bec9e43dd94 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:04.657540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3f6f10f-db09-4ad6-91fd-0bec9e43dd94 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:04.657990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3f6f10f-db09-4ad6-91fd-0bec9e43dd94 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:04.658435 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3f6f10f-db09-4ad6-91fd-0bec9e43dd94 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:04.719880 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e3f6f10f-db09-4ad6-91fd-0bec9e43dd94 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:04.727749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3f6f10f-db09-4ad6-91fd-0bec9e43dd94 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1237 microversion: 2.1 time: 0.082870 Sep 02 10:10:04.731789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1108/2290] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:04 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:05.748763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-72117116-1f12-4f4c-b8b7-11119b36b76e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:05.750438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-72117116-1f12-4f4c-b8b7-11119b36b76e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:05.763496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72117116-1f12-4f4c-b8b7-11119b36b76e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:05.768521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72117116-1f12-4f4c-b8b7-11119b36b76e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:05.770370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72117116-1f12-4f4c-b8b7-11119b36b76e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:05.770370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72117116-1f12-4f4c-b8b7-11119b36b76e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:05.771892 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72117116-1f12-4f4c-b8b7-11119b36b76e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:05.772365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-72117116-1f12-4f4c-b8b7-11119b36b76e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:05.865597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-72117116-1f12-4f4c-b8b7-11119b36b76e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:05.873359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-72117116-1f12-4f4c-b8b7-11119b36b76e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1301 microversion: 2.1 time: 0.128458 Sep 02 10:10:05.887080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1183/2291] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:05 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1301 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:06.900439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d77cd01-29f2-4396-9993-7ec9f8c23aa7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:06.901273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6d77cd01-29f2-4396-9993-7ec9f8c23aa7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:06.909191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d77cd01-29f2-4396-9993-7ec9f8c23aa7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:06.909730 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d77cd01-29f2-4396-9993-7ec9f8c23aa7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:06.910176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d77cd01-29f2-4396-9993-7ec9f8c23aa7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:06.911089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d77cd01-29f2-4396-9993-7ec9f8c23aa7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:06.911409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d77cd01-29f2-4396-9993-7ec9f8c23aa7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:06.911830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d77cd01-29f2-4396-9993-7ec9f8c23aa7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:07.065379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6d77cd01-29f2-4396-9993-7ec9f8c23aa7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:07.072915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6d77cd01-29f2-4396-9993-7ec9f8c23aa7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1366 microversion: 2.1 time: 0.176634 Sep 02 10:10:07.073472 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1109/2292] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:06 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:07.471644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-95d1ae16-dac4-4a25-8c3a-293224d2f4eb req-9384a408-cc6e-46c8-b3cd-106f40e3fb1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1fc967-36d9-4d43-856d-9a9fdc5d9927", "tag": "b9bad87a-862e-4252-9a66-f647196d1c4d"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:10:07.483812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-95d1ae16-dac4-4a25-8c3a-293224d2f4eb req-9384a408-cc6e-46c8-b3cd-106f40e3fb1f service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:07.484324 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-95d1ae16-dac4-4a25-8c3a-293224d2f4eb req-9384a408-cc6e-46c8-b3cd-106f40e3fb1f service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:07.484828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-95d1ae16-dac4-4a25-8c3a-293224d2f4eb req-9384a408-cc6e-46c8-b3cd-106f40e3fb1f service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:07.498116 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-95d1ae16-dac4-4a25-8c3a-293224d2f4eb req-9384a408-cc6e-46c8-b3cd-106f40e3fb1f service nova] Creating event network-changed:b9bad87a-862e-4252-9a66-f647196d1c4d for instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 on hv-cinder-85083 Sep 02 10:10:07.511742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-95d1ae16-dac4-4a25-8c3a-293224d2f4eb req-9384a408-cc6e-46c8-b3cd-106f40e3fb1f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044667 Sep 02 10:10:07.512335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1184/2293] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:10:08.093958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cd4c1031-83f2-438c-9ef7-dc089cfc05da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:08.094787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cd4c1031-83f2-438c-9ef7-dc089cfc05da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:08.101591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd4c1031-83f2-438c-9ef7-dc089cfc05da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:08.102082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd4c1031-83f2-438c-9ef7-dc089cfc05da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:08.102604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd4c1031-83f2-438c-9ef7-dc089cfc05da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:08.103335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd4c1031-83f2-438c-9ef7-dc089cfc05da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:08.103787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd4c1031-83f2-438c-9ef7-dc089cfc05da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:08.104214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cd4c1031-83f2-438c-9ef7-dc089cfc05da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:08.235558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-cd4c1031-83f2-438c-9ef7-dc089cfc05da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:08.243517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cd4c1031-83f2-438c-9ef7-dc089cfc05da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1366 microversion: 2.1 time: 0.153961 Sep 02 10:10:08.244081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1110/2294] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:08 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:09.264990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ef6a64e2-c5ae-40fc-a799-ea85a7e52119 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:09.265681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ef6a64e2-c5ae-40fc-a799-ea85a7e52119 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:09.271948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef6a64e2-c5ae-40fc-a799-ea85a7e52119 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:09.272429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef6a64e2-c5ae-40fc-a799-ea85a7e52119 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:09.272862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef6a64e2-c5ae-40fc-a799-ea85a7e52119 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:09.273538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef6a64e2-c5ae-40fc-a799-ea85a7e52119 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:09.273981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef6a64e2-c5ae-40fc-a799-ea85a7e52119 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:09.274400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ef6a64e2-c5ae-40fc-a799-ea85a7e52119 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:09.405519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ef6a64e2-c5ae-40fc-a799-ea85a7e52119 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:09.413098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ef6a64e2-c5ae-40fc-a799-ea85a7e52119 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1366 microversion: 2.1 time: 0.152832 Sep 02 10:10:09.413652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1185/2295] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:09 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:10.433545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4e90b329-c8e0-43f9-9321-e356af591dc2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:10.434100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4e90b329-c8e0-43f9-9321-e356af591dc2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:10.440563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e90b329-c8e0-43f9-9321-e356af591dc2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:10.441044 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e90b329-c8e0-43f9-9321-e356af591dc2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:10.441476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e90b329-c8e0-43f9-9321-e356af591dc2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:10.442161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e90b329-c8e0-43f9-9321-e356af591dc2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:10.442681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e90b329-c8e0-43f9-9321-e356af591dc2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:10.443066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e90b329-c8e0-43f9-9321-e356af591dc2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:10.572551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4e90b329-c8e0-43f9-9321-e356af591dc2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:10.580702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4e90b329-c8e0-43f9-9321-e356af591dc2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1366 microversion: 2.1 time: 0.151158 Sep 02 10:10:10.581265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1111/2296] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:10 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:11.602394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3f96258c-c261-44d8-81d3-f98ea09bfa82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:11.603037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3f96258c-c261-44d8-81d3-f98ea09bfa82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:11.610106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3f96258c-c261-44d8-81d3-f98ea09bfa82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:11.610589 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3f96258c-c261-44d8-81d3-f98ea09bfa82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:11.611045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3f96258c-c261-44d8-81d3-f98ea09bfa82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:11.611748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3f96258c-c261-44d8-81d3-f98ea09bfa82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:11.612195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3f96258c-c261-44d8-81d3-f98ea09bfa82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:11.612617 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3f96258c-c261-44d8-81d3-f98ea09bfa82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:11.742820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3f96258c-c261-44d8-81d3-f98ea09bfa82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:11.750371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3f96258c-c261-44d8-81d3-f98ea09bfa82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1366 microversion: 2.1 time: 0.151897 Sep 02 10:10:11.750958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1186/2297] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:11 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:12.771088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5ea4ba42-5404-4a14-b894-718ad07829da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:12.771705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5ea4ba42-5404-4a14-b894-718ad07829da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:12.774015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:10:12.778978 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ea4ba42-5404-4a14-b894-718ad07829da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:12.779465 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ea4ba42-5404-4a14-b894-718ad07829da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:12.780211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ea4ba42-5404-4a14-b894-718ad07829da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:12.781449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ea4ba42-5404-4a14-b894-718ad07829da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:12.781909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ea4ba42-5404-4a14-b894-718ad07829da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:12.782338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ea4ba42-5404-4a14-b894-718ad07829da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:12.912625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5ea4ba42-5404-4a14-b894-718ad07829da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:12.920497 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5ea4ba42-5404-4a14-b894-718ad07829da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1366 microversion: 2.1 time: 0.154294 Sep 02 10:10:12.921063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1112/2298] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:12 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:13.940875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-12a3b348-96b4-4875-8a90-b49612cbafc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:13.941487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-12a3b348-96b4-4875-8a90-b49612cbafc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:13.943509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:10:13.944235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=6 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:10:13.950555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12a3b348-96b4-4875-8a90-b49612cbafc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:13.951086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12a3b348-96b4-4875-8a90-b49612cbafc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:13.951543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12a3b348-96b4-4875-8a90-b49612cbafc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:13.952232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12a3b348-96b4-4875-8a90-b49612cbafc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:13.953179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12a3b348-96b4-4875-8a90-b49612cbafc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:13.955047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-12a3b348-96b4-4875-8a90-b49612cbafc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:14.090397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-12a3b348-96b4-4875-8a90-b49612cbafc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:14.095613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-12a3b348-96b4-4875-8a90-b49612cbafc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1366 microversion: 2.1 time: 0.158626 Sep 02 10:10:14.096176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1187/2299] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:13 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:14.578193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-82c45326-497b-4d52-87e5-23f7b11e62fe req-cd4bcbea-b5ed-413c-9029-d84eeb1edd62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1fc967-36d9-4d43-856d-9a9fdc5d9927", "name": "network-vif-plugged", "status": "completed", "tag": "b9bad87a-862e-4252-9a66-f647196d1c4d"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:10:14.588110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-82c45326-497b-4d52-87e5-23f7b11e62fe req-cd4bcbea-b5ed-413c-9029-d84eeb1edd62 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:14.588587 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-82c45326-497b-4d52-87e5-23f7b11e62fe req-cd4bcbea-b5ed-413c-9029-d84eeb1edd62 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:14.588991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-82c45326-497b-4d52-87e5-23f7b11e62fe req-cd4bcbea-b5ed-413c-9029-d84eeb1edd62 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:14.599561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-82c45326-497b-4d52-87e5-23f7b11e62fe req-cd4bcbea-b5ed-413c-9029-d84eeb1edd62 service nova] Creating event network-vif-plugged:b9bad87a-862e-4252-9a66-f647196d1c4d for instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 on hv-cinder-85083 Sep 02 10:10:14.604550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-82c45326-497b-4d52-87e5-23f7b11e62fe req-cd4bcbea-b5ed-413c-9029-d84eeb1edd62 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030047 Sep 02 10:10:14.605155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1113/2300] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:10:15.116464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7b7b7e48-c3a6-4f11-8774-f94f17726bb5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:15.117134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7b7b7e48-c3a6-4f11-8774-f94f17726bb5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:15.123495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b7b7e48-c3a6-4f11-8774-f94f17726bb5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:15.123984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b7b7e48-c3a6-4f11-8774-f94f17726bb5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:15.124433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b7b7e48-c3a6-4f11-8774-f94f17726bb5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:15.125168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b7b7e48-c3a6-4f11-8774-f94f17726bb5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:15.125646 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b7b7e48-c3a6-4f11-8774-f94f17726bb5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:15.126061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7b7b7e48-c3a6-4f11-8774-f94f17726bb5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:15.264364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7b7b7e48-c3a6-4f11-8774-f94f17726bb5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:15.272606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7b7b7e48-c3a6-4f11-8774-f94f17726bb5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1366 microversion: 2.1 time: 0.160238 Sep 02 10:10:15.273162 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1188/2301] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:15 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:16.294353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-58fddb0d-f1bf-44fe-95b7-2a8c3b980fbe tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:16.294946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-58fddb0d-f1bf-44fe-95b7-2a8c3b980fbe tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:16.301473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58fddb0d-f1bf-44fe-95b7-2a8c3b980fbe tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:16.301951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58fddb0d-f1bf-44fe-95b7-2a8c3b980fbe tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:16.302386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58fddb0d-f1bf-44fe-95b7-2a8c3b980fbe tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:16.303093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58fddb0d-f1bf-44fe-95b7-2a8c3b980fbe tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:16.303550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58fddb0d-f1bf-44fe-95b7-2a8c3b980fbe tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:16.303970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-58fddb0d-f1bf-44fe-95b7-2a8c3b980fbe tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:16.431864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-58fddb0d-f1bf-44fe-95b7-2a8c3b980fbe tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:16.440058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-58fddb0d-f1bf-44fe-95b7-2a8c3b980fbe tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1366 microversion: 2.1 time: 0.150489 Sep 02 10:10:16.440620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1114/2302] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:16 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:10:17.461828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cae57408-9fad-41e7-8574-1a9e601f5600 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:17.462505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cae57408-9fad-41e7-8574-1a9e601f5600 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:17.469137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cae57408-9fad-41e7-8574-1a9e601f5600 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:17.469626 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cae57408-9fad-41e7-8574-1a9e601f5600 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:17.470064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cae57408-9fad-41e7-8574-1a9e601f5600 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:17.471504 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cae57408-9fad-41e7-8574-1a9e601f5600 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:17.471969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cae57408-9fad-41e7-8574-1a9e601f5600 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:17.472396 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cae57408-9fad-41e7-8574-1a9e601f5600 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:17.604146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cae57408-9fad-41e7-8574-1a9e601f5600 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:10:17.611995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cae57408-9fad-41e7-8574-1a9e601f5600 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1555 microversion: 2.1 time: 0.154094 Sep 02 10:10:17.612811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1189/2303] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:10:17 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:10:17.632538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a00c2fa8-164b-4a01-b243-6234f0cf7fe3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:10:17.633084 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a00c2fa8-164b-4a01-b243-6234f0cf7fe3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:10:17.640116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a00c2fa8-164b-4a01-b243-6234f0cf7fe3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:17.640599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a00c2fa8-164b-4a01-b243-6234f0cf7fe3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:17.641033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a00c2fa8-164b-4a01-b243-6234f0cf7fe3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:17.641743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a00c2fa8-164b-4a01-b243-6234f0cf7fe3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:17.642252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a00c2fa8-164b-4a01-b243-6234f0cf7fe3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:17.643188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a00c2fa8-164b-4a01-b243-6234f0cf7fe3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:17.755087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a00c2fa8-164b-4a01-b243-6234f0cf7fe3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126303 Sep 02 10:10:17.755833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1115/2304] 10.222.0.57 () {58 vars in 1275 bytes} [Fri Sep 2 10:10:17 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:10:19.062149 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-cce04de6-2be6-41e2-8a6b-ce09db1e96c8 req-c607b0a9-13c3-47ae-8317-54322a1c1beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1fc967-36d9-4d43-856d-9a9fdc5d9927", "tag": "b9bad87a-862e-4252-9a66-f647196d1c4d"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:10:19.072264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-cce04de6-2be6-41e2-8a6b-ce09db1e96c8 req-c607b0a9-13c3-47ae-8317-54322a1c1beb service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:10:19.072740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-cce04de6-2be6-41e2-8a6b-ce09db1e96c8 req-c607b0a9-13c3-47ae-8317-54322a1c1beb service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:10:19.073172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-cce04de6-2be6-41e2-8a6b-ce09db1e96c8 req-c607b0a9-13c3-47ae-8317-54322a1c1beb service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:10:19.089413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-cce04de6-2be6-41e2-8a6b-ce09db1e96c8 req-c607b0a9-13c3-47ae-8317-54322a1c1beb service nova] Creating event network-changed:b9bad87a-862e-4252-9a66-f647196d1c4d for instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 on hv-cinder-85083 Sep 02 10:10:19.098016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-cce04de6-2be6-41e2-8a6b-ce09db1e96c8 req-c607b0a9-13c3-47ae-8317-54322a1c1beb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039533 Sep 02 10:10:19.101664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1190/2305] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:11:03.657513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:03.658280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=42 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:03.662970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-968d5f5b-ba60-4d55-84f7-c7899cdd174b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:03.663459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-968d5f5b-ba60-4d55-84f7-c7899cdd174b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:03.670128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-968d5f5b-ba60-4d55-84f7-c7899cdd174b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:03.670604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-968d5f5b-ba60-4d55-84f7-c7899cdd174b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:03.671077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-968d5f5b-ba60-4d55-84f7-c7899cdd174b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:03.673025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-968d5f5b-ba60-4d55-84f7-c7899cdd174b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:03.673025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-968d5f5b-ba60-4d55-84f7-c7899cdd174b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:03.673025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-968d5f5b-ba60-4d55-84f7-c7899cdd174b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:03.697867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-968d5f5b-ba60-4d55-84f7-c7899cdd174b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/ips" status: 200 len: 151 microversion: 2.20 time: 0.041899 Sep 02 10:11:03.701760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1116/2306] 10.222.0.57 () {60 vars in 1289 bytes} [Fri Sep 2 10:11:03 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 10:11:06.878736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d7b7b9ea-c1eb-4e9e-aab8-52a0508aca29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:11:06.879352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d7b7b9ea-c1eb-4e9e-aab8-52a0508aca29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:06.881738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:06.882401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=48 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:06.888307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7b7b9ea-c1eb-4e9e-aab8-52a0508aca29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:06.888795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7b7b9ea-c1eb-4e9e-aab8-52a0508aca29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:06.889237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7b7b9ea-c1eb-4e9e-aab8-52a0508aca29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:06.889924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7b7b9ea-c1eb-4e9e-aab8-52a0508aca29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:06.890378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7b7b9ea-c1eb-4e9e-aab8-52a0508aca29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:06.890837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7b7b9ea-c1eb-4e9e-aab8-52a0508aca29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:06.913888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-d7b7b9ea-c1eb-4e9e-aab8-52a0508aca29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lazy-loading 'flavor' on Instance uuid 7800ab6f-02d9-4d8f-a038-32b2676ec781 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:11:07.594666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d7b7b9ea-c1eb-4e9e-aab8-52a0508aca29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "POST /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/action" status: 202 len: 0 microversion: 2.20 time: 0.720386 Sep 02 10:11:07.595289 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1191/2307] 10.222.0.57 () {62 vars in 1319 bytes} [Fri Sep 2 10:11:06 2022] POST /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/action => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:11:07.604536 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:07.605169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:07.612448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:07.612921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:07.613345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:07.614013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:07.614457 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:07.614901 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:07.842179 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:07.850407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:07.851934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:07.853083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1db9d20f-cabb-4ade-9e23-2f3a11607cad tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.253342 Sep 02 10:11:07.853641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1117/2308] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:07 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:08.877636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:08.878340 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:08.885494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:08.885984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:08.886423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:08.887140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:08.887600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:08.888026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:09.088845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:09.096924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:09.098383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:09.099580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7320145e-e2f9-4f42-98de-d5fbbe5c9d5e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.226718 Sep 02 10:11:09.100147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1192/2309] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:08 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:10.122467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:10.123081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:10.129504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:10.129983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:10.130417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:10.131130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:10.131582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:10.132006 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:10.261264 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:10.269226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:10.273798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:10.273798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ce4068f4-837c-472d-adbf-d4649b98ab4e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.153419 Sep 02 10:11:10.273798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1118/2310] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:10 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:11.295938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:11.296513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:11.302877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:11.303362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:11.303797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:11.304519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:11.304969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:11.305393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:11.437013 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:11.444930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:11.446373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:11.447548 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3455847f-4a9f-4790-876b-256efc8e220b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.155647 Sep 02 10:11:11.448114 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1193/2311] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:11 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:12.470804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:12.471357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:12.477745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:12.478231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:12.478667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:12.479379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:12.479829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:12.480251 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:12.604593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:12.613160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:12.614583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:12.615761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6049e8d6-e677-496f-a74a-5122de525fae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.148955 Sep 02 10:11:12.616325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1119/2312] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:12 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:13.640479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:13.641682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:13.649020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:13.649508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:13.649948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:13.650636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:13.651125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:13.651555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:13.776756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:13.784724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:13.786183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:13.787394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-331303e2-e077-482d-97a8-bb523b4853c5 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.151572 Sep 02 10:11:13.787955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1194/2313] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:13 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:14.810625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:14.811330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:14.818619 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:14.819122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:14.820299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:14.820998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:14.821450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:14.821873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:14.952544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:14.960560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:14.962012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:14.963198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6538cec3-c9d9-4098-ab0f-630c922f412e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.156532 Sep 02 10:11:14.963778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1120/2314] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:14 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:11:15.986205 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:15.986847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:15.993443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:15.993925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:15.994357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:15.995077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:15.995527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:15.995947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:16.127942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:16.136449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:16.137886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:16.139050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2b9f143a-178f-450b-b84f-c23ba7676226 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.157028 Sep 02 10:11:16.139613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1195/2315] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:15 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:17.162672 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:17.163295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:17.170376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:17.170907 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:17.171348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:17.172033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:17.172492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:17.172922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:17.298531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:17.306583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:17.308067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:17.309217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-abeb047c-b25a-4ded-b044-77baafff8459 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.150518 Sep 02 10:11:17.309775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1121/2316] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:17 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:18.332024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:18.332724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:18.339276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:18.339765 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:18.343743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:18.343743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:18.343743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:18.343743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:18.468409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:18.476898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:18.478357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:18.479552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cc56f148-afbd-4346-9e0c-52af5a680b0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.151471 Sep 02 10:11:18.480104 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1196/2317] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:18 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:19.503302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:19.503976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:19.510996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:19.511499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:19.511931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:19.512608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:19.513059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:19.513484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:19.644701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:19.652702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:19.654197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:19.655376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7dc83bef-8b12-4162-8d5c-e90a43f626c8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1743 microversion: 2.20 time: 0.156077 Sep 02 10:11:19.655934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1122/2318] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:19 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:20.678200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:20.678842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:20.685269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:20.685753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:20.686189 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:20.686927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:20.687382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:20.687815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:20.817507 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:20.826072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:20.827535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:20.828685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1c8eb5a3-0c2a-4a6a-90cb-c9bc1a3b1ecd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1743 microversion: 2.20 time: 0.154383 Sep 02 10:11:20.829247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1197/2319] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:20 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:21.851120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:21.852316 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:21.858660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:21.859171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:21.859610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:21.860294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:21.861005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:21.861430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:22.001454 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:22.010149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:22.011620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:22.012764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e57f458e-3054-44a4-9734-456fb0223cb8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1743 microversion: 2.20 time: 0.165551 Sep 02 10:11:22.013315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1123/2320] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:21 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:23.036612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:23.037247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:23.044158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:23.044689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:23.045127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:23.045832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:23.046290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:23.046737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:23.175900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:23.184389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:23.185825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:23.187001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-67b0b39e-62a7-4387-9605-a3f50641c66b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1743 microversion: 2.20 time: 0.154349 Sep 02 10:11:23.190798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1198/2321] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:23 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:24.209417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:24.210020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:24.216551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:24.217031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:24.217458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:24.218133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:24.218576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:24.219092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:24.345262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:24.354170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:24.355638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:24.356833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c380a4cc-7490-4d74-adaa-a8a0c8936f2d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1743 microversion: 2.20 time: 0.151262 Sep 02 10:11:24.357370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1124/2322] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:24 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:11:24.814089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-6a632c92-b7bd-4d4e-be97-67d6ab907668 req-fc0c60f8-241b-40f8-a378-1a9f680a62b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7800ab6f-02d9-4d8f-a038-32b2676ec781", "name": "network-vif-plugged", "status": "completed", "tag": "37fe2545-9daa-4fdb-8240-493d506d5ff6"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:11:24.826996 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6a632c92-b7bd-4d4e-be97-67d6ab907668 req-fc0c60f8-241b-40f8-a378-1a9f680a62b8 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:24.828727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6a632c92-b7bd-4d4e-be97-67d6ab907668 req-fc0c60f8-241b-40f8-a378-1a9f680a62b8 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:24.828727 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-6a632c92-b7bd-4d4e-be97-67d6ab907668 req-fc0c60f8-241b-40f8-a378-1a9f680a62b8 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:24.839922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-6a632c92-b7bd-4d4e-be97-67d6ab907668 req-fc0c60f8-241b-40f8-a378-1a9f680a62b8 service nova] Creating event network-vif-plugged:37fe2545-9daa-4fdb-8240-493d506d5ff6 for instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 on hv-cinder-85083 Sep 02 10:11:24.846132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-6a632c92-b7bd-4d4e-be97-67d6ab907668 req-fc0c60f8-241b-40f8-a378-1a9f680a62b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036440 Sep 02 10:11:24.846752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1199/2323] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:11:25.379598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:25.382065 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:25.387061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:25.387544 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:25.388004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:25.388753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:25.389197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:25.389618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:25.532404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:25.543140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:25.543140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:25.543881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9e05ec45-5038-494c-9b08-25c282144b81 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1738 microversion: 2.20 time: 0.167849 Sep 02 10:11:25.549557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1125/2324] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:25 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:26.569630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:26.571528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:26.578022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:26.578518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:26.578988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:26.579694 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:26.580150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:26.580579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:26.726737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:26.736580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:26.738057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:26.739311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c141636d-d47b-495e-b2eb-755fbae69555 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1738 microversion: 2.20 time: 0.174680 Sep 02 10:11:26.740359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1200/2325] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:26 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:27.761601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:27.763133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:27.772244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:27.772740 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:27.773183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:27.774380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:27.774869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:27.775303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:27.923192 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:27.931612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:27.933327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:27.934802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2ef7206d-42f6-4331-8906-7f39e0c2457b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1738 microversion: 2.20 time: 0.177215 Sep 02 10:11:27.935939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1126/2326] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:27 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:28.959270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:28.959842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:28.967615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:28.968381 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:28.968818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:28.969893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:28.970418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:28.971102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:29.126966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:29.135710 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:29.137466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:29.138643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b0a91089-e4b6-424d-866c-06f51de44a15 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1738 microversion: 2.20 time: 0.183719 Sep 02 10:11:29.139225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1201/2327] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:28 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:30.161865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:30.163214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:30.169609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:30.170096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:30.172847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:30.172847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:30.172847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:30.172847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:30.319698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:30.329032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:30.330525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:30.331755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b3420d11-09fe-434d-927c-f924619bafbe tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1738 microversion: 2.20 time: 0.173812 Sep 02 10:11:30.339055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1127/2328] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:30 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:31.354935 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:31.355577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:31.362183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:31.362666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:31.363126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:31.363817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:31.364276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:31.364699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:31.500977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:31.509752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:31.511249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:31.512407 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ce192911-f2ae-483d-adeb-2cd377b11fa7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1738 microversion: 2.20 time: 0.161537 Sep 02 10:11:31.513019 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1202/2329] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:31 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:32.535449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:32.536054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:32.543556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:32.544102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:32.544550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:32.545242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:32.545698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:32.546122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:32.715032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:32.724161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:32.725605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:32.727572 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-430a4ffe-64f7-44c3-ad0a-3933ef0684af tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1738 microversion: 2.20 time: 0.196231 Sep 02 10:11:32.742728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1128/2330] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:32 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:33.752615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:33.753500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:33.760130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:33.760620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:33.761058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:33.761787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:33.762238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:33.762662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:33.919902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:33.929288 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:33.930631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:33.931842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b30fbc77-548e-4df5-961b-f995f1d4cfb1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1738 microversion: 2.20 time: 0.183198 Sep 02 10:11:33.934064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1203/2331] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:33 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:11:34.185447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f8ed2781-2148-43db-b3f6-241397e9bf5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:34.186031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f8ed2781-2148-43db-b3f6-241397e9bf5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:34.192367 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ed2781-2148-43db-b3f6-241397e9bf5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:34.192857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ed2781-2148-43db-b3f6-241397e9bf5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:34.193295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ed2781-2148-43db-b3f6-241397e9bf5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:34.193974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ed2781-2148-43db-b3f6-241397e9bf5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:34.194428 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ed2781-2148-43db-b3f6-241397e9bf5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:34.194882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f8ed2781-2148-43db-b3f6-241397e9bf5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:34.219168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f8ed2781-2148-43db-b3f6-241397e9bf5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/ips" status: 200 len: 149 microversion: 2.1 time: 0.037541 Sep 02 10:11:34.219735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1129/2332] 10.222.0.57 () {58 vars in 1248 bytes} [Fri Sep 2 10:11:34 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:11:34.956402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:34.957427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:34.964943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:34.965925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:34.967757 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:34.968949 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:34.969479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:34.970107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:35.169230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:35.177744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:35.179223 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:35.189850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b343f946-76d3-416c-8884-e5176a917d4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1738 microversion: 2.20 time: 0.228204 Sep 02 10:11:35.189850 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1204/2333] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:34 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:36.156547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1f4bd628-e626-4e21-bf73-cd7c8ced955c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf7796d5-95c6-4540-8057-5758f161e5ff"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:11:36.158900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1f4bd628-e626-4e21-bf73-cd7c8ced955c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:36.165514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f4bd628-e626-4e21-bf73-cd7c8ced955c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:36.165999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f4bd628-e626-4e21-bf73-cd7c8ced955c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:36.166437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f4bd628-e626-4e21-bf73-cd7c8ced955c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:36.167251 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f4bd628-e626-4e21-bf73-cd7c8ced955c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:36.167705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f4bd628-e626-4e21-bf73-cd7c8ced955c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:36.168135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1f4bd628-e626-4e21-bf73-cd7c8ced955c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:36.205411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:36.206050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:36.213797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:36.214286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:36.214741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:36.215435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:36.215889 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:36.216316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:36.353171 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:36.361943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:36.363432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:36.364573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e90521a7-e7e0-4503-9704-9ec19b3633d3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1738 microversion: 2.20 time: 0.163206 Sep 02 10:11:36.365130 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1205/2334] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:36 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:11:37.256145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1f4bd628-e626-4e21-bf73-cd7c8ced955c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.103382 Sep 02 10:11:37.263022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1130/2335] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 10:11:36 2022] POST /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-volume_attachments => generated 194 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:11:37.389219 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:37.390634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:37.393164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=31 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:37.398868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:37.399421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:37.399865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:37.400574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:37.401023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:37.401451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:37.404231 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:37.541478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:37.549424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:37.550906 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:37.552071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-62542931-c8ab-4b46-9682-68cca1c3d60a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1720 microversion: 2.20 time: 0.167407 Sep 02 10:11:37.552608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1206/2336] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:37 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:38.577327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:38.577979 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:38.579917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=31 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:38.584818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:38.585301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:38.585737 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:38.586418 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:38.587523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:38.587949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:38.591860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:38.715561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:38.723474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:38.724912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:38.726046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9c3fda87-1f3d-44f6-8fc6-0ec32b1d87e0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1720 microversion: 2.20 time: 0.153593 Sep 02 10:11:38.726602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1131/2337] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:38 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:39.749828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:39.750280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:39.758041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:39.758528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:39.758984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:39.760309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:39.760764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:39.761187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:39.890579 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:39.898644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:39.900122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:39.901267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e06e2c43-fec9-4f19-b799-1b6b3a7b45f7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1723 microversion: 2.20 time: 0.155527 Sep 02 10:11:39.901830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1207/2338] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:39 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:39.923704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-83148439-b4b7-4d37-9d34-d3a8067c86a7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7144779d-e1b0-4534-9364-24a0b1f7be3b"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:11:39.926152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-83148439-b4b7-4d37-9d34-d3a8067c86a7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:39.933229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83148439-b4b7-4d37-9d34-d3a8067c86a7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:39.933716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83148439-b4b7-4d37-9d34-d3a8067c86a7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:39.934155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83148439-b4b7-4d37-9d34-d3a8067c86a7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:39.934886 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83148439-b4b7-4d37-9d34-d3a8067c86a7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:39.935345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83148439-b4b7-4d37-9d34-d3a8067c86a7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:39.935775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-83148439-b4b7-4d37-9d34-d3a8067c86a7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:40.898002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-329400c6-eb5c-4524-81c4-7f241f9ff09d req-83097426-0f15-4905-9834-ac977b3d69db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7800ab6f-02d9-4d8f-a038-32b2676ec781", "name": "network-vif-unplugged", "status": "completed", "tag": "37fe2545-9daa-4fdb-8240-493d506d5ff6"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:11:40.899546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-83148439-b4b7-4d37-9d34-d3a8067c86a7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "POST /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.978692 Sep 02 10:11:40.905582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1132/2339] 10.222.0.57 () {62 vars in 1364 bytes} [Fri Sep 2 10:11:39 2022] POST /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments => generated 188 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 10:11:40.908586 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-329400c6-eb5c-4524-81c4-7f241f9ff09d req-83097426-0f15-4905-9834-ac977b3d69db service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:40.909073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-329400c6-eb5c-4524-81c4-7f241f9ff09d req-83097426-0f15-4905-9834-ac977b3d69db service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:40.909506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-329400c6-eb5c-4524-81c4-7f241f9ff09d req-83097426-0f15-4905-9834-ac977b3d69db service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:40.920700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.compute.server_external_events [req-329400c6-eb5c-4524-81c4-7f241f9ff09d req-83097426-0f15-4905-9834-ac977b3d69db service nova] Unable to find a host for instance 7800ab6f-02d9-4d8f-a038-32b2676ec781. Dropping event network-vif-unplugged {{(pid=127533) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 02 10:11:40.921581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-329400c6-eb5c-4524-81c4-7f241f9ff09d req-83097426-0f15-4905-9834-ac977b3d69db service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027547 Sep 02 10:11:40.922162 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1208/2340] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 02 10:11:41.030076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3cf063b7-88e8-432d-9f1a-d3a78a3d9461 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:11:41.030076 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3cf063b7-88e8-432d-9f1a-d3a78a3d9461 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:41.036996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf063b7-88e8-432d-9f1a-d3a78a3d9461 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:41.037481 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf063b7-88e8-432d-9f1a-d3a78a3d9461 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:41.037924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf063b7-88e8-432d-9f1a-d3a78a3d9461 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:41.038609 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf063b7-88e8-432d-9f1a-d3a78a3d9461 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:41.039108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf063b7-88e8-432d-9f1a-d3a78a3d9461 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:41.039618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3cf063b7-88e8-432d-9f1a-d3a78a3d9461 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:41.082399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3cf063b7-88e8-432d-9f1a-d3a78a3d9461 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127531) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 10:11:41.301238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3cf063b7-88e8-432d-9f1a-d3a78a3d9461 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "POST /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/action" status: 202 len: 0 microversion: 2.20 time: 0.276802 Sep 02 10:11:41.304956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1133/2341] 10.222.0.57 () {62 vars in 1319 bytes} [Fri Sep 2 10:11:41 2022] POST /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:11:41.310298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:41.311244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:41.317597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:41.318169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:41.318679 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:41.319467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:41.320142 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:41.320799 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:41.458520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:41.468848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:41.470311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:41.471508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6db82837-710f-45ff-b244-817e6348eab6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1749 microversion: 2.20 time: 0.165137 Sep 02 10:11:41.472093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1209/2342] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:41 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:41.610173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7bc9d4b7-fa8a-4608-9dbe-2545dda601bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: .version_select at 0x7f4e5fbb45e0>, body: {"keypair": {"name": "tempest-keypair-490901793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHDXVxdRMm9GByvsyD+qP08g54fyC1rudcDnVNjNIE4RwM0oLBcBXy6HKphDtMiw7z3JyE/Gw4UAog443aaN5KKPpAbDTVJdokWVYLs33EKQrvxVUH8rC38RjTcELqj+g=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:11:41.625446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-7bc9d4b7-fa8a-4608-9dbe-2545dda601bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:11:41.629268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-7bc9d4b7-fa8a-4608-9dbe-2545dda601bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for user 65963d36fc4741c69534b3dde1e00857 and project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:11:41.711825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7bc9d4b7-fa8a-4608-9dbe-2545dda601bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105633 Sep 02 10:11:41.713007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1134/2343] 10.222.0.57 () {60 vars in 1159 bytes} [Fri Sep 2 10:11:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:11:42.495608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:42.496258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:42.502781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:42.503368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:42.503877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:42.504580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:42.505036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:42.505469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:42.632738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:42.641409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:42.643005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:42.644245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9b0a112f-cebe-48a5-9932-97d433986c61 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1749 microversion: 2.20 time: 0.153408 Sep 02 10:11:42.644802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1210/2344] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:42 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:11:43.668516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:43.669161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:43.676425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:43.676996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:43.677525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:43.678220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:43.678671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:43.679231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:43.826811 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:43.835425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:43.836796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:43.838586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2b577d18-862b-47ab-8009-fd5e4783a415 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1751 microversion: 2.20 time: 0.174541 Sep 02 10:11:43.839179 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1135/2345] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:43 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:44.133344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1370099409", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f26589e0-f0d0-4abe-9ad1-1113f17930dd"}], "security_groups": [{"name": "tempest-securitygroup--1596129060"}], "key_name": "tempest-keypair-490901793", "user_data": "}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:11:44.235922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.network.neutron [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] validate_networks() for [('f26589e0-f0d0-4abe-9ad1-1113f17930dd', None, None, None, None, None)] {{(pid=127533) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 10:11:44.614344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Flavor limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 10:11:44.614798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Image limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 10:11:44.615272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Flavor pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 10:11:44.615678 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Image pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 10:11:44.616123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 10:11:44.625808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:44.626285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:44.627490 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:44.628631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:44.633775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:44.633775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:44.647304 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:11:44.652106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for user 65963d36fc4741c69534b3dde1e00857 and project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:11:44.663125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Going to run 1 instances... {{(pid=127533) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 10:11:44.665451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127533) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 10:11:44.804488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3a54e07a-da9d-4245-ad27-b1af84c13089 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.675331 Sep 02 10:11:44.805141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1211/2346] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 10:11:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 10:11:44.816035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2d869900-ed5d-4d8b-8424-79098470086b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:44.816787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2d869900-ed5d-4d8b-8424-79098470086b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:44.862552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:44.863325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:44.874580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2d869900-ed5d-4d8b-8424-79098470086b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:44.878008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:44.878531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:44.879003 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:44.879718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:44.880259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:44.880570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:44.882219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2d869900-ed5d-4d8b-8424-79098470086b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1241 microversion: 2.1 time: 0.070013 Sep 02 10:11:44.883103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1136/2347] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:44 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:11:45.015929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:45.024566 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:45.026528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:45.027834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-74225f18-cb9e-49f7-8462-2bad8df3d389 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.169941 Sep 02 10:11:45.028395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1212/2348] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:44 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:11:45.902498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-da495b5a-c3be-4d3f-982d-2cb83cbfce11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:45.904904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-da495b5a-c3be-4d3f-982d-2cb83cbfce11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:45.910594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da495b5a-c3be-4d3f-982d-2cb83cbfce11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:45.911108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da495b5a-c3be-4d3f-982d-2cb83cbfce11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:45.911655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da495b5a-c3be-4d3f-982d-2cb83cbfce11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:45.912488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da495b5a-c3be-4d3f-982d-2cb83cbfce11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:45.912948 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da495b5a-c3be-4d3f-982d-2cb83cbfce11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:45.913373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da495b5a-c3be-4d3f-982d-2cb83cbfce11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:45.979534 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da495b5a-c3be-4d3f-982d-2cb83cbfce11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:45.985452 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-da495b5a-c3be-4d3f-982d-2cb83cbfce11 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1245 microversion: 2.1 time: 0.087286 Sep 02 10:11:45.990772 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1137/2349] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:45 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:46.051768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:46.052383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:46.058846 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:46.059361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:46.059801 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:46.060479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:46.060931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:46.061355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:46.199452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:46.212056 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:46.215703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:46.218084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b06e7333-c311-4b04-bf12-0dccd2adebe6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.170346 Sep 02 10:11:46.226962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1213/2350] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:46 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:47.006427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-503d2122-c514-477a-bb92-ac8d209c0fc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:47.007208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-503d2122-c514-477a-bb92-ac8d209c0fc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:47.014852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-503d2122-c514-477a-bb92-ac8d209c0fc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:47.015780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-503d2122-c514-477a-bb92-ac8d209c0fc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:47.016283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-503d2122-c514-477a-bb92-ac8d209c0fc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:47.017096 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-503d2122-c514-477a-bb92-ac8d209c0fc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:47.017779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-503d2122-c514-477a-bb92-ac8d209c0fc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:47.018265 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-503d2122-c514-477a-bb92-ac8d209c0fc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:47.089880 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-503d2122-c514-477a-bb92-ac8d209c0fc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:47.098661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-503d2122-c514-477a-bb92-ac8d209c0fc8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.096030 Sep 02 10:11:47.099917 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1138/2351] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:47 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:47.241836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:47.242697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:47.249699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:47.250460 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:47.250987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:47.251744 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:47.252307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:47.252803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:47.391736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:47.400360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:47.401803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:47.402978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bd8e7105-3ef3-46c8-84bd-2a7166b6b588 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.165013 Sep 02 10:11:47.403530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1214/2352] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:47 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:48.120701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c0b9908c-2fc7-4672-8282-8122286e65d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:48.121312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c0b9908c-2fc7-4672-8282-8122286e65d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:48.127714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9908c-2fc7-4672-8282-8122286e65d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:48.128199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9908c-2fc7-4672-8282-8122286e65d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:48.128634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9908c-2fc7-4672-8282-8122286e65d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:48.129325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9908c-2fc7-4672-8282-8122286e65d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:48.129777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9908c-2fc7-4672-8282-8122286e65d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:48.130215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c0b9908c-2fc7-4672-8282-8122286e65d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:48.195088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c0b9908c-2fc7-4672-8282-8122286e65d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:48.203280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c0b9908c-2fc7-4672-8282-8122286e65d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.086879 Sep 02 10:11:48.204491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1139/2353] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:48 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:48.427593 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:48.428295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:48.435182 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:48.435696 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:48.436139 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:48.436833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:48.437283 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:48.437705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:48.579305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:48.588615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:48.590064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:48.591259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cc76e90e-b6e1-4825-8f97-8cc7d39af6e3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.167992 Sep 02 10:11:48.591817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1215/2354] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:48 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:49.224147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e7e20a9-d9d9-4265-880b-5c7ce66c37da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:49.224746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e7e20a9-d9d9-4265-880b-5c7ce66c37da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:49.231196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e7e20a9-d9d9-4265-880b-5c7ce66c37da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:49.231680 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e7e20a9-d9d9-4265-880b-5c7ce66c37da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:49.232112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e7e20a9-d9d9-4265-880b-5c7ce66c37da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:49.232791 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e7e20a9-d9d9-4265-880b-5c7ce66c37da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:49.233242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e7e20a9-d9d9-4265-880b-5c7ce66c37da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:49.233665 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e7e20a9-d9d9-4265-880b-5c7ce66c37da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:49.296953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1e7e20a9-d9d9-4265-880b-5c7ce66c37da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:49.304743 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e7e20a9-d9d9-4265-880b-5c7ce66c37da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.084579 Sep 02 10:11:49.305311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1140/2355] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:49 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:49.615415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:49.616093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:49.623334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:49.623820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:49.624261 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:49.624946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:49.625402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:49.625829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:49.767895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:49.777947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:49.779470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:49.780674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a50a2220-8d73-4953-819a-7dc335373155 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.169191 Sep 02 10:11:49.781233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1216/2356] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:49 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:50.326838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c83317b6-6cbe-43d8-aee8-6120fc236bba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:50.327453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c83317b6-6cbe-43d8-aee8-6120fc236bba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:50.333830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c83317b6-6cbe-43d8-aee8-6120fc236bba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:50.334313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c83317b6-6cbe-43d8-aee8-6120fc236bba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:50.334872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c83317b6-6cbe-43d8-aee8-6120fc236bba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:50.335567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c83317b6-6cbe-43d8-aee8-6120fc236bba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:50.336016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c83317b6-6cbe-43d8-aee8-6120fc236bba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:50.336439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c83317b6-6cbe-43d8-aee8-6120fc236bba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:50.403063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c83317b6-6cbe-43d8-aee8-6120fc236bba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:50.417581 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c83317b6-6cbe-43d8-aee8-6120fc236bba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.094467 Sep 02 10:11:50.422130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1141/2357] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:50 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:50.804724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:50.806907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:50.814830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:50.815704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:50.816383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:50.817462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:50.818172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:50.818900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:50.964281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:50.973150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:50.974607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:50.975907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3c28898f-0641-4143-b162-1fd2126fff0b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.175235 Sep 02 10:11:50.976471 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1217/2358] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:50 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:51.442817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8ad19b72-9b7f-4c5b-993f-4448aa015d2a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:51.444557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8ad19b72-9b7f-4c5b-993f-4448aa015d2a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:51.452136 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad19b72-9b7f-4c5b-993f-4448aa015d2a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:51.453125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad19b72-9b7f-4c5b-993f-4448aa015d2a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:51.453973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad19b72-9b7f-4c5b-993f-4448aa015d2a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:51.455112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad19b72-9b7f-4c5b-993f-4448aa015d2a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:51.455806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad19b72-9b7f-4c5b-993f-4448aa015d2a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:51.457094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ad19b72-9b7f-4c5b-993f-4448aa015d2a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:51.522125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ad19b72-9b7f-4c5b-993f-4448aa015d2a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:51.530499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8ad19b72-9b7f-4c5b-993f-4448aa015d2a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.091968 Sep 02 10:11:51.531111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1142/2359] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:51 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:51.999743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:52.001244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:52.008253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:52.008794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:52.009803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:52.010539 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:52.011052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:52.011524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:52.163081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:52.172238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:52.173699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:52.174902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1368fd77-7815-4d42-b8b7-3af0299f66e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.179075 Sep 02 10:11:52.175464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1218/2360] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:51 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:52.553284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-43fa40ad-0b72-4657-8f89-e2d0cb52534c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:52.553961 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-43fa40ad-0b72-4657-8f89-e2d0cb52534c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:52.561218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fa40ad-0b72-4657-8f89-e2d0cb52534c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:52.561798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fa40ad-0b72-4657-8f89-e2d0cb52534c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:52.562307 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fa40ad-0b72-4657-8f89-e2d0cb52534c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:52.563145 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fa40ad-0b72-4657-8f89-e2d0cb52534c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:52.563786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fa40ad-0b72-4657-8f89-e2d0cb52534c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:52.564311 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fa40ad-0b72-4657-8f89-e2d0cb52534c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:52.639004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-43fa40ad-0b72-4657-8f89-e2d0cb52534c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:52.649783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-43fa40ad-0b72-4657-8f89-e2d0cb52534c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.100245 Sep 02 10:11:52.651060 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1143/2361] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:52 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:53.199821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:53.200458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:53.207036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:53.207529 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:53.207967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:53.208974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:53.209433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:53.209866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:53.360063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:53.369468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:53.370931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:53.372119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dd90bc25-23b9-40b7-ad24-1f88663ce9d7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.176934 Sep 02 10:11:53.373028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1219/2362] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:53 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:53.673792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-bf9b8dd9-62c7-4889-8080-0369875d53bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:53.674436 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-bf9b8dd9-62c7-4889-8080-0369875d53bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:53.681951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf9b8dd9-62c7-4889-8080-0369875d53bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:53.682437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf9b8dd9-62c7-4889-8080-0369875d53bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:53.682898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf9b8dd9-62c7-4889-8080-0369875d53bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:53.683589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf9b8dd9-62c7-4889-8080-0369875d53bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:53.684035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf9b8dd9-62c7-4889-8080-0369875d53bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:53.684453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-bf9b8dd9-62c7-4889-8080-0369875d53bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:53.749511 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-bf9b8dd9-62c7-4889-8080-0369875d53bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:53.758423 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-bf9b8dd9-62c7-4889-8080-0369875d53bc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.088538 Sep 02 10:11:53.759317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1144/2363] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:53 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:54.400573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:54.401493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:54.408387 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:54.409258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:54.409959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:54.410945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:54.411636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:54.412296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:54.551368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:54.560411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:54.561873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:54.563077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-51465c55-118f-4ea1-bd87-f5a87c78a5d4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.166991 Sep 02 10:11:54.563633 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1220/2364] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:54 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:54.778923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-eb427fee-9d22-43ce-b809-07d1656ed38f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:54.779503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-eb427fee-9d22-43ce-b809-07d1656ed38f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:54.785941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb427fee-9d22-43ce-b809-07d1656ed38f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:54.786455 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb427fee-9d22-43ce-b809-07d1656ed38f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:54.786923 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb427fee-9d22-43ce-b809-07d1656ed38f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:54.787631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb427fee-9d22-43ce-b809-07d1656ed38f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:54.788083 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb427fee-9d22-43ce-b809-07d1656ed38f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:54.788507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-eb427fee-9d22-43ce-b809-07d1656ed38f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:54.850465 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-eb427fee-9d22-43ce-b809-07d1656ed38f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:54.858226 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-eb427fee-9d22-43ce-b809-07d1656ed38f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.083196 Sep 02 10:11:54.858809 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1145/2365] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:54 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:55.586916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:55.588038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:55.589936 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:55.590594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=6 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:55.595853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:55.601746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:55.601746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:55.601746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:55.601746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:55.602187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:55.724920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:55.733488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:55.735207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:55.736393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-95bd4815-295a-4dc6-be83-7189d4028e24 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.153439 Sep 02 10:11:55.736954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1221/2366] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:55 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:55.880020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-466461d9-9c16-4098-88d9-79eb6c3ded70 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:55.880630 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-466461d9-9c16-4098-88d9-79eb6c3ded70 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:55.882531 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:55.888661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-466461d9-9c16-4098-88d9-79eb6c3ded70 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:55.892373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-466461d9-9c16-4098-88d9-79eb6c3ded70 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:55.892373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-466461d9-9c16-4098-88d9-79eb6c3ded70 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:55.892373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-466461d9-9c16-4098-88d9-79eb6c3ded70 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:55.892373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-466461d9-9c16-4098-88d9-79eb6c3ded70 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:55.892854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-466461d9-9c16-4098-88d9-79eb6c3ded70 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:55.893690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:55.955512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-466461d9-9c16-4098-88d9-79eb6c3ded70 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:55.963562 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-466461d9-9c16-4098-88d9-79eb6c3ded70 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.087313 Sep 02 10:11:55.964121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1146/2367] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:55 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:56.759489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:56.760092 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:56.766527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:56.767048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:56.767486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:56.768168 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:56.768618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:56.769039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:56.896553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:56.905126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:56.907255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:56.907762 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8d998b96-8191-4981-b7f2-e42dc65ccf23 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.152308 Sep 02 10:11:56.908319 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1222/2368] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:56 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:56.984857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ba9e2e1e-6034-4577-9ffe-f5f2926ce2d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:56.985467 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ba9e2e1e-6034-4577-9ffe-f5f2926ce2d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:56.992162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba9e2e1e-6034-4577-9ffe-f5f2926ce2d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:56.992632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba9e2e1e-6034-4577-9ffe-f5f2926ce2d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:56.993058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba9e2e1e-6034-4577-9ffe-f5f2926ce2d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:56.993739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba9e2e1e-6034-4577-9ffe-f5f2926ce2d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:56.994180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba9e2e1e-6034-4577-9ffe-f5f2926ce2d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:56.994597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ba9e2e1e-6034-4577-9ffe-f5f2926ce2d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:57.055372 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ba9e2e1e-6034-4577-9ffe-f5f2926ce2d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:57.062668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ba9e2e1e-6034-4577-9ffe-f5f2926ce2d5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.082249 Sep 02 10:11:57.063255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1147/2369] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:56 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:11:57.931271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:57.931887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:57.938357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:57.938878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:57.939315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:57.939998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:57.940456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:57.940877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:58.071158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:58.079622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:58.081213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:58.082374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-82e4d7a1-dfcb-4ebe-9e9d-b26ed398d6f2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.155006 Sep 02 10:11:58.082966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1223/2370] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:57 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:58.083318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f5cbe392-d4a9-487a-a67f-ceff49ca22aa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:58.083926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f5cbe392-d4a9-487a-a67f-ceff49ca22aa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:58.090753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5cbe392-d4a9-487a-a67f-ceff49ca22aa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:58.091233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5cbe392-d4a9-487a-a67f-ceff49ca22aa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:58.091663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5cbe392-d4a9-487a-a67f-ceff49ca22aa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:58.092341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5cbe392-d4a9-487a-a67f-ceff49ca22aa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:58.092787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5cbe392-d4a9-487a-a67f-ceff49ca22aa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:58.093203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f5cbe392-d4a9-487a-a67f-ceff49ca22aa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:58.153938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f5cbe392-d4a9-487a-a67f-ceff49ca22aa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:58.161476 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f5cbe392-d4a9-487a-a67f-ceff49ca22aa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.081894 Sep 02 10:11:58.162028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1148/2371] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:58 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:11:59.105910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:59.106525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:59.113208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:59.113689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:59.114121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:59.114829 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:59.115286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:59.115712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:59.118832 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:11:59.183009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-60b7d69b-3ca7-4985-b960-97fd80a90966 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:11:59.183600 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-60b7d69b-3ca7-4985-b960-97fd80a90966 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:11:59.189899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b7d69b-3ca7-4985-b960-97fd80a90966 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:59.190379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b7d69b-3ca7-4985-b960-97fd80a90966 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:59.190851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b7d69b-3ca7-4985-b960-97fd80a90966 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:59.191530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b7d69b-3ca7-4985-b960-97fd80a90966 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:11:59.192424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b7d69b-3ca7-4985-b960-97fd80a90966 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:11:59.192424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-60b7d69b-3ca7-4985-b960-97fd80a90966 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:11:59.243940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:59.252655 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:59.253575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-60b7d69b-3ca7-4985-b960-97fd80a90966 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:59.254101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:11:59.255334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-00ece303-737b-45a9-ae4c-950c75f3a72b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.153811 Sep 02 10:11:59.255909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1224/2372] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:11:59 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:11:59.261639 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-60b7d69b-3ca7-4985-b960-97fd80a90966 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.083280 Sep 02 10:11:59.262275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1149/2373] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:11:59 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:12:00.278175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:00.278870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:00.281167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-75dd9638-cc97-4ab2-bae0-364512ac012f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:00.281788 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-75dd9638-cc97-4ab2-bae0-364512ac012f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:00.285286 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:00.285771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:00.286209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:00.287008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:00.287464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:00.287914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:00.288123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75dd9638-cc97-4ab2-bae0-364512ac012f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:00.288601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75dd9638-cc97-4ab2-bae0-364512ac012f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:00.289063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75dd9638-cc97-4ab2-bae0-364512ac012f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:00.289745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75dd9638-cc97-4ab2-bae0-364512ac012f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:00.290198 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75dd9638-cc97-4ab2-bae0-364512ac012f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:00.290615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-75dd9638-cc97-4ab2-bae0-364512ac012f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:00.356891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-75dd9638-cc97-4ab2-bae0-364512ac012f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:00.364934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-75dd9638-cc97-4ab2-bae0-364512ac012f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.087530 Sep 02 10:12:00.367714 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1150/2374] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:00 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:12:00.423301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:00.432248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:00.433689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:00.434870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6452b616-324e-4cb2-9cfe-8238410a0a92 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.160667 Sep 02 10:12:00.435426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1225/2375] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:00 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:01.386755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f03a235a-f156-473d-a953-e3f5561fd77d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:01.387374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f03a235a-f156-473d-a953-e3f5561fd77d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:01.393966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f03a235a-f156-473d-a953-e3f5561fd77d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:01.394442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f03a235a-f156-473d-a953-e3f5561fd77d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:01.394909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f03a235a-f156-473d-a953-e3f5561fd77d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:01.395642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f03a235a-f156-473d-a953-e3f5561fd77d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:01.396087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f03a235a-f156-473d-a953-e3f5561fd77d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:01.396504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f03a235a-f156-473d-a953-e3f5561fd77d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:01.458686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:01.459335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:01.466677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:01.467222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:01.467660 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:01.468356 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:01.468803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:01.469222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:01.603328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:01.612702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:01.614187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:01.615389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6f6c814f-388f-4203-9962-e2bd08456333 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.160607 Sep 02 10:12:01.615945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1226/2376] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:01 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:12:01.717767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f03a235a-f156-473d-a953-e3f5561fd77d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:01.725368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f03a235a-f156-473d-a953-e3f5561fd77d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.343071 Sep 02 10:12:01.725927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1151/2377] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:01 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:02.639052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:02.639692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:02.646110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:02.646584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:02.647051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:02.647731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:02.648204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:02.648622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:02.745783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d876fae5-2fc4-4c5e-a1ff-e987decc11be tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:02.746498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d876fae5-2fc4-4c5e-a1ff-e987decc11be tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:02.752859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d876fae5-2fc4-4c5e-a1ff-e987decc11be tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:02.753342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d876fae5-2fc4-4c5e-a1ff-e987decc11be tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:02.753776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d876fae5-2fc4-4c5e-a1ff-e987decc11be tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:02.754466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d876fae5-2fc4-4c5e-a1ff-e987decc11be tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:02.754949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d876fae5-2fc4-4c5e-a1ff-e987decc11be tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:02.755405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d876fae5-2fc4-4c5e-a1ff-e987decc11be tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:02.788465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:02.797550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:02.799029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:02.800191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-71e36c41-b8fb-4ec7-b4bb-842cb190bf47 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.165081 Sep 02 10:12:02.800748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1227/2378] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:02 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:02.816940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d876fae5-2fc4-4c5e-a1ff-e987decc11be tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:02.824622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d876fae5-2fc4-4c5e-a1ff-e987decc11be tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.083148 Sep 02 10:12:02.825185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1152/2379] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:02 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:12:03.824513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:03.825122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:03.831527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:03.831954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:03.832393 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:03.833079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:03.833531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:03.833962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:03.845049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-39396c91-8d12-4af3-98c1-a4a1e40c7d3f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:03.846066 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-39396c91-8d12-4af3-98c1-a4a1e40c7d3f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:03.852242 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39396c91-8d12-4af3-98c1-a4a1e40c7d3f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:03.853236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39396c91-8d12-4af3-98c1-a4a1e40c7d3f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:03.853236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39396c91-8d12-4af3-98c1-a4a1e40c7d3f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:03.853854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39396c91-8d12-4af3-98c1-a4a1e40c7d3f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:03.854308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39396c91-8d12-4af3-98c1-a4a1e40c7d3f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:03.854750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-39396c91-8d12-4af3-98c1-a4a1e40c7d3f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:03.916854 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-39396c91-8d12-4af3-98c1-a4a1e40c7d3f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:03.924459 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-39396c91-8d12-4af3-98c1-a4a1e40c7d3f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1293 microversion: 2.1 time: 0.083238 Sep 02 10:12:03.925035 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1153/2380] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:03 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:12:03.973825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:03.982420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:03.983908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:03.985317 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-354691eb-1f0b-46f2-a298-e8656a0e62ea tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.165218 Sep 02 10:12:03.985874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1228/2381] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:03 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:04.945697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-43fcb255-ed7a-4717-931b-0afb6af70be2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:04.946423 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-43fcb255-ed7a-4717-931b-0afb6af70be2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:04.953197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fcb255-ed7a-4717-931b-0afb6af70be2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:04.956046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fcb255-ed7a-4717-931b-0afb6af70be2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:04.956046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fcb255-ed7a-4717-931b-0afb6af70be2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:04.956046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fcb255-ed7a-4717-931b-0afb6af70be2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:04.956046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fcb255-ed7a-4717-931b-0afb6af70be2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:04.956484 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-43fcb255-ed7a-4717-931b-0afb6af70be2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:05.009108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:05.009723 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:05.016553 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:05.017296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:05.017743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:05.018509 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:05.018651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-43fcb255-ed7a-4717-931b-0afb6af70be2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:05.019307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:05.019741 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:05.028160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-43fcb255-ed7a-4717-931b-0afb6af70be2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1299 microversion: 2.1 time: 0.086331 Sep 02 10:12:05.028932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1154/2382] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:04 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:05.185313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:05.193878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:05.195364 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:05.197054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6ce33526-8a09-4caf-b6e1-1f4f90bdeb62 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.192364 Sep 02 10:12:05.197643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1229/2383] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:05 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:12:06.049222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-770d9a9e-f876-4cbd-b91c-2f885f66f8e3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:06.049866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-770d9a9e-f876-4cbd-b91c-2f885f66f8e3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:06.056526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-770d9a9e-f876-4cbd-b91c-2f885f66f8e3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:06.056940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-770d9a9e-f876-4cbd-b91c-2f885f66f8e3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:06.057381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-770d9a9e-f876-4cbd-b91c-2f885f66f8e3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:06.058070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-770d9a9e-f876-4cbd-b91c-2f885f66f8e3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:06.058525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-770d9a9e-f876-4cbd-b91c-2f885f66f8e3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:06.058983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-770d9a9e-f876-4cbd-b91c-2f885f66f8e3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:06.192759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-770d9a9e-f876-4cbd-b91c-2f885f66f8e3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:06.201050 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-770d9a9e-f876-4cbd-b91c-2f885f66f8e3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1367 microversion: 2.1 time: 0.155796 Sep 02 10:12:06.201617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1155/2384] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:06 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:06.221306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:06.222316 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:06.232124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:06.232124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:06.232124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:06.232124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:06.232734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:06.233177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:06.234444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-e079f1d6-2434-404f-bb8a-acfd075469c9 req-5742a942-e755-4df6-8c80-e52c1b239e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ede06e-7501-4396-9431-6a17dfaadc36", "tag": "cc0ea721-b328-4da5-a8a6-2d44ef12e861"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:12:06.244543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-e079f1d6-2434-404f-bb8a-acfd075469c9 req-5742a942-e755-4df6-8c80-e52c1b239e57 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:06.245019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-e079f1d6-2434-404f-bb8a-acfd075469c9 req-5742a942-e755-4df6-8c80-e52c1b239e57 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:06.245715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-e079f1d6-2434-404f-bb8a-acfd075469c9 req-5742a942-e755-4df6-8c80-e52c1b239e57 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:06.256944 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-e079f1d6-2434-404f-bb8a-acfd075469c9 req-5742a942-e755-4df6-8c80-e52c1b239e57 service nova] Creating event network-changed:cc0ea721-b328-4da5-a8a6-2d44ef12e861 for instance 96ede06e-7501-4396-9431-6a17dfaadc36 on hv-cinder-85083 Sep 02 10:12:06.262873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-e079f1d6-2434-404f-bb8a-acfd075469c9 req-5742a942-e755-4df6-8c80-e52c1b239e57 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032355 Sep 02 10:12:06.265701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1156/2385] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:12:06.469476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:06.478212 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:06.479771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:06.481001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f4af792a-2b32-4cd2-8925-1c812d474c42 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.264747 Sep 02 10:12:06.481658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1230/2386] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:06 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:07.222565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8e7ba608-0eef-4298-9eb5-7f0f74a1e238 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:07.223300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8e7ba608-0eef-4298-9eb5-7f0f74a1e238 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:07.230373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7ba608-0eef-4298-9eb5-7f0f74a1e238 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:07.230885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7ba608-0eef-4298-9eb5-7f0f74a1e238 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:07.231318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7ba608-0eef-4298-9eb5-7f0f74a1e238 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:07.232003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7ba608-0eef-4298-9eb5-7f0f74a1e238 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:07.232646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7ba608-0eef-4298-9eb5-7f0f74a1e238 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:07.233049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e7ba608-0eef-4298-9eb5-7f0f74a1e238 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:07.366291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8e7ba608-0eef-4298-9eb5-7f0f74a1e238 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:07.374803 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8e7ba608-0eef-4298-9eb5-7f0f74a1e238 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1367 microversion: 2.1 time: 0.156939 Sep 02 10:12:07.375429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1157/2387] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:07 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:07.505105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:07.505718 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:07.512621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:07.513127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:07.513557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:07.514235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:07.514677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:07.515125 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:07.643541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:07.651910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:07.653339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:07.654475 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-911d367e-fa27-4380-897e-409fe0eaa29b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.153660 Sep 02 10:12:07.655076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1231/2388] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:07 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:08.396031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4e625a77-024c-4aec-8c97-d04f96941ac0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:08.396638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4e625a77-024c-4aec-8c97-d04f96941ac0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:08.403092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e625a77-024c-4aec-8c97-d04f96941ac0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:08.403568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e625a77-024c-4aec-8c97-d04f96941ac0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:08.403998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e625a77-024c-4aec-8c97-d04f96941ac0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:08.404673 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e625a77-024c-4aec-8c97-d04f96941ac0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:08.405118 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e625a77-024c-4aec-8c97-d04f96941ac0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:08.405537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4e625a77-024c-4aec-8c97-d04f96941ac0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:08.534583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4e625a77-024c-4aec-8c97-d04f96941ac0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:08.542123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4e625a77-024c-4aec-8c97-d04f96941ac0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1367 microversion: 2.1 time: 0.149992 Sep 02 10:12:08.542689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1158/2389] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:08 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:08.677039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:08.677647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:08.679995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:12:08.685448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:08.685932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:08.686368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:08.687072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:08.687580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:08.688005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:08.820409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:08.828983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:08.830429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:08.831622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ecde32e5-c774-4b98-9b7a-f9535b774e67 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.158487 Sep 02 10:12:08.832175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1232/2390] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:08 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:09.561707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb77d04e-1c57-49fb-b063-11054d34b745 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:09.562319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb77d04e-1c57-49fb-b063-11054d34b745 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:09.564769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:12:09.569442 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb77d04e-1c57-49fb-b063-11054d34b745 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:09.571822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb77d04e-1c57-49fb-b063-11054d34b745 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:09.571822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb77d04e-1c57-49fb-b063-11054d34b745 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:09.571822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb77d04e-1c57-49fb-b063-11054d34b745 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:09.571822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb77d04e-1c57-49fb-b063-11054d34b745 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:09.572780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb77d04e-1c57-49fb-b063-11054d34b745 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:09.697731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb77d04e-1c57-49fb-b063-11054d34b745 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:09.705317 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb77d04e-1c57-49fb-b063-11054d34b745 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1367 microversion: 2.1 time: 0.147491 Sep 02 10:12:09.705881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1159/2391] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:09 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:09.854426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:09.855088 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:09.861748 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:09.862227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:09.862658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:09.863367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:09.863815 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:09.864232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:09.989946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:09.998930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:10.000367 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:10.001519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d8bffc29-bbdb-4ca4-839e-906e58f23ad9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.151208 Sep 02 10:12:10.002061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1233/2392] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:09 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:10.726453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b70b17a3-06b9-45a2-92f3-a4e8cd705a29 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:10.727087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b70b17a3-06b9-45a2-92f3-a4e8cd705a29 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:10.734321 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70b17a3-06b9-45a2-92f3-a4e8cd705a29 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:10.734832 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70b17a3-06b9-45a2-92f3-a4e8cd705a29 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:10.735269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70b17a3-06b9-45a2-92f3-a4e8cd705a29 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:10.735937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70b17a3-06b9-45a2-92f3-a4e8cd705a29 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:10.736384 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70b17a3-06b9-45a2-92f3-a4e8cd705a29 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:10.736804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b70b17a3-06b9-45a2-92f3-a4e8cd705a29 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:10.871290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b70b17a3-06b9-45a2-92f3-a4e8cd705a29 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:10.880053 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b70b17a3-06b9-45a2-92f3-a4e8cd705a29 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1367 microversion: 2.1 time: 0.157431 Sep 02 10:12:10.880633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1160/2393] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:10 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:11.024237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:11.024842 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:11.031808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:11.035623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:11.035623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:11.035623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:11.035623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:11.036053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:11.168637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:11.177318 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:11.178796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:11.179948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-626a1e2b-84e2-4da5-b062-e1671f46c7fd tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.159584 Sep 02 10:12:11.180501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1234/2394] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:11 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:11.901350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-65f370be-b68f-4aa5-a6b0-c523749a4e7b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:11.901958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-65f370be-b68f-4aa5-a6b0-c523749a4e7b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:11.908439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65f370be-b68f-4aa5-a6b0-c523749a4e7b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:11.908921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65f370be-b68f-4aa5-a6b0-c523749a4e7b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:11.909362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65f370be-b68f-4aa5-a6b0-c523749a4e7b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:11.910041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65f370be-b68f-4aa5-a6b0-c523749a4e7b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:11.910495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65f370be-b68f-4aa5-a6b0-c523749a4e7b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:11.910957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65f370be-b68f-4aa5-a6b0-c523749a4e7b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:12.035963 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-65f370be-b68f-4aa5-a6b0-c523749a4e7b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:12.043491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-65f370be-b68f-4aa5-a6b0-c523749a4e7b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1367 microversion: 2.1 time: 0.146595 Sep 02 10:12:12.044058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1161/2395] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:11 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:12.203715 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:12.204332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:12.210865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:12.211355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:12.211797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:12.212488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:12.212974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:12.213404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:12.344993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:12.353551 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:12.355043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:12.356229 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a8244ebe-5a3e-449c-be06-4168fda1221c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.156512 Sep 02 10:12:12.356788 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1235/2396] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:12 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:13.064866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c5dfe4e4-e606-49fa-8126-e5e1de0d8256 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:13.065671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c5dfe4e4-e606-49fa-8126-e5e1de0d8256 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:13.073739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5dfe4e4-e606-49fa-8126-e5e1de0d8256 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:13.074313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5dfe4e4-e606-49fa-8126-e5e1de0d8256 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:13.075408 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5dfe4e4-e606-49fa-8126-e5e1de0d8256 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:13.075670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5dfe4e4-e606-49fa-8126-e5e1de0d8256 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:13.076200 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5dfe4e4-e606-49fa-8126-e5e1de0d8256 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:13.076801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c5dfe4e4-e606-49fa-8126-e5e1de0d8256 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:13.193903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-8113ddb6-b405-41dc-b6b0-03046e901bff req-c30fb839-463e-40ea-88a6-560bbab3ee62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ede06e-7501-4396-9431-6a17dfaadc36", "name": "network-vif-plugged", "status": "completed", "tag": "cc0ea721-b328-4da5-a8a6-2d44ef12e861"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:12:13.210809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-8113ddb6-b405-41dc-b6b0-03046e901bff req-c30fb839-463e-40ea-88a6-560bbab3ee62 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:13.212148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-8113ddb6-b405-41dc-b6b0-03046e901bff req-c30fb839-463e-40ea-88a6-560bbab3ee62 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:13.213400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-8113ddb6-b405-41dc-b6b0-03046e901bff req-c30fb839-463e-40ea-88a6-560bbab3ee62 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:13.224650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c5dfe4e4-e606-49fa-8126-e5e1de0d8256 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:13.225964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-8113ddb6-b405-41dc-b6b0-03046e901bff req-c30fb839-463e-40ea-88a6-560bbab3ee62 service nova] Creating event network-vif-plugged:cc0ea721-b328-4da5-a8a6-2d44ef12e861 for instance 96ede06e-7501-4396-9431-6a17dfaadc36 on hv-cinder-85083 Sep 02 10:12:13.233340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c5dfe4e4-e606-49fa-8126-e5e1de0d8256 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1367 microversion: 2.1 time: 0.172909 Sep 02 10:12:13.234479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-8113ddb6-b405-41dc-b6b0-03046e901bff req-c30fb839-463e-40ea-88a6-560bbab3ee62 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044645 Sep 02 10:12:13.235025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1162/2397] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:13 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:13.235876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1236/2398] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:12:13.381255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:13.382100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:13.388947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:13.389441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:13.390045 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:13.390753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:13.391294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:13.391724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:13.407549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:12:13.533144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:13.542668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:13.544248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:13.545548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f1e4e25b-87dd-41b7-87b2-6a936541e783 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.168800 Sep 02 10:12:13.546407 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1163/2399] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:13 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:14.256043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d7a0d262-0145-438d-8ed3-986f9a8c8f7d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:14.256763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d7a0d262-0145-438d-8ed3-986f9a8c8f7d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:14.263377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7a0d262-0145-438d-8ed3-986f9a8c8f7d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:14.263863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7a0d262-0145-438d-8ed3-986f9a8c8f7d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:14.264298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7a0d262-0145-438d-8ed3-986f9a8c8f7d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:14.264974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7a0d262-0145-438d-8ed3-986f9a8c8f7d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:14.265420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7a0d262-0145-438d-8ed3-986f9a8c8f7d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:14.265839 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d7a0d262-0145-438d-8ed3-986f9a8c8f7d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:14.394323 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d7a0d262-0145-438d-8ed3-986f9a8c8f7d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:14.401921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d7a0d262-0145-438d-8ed3-986f9a8c8f7d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1367 microversion: 2.1 time: 0.150594 Sep 02 10:12:14.402477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1237/2400] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:14 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:14.569677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:14.570288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:14.577331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:14.577815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:14.578248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:14.578960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:14.579409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:14.579830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:14.708599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:14.717341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:14.718872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:14.720031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e06855da-d258-466a-bcd7-3f69f09afe22 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.154603 Sep 02 10:12:14.720589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1164/2401] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:14 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:15.255265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-657cdacc-1e74-48dc-b24b-bddfa55dcebf req-588f027d-0edc-4bf2-9f72-bcb92325dfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7800ab6f-02d9-4d8f-a038-32b2676ec781", "name": "network-vif-plugged", "status": "completed", "tag": "37fe2545-9daa-4fdb-8240-493d506d5ff6"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:12:15.265258 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-657cdacc-1e74-48dc-b24b-bddfa55dcebf req-588f027d-0edc-4bf2-9f72-bcb92325dfe6 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:15.265893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-657cdacc-1e74-48dc-b24b-bddfa55dcebf req-588f027d-0edc-4bf2-9f72-bcb92325dfe6 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:15.266166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-657cdacc-1e74-48dc-b24b-bddfa55dcebf req-588f027d-0edc-4bf2-9f72-bcb92325dfe6 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:15.280195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-657cdacc-1e74-48dc-b24b-bddfa55dcebf req-588f027d-0edc-4bf2-9f72-bcb92325dfe6 service nova] Creating event network-vif-plugged:37fe2545-9daa-4fdb-8240-493d506d5ff6 for instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 on hv-cinder-85083 Sep 02 10:12:15.285274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-657cdacc-1e74-48dc-b24b-bddfa55dcebf req-588f027d-0edc-4bf2-9f72-bcb92325dfe6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034095 Sep 02 10:12:15.285894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1238/2402] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:12:15.422032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b1ebf9f-788a-4a2f-b343-6d9a59441a96 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:15.422642 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8b1ebf9f-788a-4a2f-b343-6d9a59441a96 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:15.428695 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ebf9f-788a-4a2f-b343-6d9a59441a96 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:15.429177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ebf9f-788a-4a2f-b343-6d9a59441a96 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:15.429607 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ebf9f-788a-4a2f-b343-6d9a59441a96 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:15.430284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ebf9f-788a-4a2f-b343-6d9a59441a96 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:15.430753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ebf9f-788a-4a2f-b343-6d9a59441a96 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:15.431179 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b1ebf9f-788a-4a2f-b343-6d9a59441a96 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:15.555400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8b1ebf9f-788a-4a2f-b343-6d9a59441a96 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:15.563025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8b1ebf9f-788a-4a2f-b343-6d9a59441a96 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1556 microversion: 2.1 time: 0.144951 Sep 02 10:12:15.563601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1165/2403] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:12:15 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1556 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:12:15.584247 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-17f3c894-8674-4937-9ea0-5a8683ac4743 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:15.584819 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-17f3c894-8674-4937-9ea0-5a8683ac4743 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:15.591502 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17f3c894-8674-4937-9ea0-5a8683ac4743 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:15.591978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17f3c894-8674-4937-9ea0-5a8683ac4743 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:15.592411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17f3c894-8674-4937-9ea0-5a8683ac4743 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:15.593082 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17f3c894-8674-4937-9ea0-5a8683ac4743 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:15.593531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17f3c894-8674-4937-9ea0-5a8683ac4743 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:15.593948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-17f3c894-8674-4937-9ea0-5a8683ac4743 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:15.676796 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-17f3c894-8674-4937-9ea0-5a8683ac4743 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096715 Sep 02 10:12:15.677532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1239/2404] 10.222.0.57 () {58 vars in 1275 bytes} [Fri Sep 2 10:12:15 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:12:15.743891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:15.744509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:15.750685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:15.751196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:15.751638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:15.752352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:15.752842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:15.753273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:15.885249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:15.893734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:15.895222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:15.896381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dee5585b-48ff-4681-b49f-c773e7232ac3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.156515 Sep 02 10:12:15.896956 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1166/2405] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:15 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:16.738238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-759083cf-5f3c-4cba-9ca2-d2c9a5fc296c req-9216007f-6cda-4b93-9a91-8c07c9b191bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96ede06e-7501-4396-9431-6a17dfaadc36", "tag": "cc0ea721-b328-4da5-a8a6-2d44ef12e861"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:12:16.747504 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-759083cf-5f3c-4cba-9ca2-d2c9a5fc296c req-9216007f-6cda-4b93-9a91-8c07c9b191bb service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:16.747985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-759083cf-5f3c-4cba-9ca2-d2c9a5fc296c req-9216007f-6cda-4b93-9a91-8c07c9b191bb service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:16.748414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-759083cf-5f3c-4cba-9ca2-d2c9a5fc296c req-9216007f-6cda-4b93-9a91-8c07c9b191bb service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:16.759558 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-759083cf-5f3c-4cba-9ca2-d2c9a5fc296c req-9216007f-6cda-4b93-9a91-8c07c9b191bb service nova] Creating event network-changed:cc0ea721-b328-4da5-a8a6-2d44ef12e861 for instance 96ede06e-7501-4396-9431-6a17dfaadc36 on hv-cinder-85083 Sep 02 10:12:16.764457 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-759083cf-5f3c-4cba-9ca2-d2c9a5fc296c req-9216007f-6cda-4b93-9a91-8c07c9b191bb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030729 Sep 02 10:12:16.765045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1240/2406] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:12:16.920092 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:16.920684 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:16.927220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:16.928104 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:16.928602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:16.929298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:16.929933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:16.930361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:17.060105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:17.068639 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:17.070116 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:17.071298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f7bc7477-bf18-4fc9-a298-a92119ab74f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.155784 Sep 02 10:12:17.071937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1167/2407] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:16 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:18.095109 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:18.095811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:18.101985 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:18.102476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:18.102954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:18.103643 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:18.104103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:18.104536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:18.231215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:18.240124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:18.241583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:18.242772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e28a0a60-0b51-4b1a-85f4-a598ed207d7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.152462 Sep 02 10:12:18.243332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1241/2408] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:18 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:19.266007 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:19.266767 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:19.273463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:19.275621 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:19.275621 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:19.275898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:19.276195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:19.276626 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:19.405618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:19.414199 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:19.415746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:19.416883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-86649856-8b2b-4f7d-b8b1-ad634a7541b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1807 microversion: 2.20 time: 0.154858 Sep 02 10:12:19.417429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1168/2409] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:19 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:12:20.439234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:12:20.439823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:12:20.446482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:20.447000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:20.447435 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:20.448127 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:12:20.448559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:12:20.448976 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:12:20.574941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:20.583461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:20.584899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:12:20.586052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8b1f91b6-034e-4b16-9801-57d0514a7a96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1794 microversion: 2.20 time: 0.150757 Sep 02 10:12:20.586612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1242/2410] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:12:20 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1794 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:13:16.083798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ffb53a94-fe5e-4f6f-941a-7d37a8d853e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:16.084396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ffb53a94-fe5e-4f6f-941a-7d37a8d853e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:16.086341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=19 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:16.087000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=33 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:16.092390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffb53a94-fe5e-4f6f-941a-7d37a8d853e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:16.092867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffb53a94-fe5e-4f6f-941a-7d37a8d853e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:16.093296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffb53a94-fe5e-4f6f-941a-7d37a8d853e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:16.093970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffb53a94-fe5e-4f6f-941a-7d37a8d853e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:16.094416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffb53a94-fe5e-4f6f-941a-7d37a8d853e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:16.094870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ffb53a94-fe5e-4f6f-941a-7d37a8d853e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:16.124049 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ffb53a94-fe5e-4f6f-941a-7d37a8d853e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments/7144779d-e1b0-4534-9364-24a0b1f7be3b" status: 200 len: 194 microversion: 2.20 time: 0.044351 Sep 02 10:13:16.124554 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1169/2411] 10.222.0.57 () {60 vars in 1454 bytes} [Fri Sep 2 10:13:16 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments/7144779d-e1b0-4534-9364-24a0b1f7be3b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 10:13:16.194144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4e507138-8e90-4aef-b558-a345c51ac631 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:16.194682 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4e507138-8e90-4aef-b558-a345c51ac631 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:16.196918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=21 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:16.197582 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=99 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:16.198456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:13:16.198593 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 10:13:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments/7144779d-e1b0-4534-9364-24a0b1f7be3b (ip 10.222.0.57) !!! Sep 02 10:13:16.206462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e507138-8e90-4aef-b558-a345c51ac631 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:16.206991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e507138-8e90-4aef-b558-a345c51ac631 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:16.207429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e507138-8e90-4aef-b558-a345c51ac631 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:16.208129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e507138-8e90-4aef-b558-a345c51ac631 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:16.208612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e507138-8e90-4aef-b558-a345c51ac631 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:16.209038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4e507138-8e90-4aef-b558-a345c51ac631 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:16.293357 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-4e507138-8e90-4aef-b558-a345c51ac631 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lazy-loading 'services' on Instance uuid 7800ab6f-02d9-4d8f-a038-32b2676ec781 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:13:16.455097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4e507138-8e90-4aef-b558-a345c51ac631 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments/7144779d-e1b0-4534-9364-24a0b1f7be3b" status: 202 len: 0 microversion: 2.20 time: 0.265243 Sep 02 10:13:16.455687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1243/2412] 10.222.0.57 () {60 vars in 1457 bytes} [Fri Sep 2 10:13:16 2022] DELETE /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments/7144779d-e1b0-4534-9364-24a0b1f7be3b => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 02 10:13:16.465217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5a10e5ff-0d1f-44ed-b9f1-59f022c7178a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:16.467583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5a10e5ff-0d1f-44ed-b9f1-59f022c7178a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:16.473734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a10e5ff-0d1f-44ed-b9f1-59f022c7178a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:16.474221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a10e5ff-0d1f-44ed-b9f1-59f022c7178a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:16.474657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a10e5ff-0d1f-44ed-b9f1-59f022c7178a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:16.475379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a10e5ff-0d1f-44ed-b9f1-59f022c7178a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:16.475828 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a10e5ff-0d1f-44ed-b9f1-59f022c7178a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:16.476255 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5a10e5ff-0d1f-44ed-b9f1-59f022c7178a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:16.506937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5a10e5ff-0d1f-44ed-b9f1-59f022c7178a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046690 Sep 02 10:13:16.507495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1170/2413] 10.222.0.57 () {60 vars in 1343 bytes} [Fri Sep 2 10:13:16 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 10:13:17.520881 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2da87d1d-9740-41d2-aa3a-71a198d73022 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:17.523201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2da87d1d-9740-41d2-aa3a-71a198d73022 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:17.529334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2da87d1d-9740-41d2-aa3a-71a198d73022 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:17.529823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2da87d1d-9740-41d2-aa3a-71a198d73022 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:17.530260 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2da87d1d-9740-41d2-aa3a-71a198d73022 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:17.530978 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2da87d1d-9740-41d2-aa3a-71a198d73022 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:17.531434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2da87d1d-9740-41d2-aa3a-71a198d73022 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:17.531861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2da87d1d-9740-41d2-aa3a-71a198d73022 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:17.561870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2da87d1d-9740-41d2-aa3a-71a198d73022 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045931 Sep 02 10:13:17.562417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1244/2414] 10.222.0.57 () {60 vars in 1343 bytes} [Fri Sep 2 10:13:17 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 10:13:18.574726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-249bf845-edc4-4cd0-a282-4e87e0f7bdd7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:18.576903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-249bf845-edc4-4cd0-a282-4e87e0f7bdd7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:18.583398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-249bf845-edc4-4cd0-a282-4e87e0f7bdd7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:18.583883 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-249bf845-edc4-4cd0-a282-4e87e0f7bdd7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:18.584318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-249bf845-edc4-4cd0-a282-4e87e0f7bdd7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:18.584995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-249bf845-edc4-4cd0-a282-4e87e0f7bdd7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:18.585444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-249bf845-edc4-4cd0-a282-4e87e0f7bdd7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:18.585867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-249bf845-edc4-4cd0-a282-4e87e0f7bdd7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:18.614632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-249bf845-edc4-4cd0-a282-4e87e0f7bdd7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044510 Sep 02 10:13:18.615208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1171/2415] 10.222.0.57 () {60 vars in 1343 bytes} [Fri Sep 2 10:13:18 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:18.674866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-43817e04-ca3a-495f-baaf-10dcc19d036c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:18.675379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-43817e04-ca3a-495f-baaf-10dcc19d036c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:18.681662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43817e04-ca3a-495f-baaf-10dcc19d036c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:18.682151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43817e04-ca3a-495f-baaf-10dcc19d036c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:18.682587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43817e04-ca3a-495f-baaf-10dcc19d036c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:18.683313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43817e04-ca3a-495f-baaf-10dcc19d036c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:18.683771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43817e04-ca3a-495f-baaf-10dcc19d036c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:18.684200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43817e04-ca3a-495f-baaf-10dcc19d036c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:18.708773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-43817e04-ca3a-495f-baaf-10dcc19d036c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Going to try to terminate instance {{(pid=127533) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:13:19.009327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-43817e04-ca3a-495f-baaf-10dcc19d036c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 204 len: 0 microversion: 2.20 time: 0.338025 Sep 02 10:13:19.009918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1245/2416] 10.222.0.57 () {60 vars in 1280 bytes} [Fri Sep 2 10:13:18 2022] DELETE /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 10:13:19.018902 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:19.019513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:19.025515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:19.026733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:19.026733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:19.027193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:19.027649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:19.028077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:19.157989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:19.165983 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:19.167470 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:19.169146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0624fc4a-7524-41c7-8d14-f1ba3f12418a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.154267 Sep 02 10:13:19.169696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1172/2417] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:19 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:20.193240 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:20.193930 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:20.200251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:20.201248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:20.201680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:20.202351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:20.202821 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:20.203245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:20.336013 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:20.343965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:20.345398 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:20.346680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-eac4fc10-0376-4106-ae13-e3375341ef17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.157590 Sep 02 10:13:20.347312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1246/2418] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:20 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:21.369411 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:21.370090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:21.376430 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:21.378134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:21.378134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:21.378134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:21.378538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:21.378990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:21.508171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:21.517009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:21.518449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:21.519631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-94f4f09d-9ac8-4eb8-9c29-6fd52f3d3aaa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1722 microversion: 2.20 time: 0.154110 Sep 02 10:13:21.520432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1173/2419] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:21 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:21.832828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-1036f0a1-7eda-43ea-80ac-50a967c9e35a req-8a56f8fb-28cb-46de-90c4-4e5c49256881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7800ab6f-02d9-4d8f-a038-32b2676ec781", "name": "network-vif-deleted", "tag": "37fe2545-9daa-4fdb-8240-493d506d5ff6"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:21.848432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-1036f0a1-7eda-43ea-80ac-50a967c9e35a req-8a56f8fb-28cb-46de-90c4-4e5c49256881 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:21.849001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-1036f0a1-7eda-43ea-80ac-50a967c9e35a req-8a56f8fb-28cb-46de-90c4-4e5c49256881 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:21.849543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-1036f0a1-7eda-43ea-80ac-50a967c9e35a req-8a56f8fb-28cb-46de-90c4-4e5c49256881 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:21.861667 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-1036f0a1-7eda-43ea-80ac-50a967c9e35a req-8a56f8fb-28cb-46de-90c4-4e5c49256881 service nova] Creating event network-vif-deleted:37fe2545-9daa-4fdb-8240-493d506d5ff6 for instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 on hv-cinder-85083 Sep 02 10:13:21.867084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-1036f0a1-7eda-43ea-80ac-50a967c9e35a req-8a56f8fb-28cb-46de-90c4-4e5c49256881 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038118 Sep 02 10:13:21.867958 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1247/2420] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:13:22.543764 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:22.547348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:22.551910 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:22.552512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:22.552971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:22.553739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:22.554213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:22.554629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:22.588289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:22.588776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:22.589207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:22.589650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lazy-loading 'fault' on Instance uuid 7800ab6f-02d9-4d8f-a038-32b2676ec781 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:13:22.635731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:22.645617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:22.647256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:22.648272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-217d25f2-640f-49d4-b613-b635e3021b70 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 200 len: 1372 microversion: 2.20 time: 0.108732 Sep 02 10:13:22.648848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1174/2421] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:22 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:23.671514 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:23.672204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:23.678699 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:23.679204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:23.679636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:23.680312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:23.680756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:23.681173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:23.693924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] HTTP exception thrown: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Request method failure captured: Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 HTTP/1.1 Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdZNVk9NxIsm7g0skexQeuyohDafBp8jBxMuzPFhySsQx7WMGbCrUwoMD1n_ihuM06-8E7zy1lfzUyN3ps4koUk28fIQICoIW2bSwKFk7gsgl6wt85iaHmzbln4wAEyWHROQpBX1awrJLhZusWPYdfJhT0BvLYqiTgkg4O9aKvwnPiQ Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:13:23.695549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_78a4f092ae254358b4e54190c2c4a1a1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: cf7d0cc498e94ba49f258c38a3c4c410 Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:13:23.697541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '7800ab6f-02d9-4d8f-a038-32b2676ec781'} Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:13:23.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:13:23.700484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:23.702687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Returning 404 to user: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:13:23.702687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-de5c185b-1b5a-494d-a15c-f0cb2f653e57 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 404 len: 111 microversion: 2.20 time: 0.029611 Sep 02 10:13:23.702687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1248/2422] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:23 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 10:13:23.706142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6636eee6-02f3-4fd4-93d4-093012abd10b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '.version_select at 0x7f4e5c341ee0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:23.793168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6636eee6-02f3-4fd4-93d4-093012abd10b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460988981" status: 204 len: 0 microversion: 2.20 time: 0.091199 Sep 02 10:13:23.793722 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1175/2423] 10.222.0.57 () {60 vars in 1262 bytes} [Fri Sep 2 10:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460988981 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 10:13:24.556549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ca95fa11-d8a5-4bde-9431-5c5084583f69 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Action: 'create', calling method: .version_select at 0x7f4e5c44e1f0>, body: {"keypair": {"name": "tempest-keypair-486978791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjjqBC1X85YuCDNJX4PydjdliRJbuAX0UpqoExeF6ipNA076+YS9P7TIxMMa0YgZ6RtbkvwBdewsV711D2zG8lYi+SPV6YxmtnTURUFA7W85/t5A+N8CByW7NionyM09Q=="}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:24.572188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-ca95fa11-d8a5-4bde-9431-5c5084583f69 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Getting quotas for project 78a4f092ae254358b4e54190c2c4a1a1. Resources: {'key_pairs'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:13:24.576024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-ca95fa11-d8a5-4bde-9431-5c5084583f69 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Getting quotas for user cf7d0cc498e94ba49f258c38a3c4c410 and project 78a4f092ae254358b4e54190c2c4a1a1. Resources: {'key_pairs'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:13:24.776156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ca95fa11-d8a5-4bde-9431-5c5084583f69 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.115390 Sep 02 10:13:24.776156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1249/2424] 10.222.0.57 () {62 vars in 1200 bytes} [Fri Sep 2 10:13:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 02 10:13:26.911977 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1782701016", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c1ab8b3-34a9-48f1-a2e8-4025f9f1071d"}], "security_groups": [{"name": "tempest-securitygroup--819515090"}], "key_name": "tempest-keypair-486978791", "user_data": "}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:27.013697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] validate_networks() for [('1c1ab8b3-34a9-48f1-a2e8-4025f9f1071d', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 10:13:27.388933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 10:13:27.389349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 10:13:27.389841 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 10:13:27.390241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 10:13:27.390644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 10:13:27.399412 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:27.399889 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:27.400312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:27.401022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:27.401461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:27.401872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:27.418024 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Getting quotas for project 78a4f092ae254358b4e54190c2c4a1a1. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:13:27.423446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Getting quotas for user cf7d0cc498e94ba49f258c38a3c4c410 and project 78a4f092ae254358b4e54190c2c4a1a1. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:13:27.434234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 10:13:27.436849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 10:13:27.593902 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-41bd9cf0-3f21-4d75-bd52-52287af17a58 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.686827 Sep 02 10:13:27.594568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1176/2425] 10.222.0.57 () {62 vars in 1188 bytes} [Fri Sep 2 10:13:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 10:13:27.606014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0ea57269-85de-4a04-940b-85d882fc6d0e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:27.606627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0ea57269-85de-4a04-940b-85d882fc6d0e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:27.672898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0ea57269-85de-4a04-940b-85d882fc6d0e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:27.680336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0ea57269-85de-4a04-940b-85d882fc6d0e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:27.681794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0ea57269-85de-4a04-940b-85d882fc6d0e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:27.682925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0ea57269-85de-4a04-940b-85d882fc6d0e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1281 microversion: 2.20 time: 0.081463 Sep 02 10:13:27.683518 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1250/2426] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:27 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:28.706238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:28.706886 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:28.713576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:28.714057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:28.714494 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:28.715207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:28.715691 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:28.716119 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:28.776858 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:28.785287 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:28.786763 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:28.787918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-db56d3ce-0e14-4b51-b919-0caf29c862e7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1285 microversion: 2.20 time: 0.086172 Sep 02 10:13:28.788471 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1177/2427] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:28 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:29.810932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:29.811542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:29.818805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:29.819287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:29.819725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:29.820414 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:29.820865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:29.821285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:29.897389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:29.905485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:29.907497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:29.908607 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-749e79b4-1e9f-490d-aff8-f124b0904f60 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1351 microversion: 2.20 time: 0.101631 Sep 02 10:13:29.909190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1251/2428] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:29 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:30.932224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:30.932834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:30.939852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:30.940333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:30.940769 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:30.941473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:30.941920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:30.942340 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:31.071458 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:31.079485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:31.080941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:31.082069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0feb88b8-0bfa-441c-8106-83098f4d0985 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1406 microversion: 2.20 time: 0.153790 Sep 02 10:13:31.082629 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1178/2429] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:30 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:31.288123 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-41b5fd15-b71b-4f77-af84-b3980d85a821 req-064da0b4-c34f-4bc9-948d-85a7f08a4f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1922d53-bdcd-4824-aca7-31b78f883be0", "tag": "0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:31.298622 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-41b5fd15-b71b-4f77-af84-b3980d85a821 req-064da0b4-c34f-4bc9-948d-85a7f08a4f11 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:31.299120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-41b5fd15-b71b-4f77-af84-b3980d85a821 req-064da0b4-c34f-4bc9-948d-85a7f08a4f11 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:31.299554 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-41b5fd15-b71b-4f77-af84-b3980d85a821 req-064da0b4-c34f-4bc9-948d-85a7f08a4f11 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:31.310830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-41b5fd15-b71b-4f77-af84-b3980d85a821 req-064da0b4-c34f-4bc9-948d-85a7f08a4f11 service nova] Creating event network-changed:0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569 for instance a1922d53-bdcd-4824-aca7-31b78f883be0 on hv-cinder-85083 Sep 02 10:13:31.316397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-41b5fd15-b71b-4f77-af84-b3980d85a821 req-064da0b4-c34f-4bc9-948d-85a7f08a4f11 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031940 Sep 02 10:13:31.317145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1252/2430] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:13:31.825218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ced1809d-21bc-4acc-8df5-8b34a3763e05 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:31.825624 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ced1809d-21bc-4acc-8df5-8b34a3763e05 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:31.832191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ced1809d-21bc-4acc-8df5-8b34a3763e05 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:31.832651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ced1809d-21bc-4acc-8df5-8b34a3763e05 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:31.833077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ced1809d-21bc-4acc-8df5-8b34a3763e05 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:31.833751 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ced1809d-21bc-4acc-8df5-8b34a3763e05 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:31.834193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ced1809d-21bc-4acc-8df5-8b34a3763e05 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:31.834611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ced1809d-21bc-4acc-8df5-8b34a3763e05 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:31.858671 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ced1809d-21bc-4acc-8df5-8b34a3763e05 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36/ips" status: 200 len: 148 microversion: 2.1 time: 0.037300 Sep 02 10:13:31.859373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1179/2431] 10.222.0.57 () {58 vars in 1248 bytes} [Fri Sep 2 10:13:31 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:13:31.871202 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf7796d5-95c6-4540-8057-5758f161e5ff"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:31.873611 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:31.879866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:31.880355 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:31.880791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:31.881481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:31.881931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:31.882351 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:31.961869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Invalid volume: volume bf7796d5-95c6-4540-8057-5758f161e5ff is already attached to instances: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: POST /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36/os-volume_attachments HTTP/1.1 Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 74 Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:13:31.963852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {"volumeAttachment": {"volumeId": "bf7796d5-95c6-4540-8057-5758f161e5ff"}} Sep 02 10:13:31.964874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid volume: volume bf7796d5-95c6-4540-8057-5758f161e5ff is already attached to instances: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'server_id': '96ede06e-7501-4396-9431-6a17dfaadc36', 'body': {'volumeAttachment': {'volumeId': 'bf7796d5-95c6-4540-8057-5758f161e5ff'}}} Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bf7796d5-95c6-4540-8057-5758f161e5ff is already attached to instances: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:31.965472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bf7796d5-95c6-4540-8057-5758f161e5ff is already attached to instances: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:31.966404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:13:31.967538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:13:31.967538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:13:31.967538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:13:31.967538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bf7796d5-95c6-4540-8057-5758f161e5ff is already attached to instances: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 Sep 02 10:13:31.967538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:31.967538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 400 to user: Invalid volume: volume bf7796d5-95c6-4540-8057-5758f161e5ff is already attached to instances: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:13:31.967538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5da0d637-f5e3-4773-b20a-7f0ddcc27fc9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098508 Sep 02 10:13:31.967538 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1253/2432] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 10:13:31 2022] POST /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 10:13:31.975256 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-78841454-13e9-44d1-be2f-3e1e5e50c55d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:31.975755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-78841454-13e9-44d1-be2f-3e1e5e50c55d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:31.981911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78841454-13e9-44d1-be2f-3e1e5e50c55d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:31.984666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78841454-13e9-44d1-be2f-3e1e5e50c55d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:31.984666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78841454-13e9-44d1-be2f-3e1e5e50c55d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:31.984666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78841454-13e9-44d1-be2f-3e1e5e50c55d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:31.984666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78841454-13e9-44d1-be2f-3e1e5e50c55d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:31.984936 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-78841454-13e9-44d1-be2f-3e1e5e50c55d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:32.011152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-78841454-13e9-44d1-be2f-3e1e5e50c55d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:13:32.104657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:32.105270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:32.111528 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:32.112041 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:32.112480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:32.113167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:32.113619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:32.114047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:32.306468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-78841454-13e9-44d1-be2f-3e1e5e50c55d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 204 len: 0 microversion: 2.1 time: 0.334911 Sep 02 10:13:32.307175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1180/2433] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:13:31 2022] DELETE /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:13:32.316016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-775b8382-57ac-41ea-804c-ed6e2918f23a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:32.316709 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-775b8382-57ac-41ea-804c-ed6e2918f23a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:32.322636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-775b8382-57ac-41ea-804c-ed6e2918f23a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:32.323152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-775b8382-57ac-41ea-804c-ed6e2918f23a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:32.323596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-775b8382-57ac-41ea-804c-ed6e2918f23a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:32.324284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-775b8382-57ac-41ea-804c-ed6e2918f23a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:32.324760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-775b8382-57ac-41ea-804c-ed6e2918f23a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:32.325184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-775b8382-57ac-41ea-804c-ed6e2918f23a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:32.341417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:32.350773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:32.352241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:32.353352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-08e13bff-57df-4c1c-9b10-26f13c6f83b2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1406 microversion: 2.20 time: 0.252791 Sep 02 10:13:32.353916 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1254/2434] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:32 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:13:32.464294 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-775b8382-57ac-41ea-804c-ed6e2918f23a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:32.472120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-775b8382-57ac-41ea-804c-ed6e2918f23a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1680 microversion: 2.1 time: 0.160605 Sep 02 10:13:32.472701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1181/2435] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:32 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:13:33.376043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:33.376659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:33.383108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:33.383594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:33.384034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:33.384722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:33.385180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:33.385608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:33.493245 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9505033e-edc6-4394-8b04-6f97791ad88a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:33.493856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9505033e-edc6-4394-8b04-6f97791ad88a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:33.500364 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9505033e-edc6-4394-8b04-6f97791ad88a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:33.500851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9505033e-edc6-4394-8b04-6f97791ad88a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:33.501286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9505033e-edc6-4394-8b04-6f97791ad88a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:33.501969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9505033e-edc6-4394-8b04-6f97791ad88a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:33.502415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9505033e-edc6-4394-8b04-6f97791ad88a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:33.502873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9505033e-edc6-4394-8b04-6f97791ad88a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:33.514955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:33.525108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:33.526947 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:33.528024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-42c2dca8-a1c2-437e-8ba1-24ed1e39e8dc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1406 microversion: 2.20 time: 0.155908 Sep 02 10:13:33.535450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1255/2436] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:33 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:13:33.632849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9505033e-edc6-4394-8b04-6f97791ad88a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:33.642213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9505033e-edc6-4394-8b04-6f97791ad88a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1680 microversion: 2.1 time: 0.152751 Sep 02 10:13:33.642792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1182/2437] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:33 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:13:34.551625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:34.552137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:34.558536 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:34.559098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:34.559531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:34.560206 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:34.560653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:34.561073 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:34.664203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-34bcec9f-7d71-46f7-9ed7-070faacfd283 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:34.664902 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-34bcec9f-7d71-46f7-9ed7-070faacfd283 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:34.671380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34bcec9f-7d71-46f7-9ed7-070faacfd283 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:34.672400 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34bcec9f-7d71-46f7-9ed7-070faacfd283 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:34.672826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34bcec9f-7d71-46f7-9ed7-070faacfd283 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:34.673509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34bcec9f-7d71-46f7-9ed7-070faacfd283 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:34.673957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34bcec9f-7d71-46f7-9ed7-070faacfd283 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:34.674373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-34bcec9f-7d71-46f7-9ed7-070faacfd283 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:34.691482 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:34.700265 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:34.701721 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:34.702853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9c8da417-ec65-4cea-a082-91f3445a02ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1406 microversion: 2.20 time: 0.155217 Sep 02 10:13:34.703450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1256/2438] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:34 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:34.805209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-34bcec9f-7d71-46f7-9ed7-070faacfd283 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:34.812816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-34bcec9f-7d71-46f7-9ed7-070faacfd283 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1680 microversion: 2.1 time: 0.152476 Sep 02 10:13:34.813370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1183/2439] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:34 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:13:35.725155 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:35.725759 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:35.732445 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:35.732924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:35.733353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:35.734033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:35.734477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:35.735499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:35.834042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1e6f0012-babc-4269-bcd9-607588effd64 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:35.834657 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1e6f0012-babc-4269-bcd9-607588effd64 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:35.841323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e6f0012-babc-4269-bcd9-607588effd64 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:35.841813 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e6f0012-babc-4269-bcd9-607588effd64 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:35.842250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e6f0012-babc-4269-bcd9-607588effd64 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:35.842980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e6f0012-babc-4269-bcd9-607588effd64 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:35.843438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e6f0012-babc-4269-bcd9-607588effd64 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:35.843866 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1e6f0012-babc-4269-bcd9-607588effd64 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:35.866290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:35.874786 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:35.876751 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:35.877863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-27a34544-83fd-4a42-a0e6-15437e0d4bbf tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1406 microversion: 2.20 time: 0.156601 Sep 02 10:13:35.878418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1257/2440] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:35 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:35.974852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1e6f0012-babc-4269-bcd9-607588effd64 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:35.982744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1e6f0012-babc-4269-bcd9-607588effd64 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1680 microversion: 2.1 time: 0.152634 Sep 02 10:13:35.985369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1184/2441] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:35 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:13:36.863106 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-8ecacb20-7602-4ec8-9759-8c1d2555f465 req-1648091b-1859-4515-87a1-94f996648b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96ede06e-7501-4396-9431-6a17dfaadc36", "name": "network-vif-deleted", "tag": "cc0ea721-b328-4da5-a8a6-2d44ef12e861"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:36.873497 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-8ecacb20-7602-4ec8-9759-8c1d2555f465 req-1648091b-1859-4515-87a1-94f996648b8a service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:36.873980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-8ecacb20-7602-4ec8-9759-8c1d2555f465 req-1648091b-1859-4515-87a1-94f996648b8a service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:36.874411 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-8ecacb20-7602-4ec8-9759-8c1d2555f465 req-1648091b-1859-4515-87a1-94f996648b8a service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:36.886108 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-8ecacb20-7602-4ec8-9759-8c1d2555f465 req-1648091b-1859-4515-87a1-94f996648b8a service nova] Creating event network-vif-deleted:cc0ea721-b328-4da5-a8a6-2d44ef12e861 for instance 96ede06e-7501-4396-9431-6a17dfaadc36 on hv-cinder-85083 Sep 02 10:13:36.891336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-8ecacb20-7602-4ec8-9759-8c1d2555f465 req-1648091b-1859-4515-87a1-94f996648b8a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032582 Sep 02 10:13:36.891925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1258/2442] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:13:36.901424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:36.902051 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:36.909445 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:36.909933 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:36.910362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:36.911077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:36.911527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:36.911951 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:36.940794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:37.005158 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b039b7cf-8a6f-4ca2-8202-a5efb0a70212 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:37.005897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b039b7cf-8a6f-4ca2-8202-a5efb0a70212 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:37.018768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b039b7cf-8a6f-4ca2-8202-a5efb0a70212 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:37.019559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b039b7cf-8a6f-4ca2-8202-a5efb0a70212 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:37.020232 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b039b7cf-8a6f-4ca2-8202-a5efb0a70212 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:37.021153 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b039b7cf-8a6f-4ca2-8202-a5efb0a70212 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:37.021817 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b039b7cf-8a6f-4ca2-8202-a5efb0a70212 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:37.022451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b039b7cf-8a6f-4ca2-8202-a5efb0a70212 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:37.095638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:37.104292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:37.105820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:37.107313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b8d85673-634e-4326-9a48-0a02f26eacd9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1406 microversion: 2.20 time: 0.210124 Sep 02 10:13:37.113191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1185/2443] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:36 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:37.125777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b039b7cf-8a6f-4ca2-8202-a5efb0a70212 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:37.134264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b039b7cf-8a6f-4ca2-8202-a5efb0a70212 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 200 len: 1326 microversion: 2.1 time: 0.134028 Sep 02 10:13:37.135450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1259/2444] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:36 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 1326 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:38.130540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:38.131175 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:38.133082 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:38.133779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:38.139478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:38.139959 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:38.140391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:38.141102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:38.141547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:38.141966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:38.158292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:38.159644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:38.169308 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=6 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:38.171190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:38.171830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:38.173481 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:38.174006 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:38.174610 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:38.175208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:38.189515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 HTTP/1.1 Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:13:38.191432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:13:38.192709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '96ede06e-7501-4396-9431-6a17dfaadc36'} Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:13:38.193256 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:13:38.194150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:13:38.195689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:13:38.196673 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-46560f4d-fe30-4ec6-92cf-48ab7c140954 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 404 len: 111 microversion: 2.1 time: 0.044631 Sep 02 10:13:38.197385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1260/2445] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:38 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 10:13:38.205972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4e38e1d4-1403-4a61-ad8b-3228f7f3c58e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '.version_select at 0x7f4e5fbf7820>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:38.274169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4e38e1d4-1403-4a61-ad8b-3228f7f3c58e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-490901793" status: 202 len: 0 microversion: 2.1 time: 0.072007 Sep 02 10:13:38.276649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1261/2446] 10.222.0.57 () {58 vars in 1218 bytes} [Fri Sep 2 10:13:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-490901793 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:13:38.292468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:38.301892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:38.303429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:38.304533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-70ab54fe-101a-4977-bc8a-eaa9f187726b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1406 microversion: 2.20 time: 0.179025 Sep 02 10:13:38.305089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1186/2447] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:38 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:13:39.091272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-63db2cd3-f744-44b7-b325-692c37c92199 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:39.091770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-63db2cd3-f744-44b7-b325-692c37c92199 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:39.098023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63db2cd3-f744-44b7-b325-692c37c92199 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:39.098505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63db2cd3-f744-44b7-b325-692c37c92199 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:39.099050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63db2cd3-f744-44b7-b325-692c37c92199 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:39.099732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63db2cd3-f744-44b7-b325-692c37c92199 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:39.100187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63db2cd3-f744-44b7-b325-692c37c92199 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:39.100614 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63db2cd3-f744-44b7-b325-692c37c92199 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:39.184873 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-63db2cd3-f744-44b7-b325-692c37c92199 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lazy-loading 'services' on Instance uuid 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:13:39.327906 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:39.328516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:39.335227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:39.335875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:39.336142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:39.336836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:39.337290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:39.337716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:39.339847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:39.414224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-63db2cd3-f744-44b7-b325-692c37c92199 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-volume_attachments/bf7796d5-95c6-4540-8057-5758f161e5ff" status: 202 len: 0 microversion: 2.1 time: 0.326677 Sep 02 10:13:39.418093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1262/2448] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 10:13:39 2022] DELETE /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-volume_attachments/bf7796d5-95c6-4540-8057-5758f161e5ff => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:13:39.432649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8db2084e-430a-4700-a187-fe848bf0f3ca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:39.435089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8db2084e-430a-4700-a187-fe848bf0f3ca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:39.443213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8db2084e-430a-4700-a187-fe848bf0f3ca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:39.443697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8db2084e-430a-4700-a187-fe848bf0f3ca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:39.444346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8db2084e-430a-4700-a187-fe848bf0f3ca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:39.445193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8db2084e-430a-4700-a187-fe848bf0f3ca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:39.445645 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8db2084e-430a-4700-a187-fe848bf0f3ca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:39.446066 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8db2084e-430a-4700-a187-fe848bf0f3ca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:39.477516 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8db2084e-430a-4700-a187-fe848bf0f3ca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058085 Sep 02 10:13:39.478257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1263/2449] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:13:39 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:13:39.482696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:39.489631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:39.491211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:39.494157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-51213bd8-b056-4533-965d-7da9c95ddcca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1406 microversion: 2.20 time: 0.169169 Sep 02 10:13:39.509892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1187/2450] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:39 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:13:39.542208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-83188f57-b269-4b4a-8f30-838c7337d9e3 req-12118541-f1df-42fb-b142-9a705ad1ca3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1922d53-bdcd-4824-aca7-31b78f883be0", "name": "network-vif-plugged", "status": "completed", "tag": "0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:39.550940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-83188f57-b269-4b4a-8f30-838c7337d9e3 req-12118541-f1df-42fb-b142-9a705ad1ca3a service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:39.551455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-83188f57-b269-4b4a-8f30-838c7337d9e3 req-12118541-f1df-42fb-b142-9a705ad1ca3a service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:39.551893 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-83188f57-b269-4b4a-8f30-838c7337d9e3 req-12118541-f1df-42fb-b142-9a705ad1ca3a service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:39.566255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-83188f57-b269-4b4a-8f30-838c7337d9e3 req-12118541-f1df-42fb-b142-9a705ad1ca3a service nova] Creating event network-vif-plugged:0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569 for instance a1922d53-bdcd-4824-aca7-31b78f883be0 on hv-cinder-85083 Sep 02 10:13:39.571176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-83188f57-b269-4b4a-8f30-838c7337d9e3 req-12118541-f1df-42fb-b142-9a705ad1ca3a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034587 Sep 02 10:13:39.571835 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1264/2451] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:13:40.489543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f3811129-aff1-420b-831c-185eb26b10f5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:40.491824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f3811129-aff1-420b-831c-185eb26b10f5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:40.498185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3811129-aff1-420b-831c-185eb26b10f5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:40.498660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3811129-aff1-420b-831c-185eb26b10f5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:40.499126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3811129-aff1-420b-831c-185eb26b10f5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:40.499802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3811129-aff1-420b-831c-185eb26b10f5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:40.500746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3811129-aff1-420b-831c-185eb26b10f5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:40.501164 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f3811129-aff1-420b-831c-185eb26b10f5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:40.519344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:40.519969 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:40.526184 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:40.526663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:40.527140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:40.527816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:40.528263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:40.528685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:40.530688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f3811129-aff1-420b-831c-185eb26b10f5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045124 Sep 02 10:13:40.532515 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1188/2452] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:13:40 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:13:40.655654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:40.663590 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:40.665043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:40.666134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-28e34b20-ee10-470d-a21f-e5092aa22e8b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1406 microversion: 2.20 time: 0.152641 Sep 02 10:13:40.666691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1265/2453] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:40 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:13:41.543253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-53d5e616-e889-4fcc-ad41-432d57048770 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:41.545284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-53d5e616-e889-4fcc-ad41-432d57048770 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:41.552029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53d5e616-e889-4fcc-ad41-432d57048770 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:41.552509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53d5e616-e889-4fcc-ad41-432d57048770 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:41.552942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53d5e616-e889-4fcc-ad41-432d57048770 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:41.553625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53d5e616-e889-4fcc-ad41-432d57048770 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:41.554070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53d5e616-e889-4fcc-ad41-432d57048770 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:41.554488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-53d5e616-e889-4fcc-ad41-432d57048770 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:41.582991 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-53d5e616-e889-4fcc-ad41-432d57048770 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043773 Sep 02 10:13:41.583543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1189/2454] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:13:41 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 10:13:41.642917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b69ee8b2-4e6e-4efc-9160-dc773f360556 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:41.643417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b69ee8b2-4e6e-4efc-9160-dc773f360556 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:41.649886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b69ee8b2-4e6e-4efc-9160-dc773f360556 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:41.650370 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b69ee8b2-4e6e-4efc-9160-dc773f360556 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:41.650841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b69ee8b2-4e6e-4efc-9160-dc773f360556 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:41.651539 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b69ee8b2-4e6e-4efc-9160-dc773f360556 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:41.651995 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b69ee8b2-4e6e-4efc-9160-dc773f360556 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:41.652419 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b69ee8b2-4e6e-4efc-9160-dc773f360556 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:41.677295 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b69ee8b2-4e6e-4efc-9160-dc773f360556 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Going to try to terminate instance {{(pid=127533) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:13:41.688291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:41.688894 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:41.694774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:41.695250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:41.695681 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:41.696349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:41.696795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:41.697212 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:41.824507 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:41.833036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:41.834490 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:41.835625 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6bb02e41-b57f-4206-a15b-b249f35b4468 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1406 microversion: 2.20 time: 0.151190 Sep 02 10:13:41.836183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1190/2455] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:41 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:13:41.957865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b69ee8b2-4e6e-4efc-9160-dc773f360556 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 204 len: 0 microversion: 2.1 time: 0.318992 Sep 02 10:13:41.958458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1266/2456] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:13:41 2022] DELETE /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 10:13:41.966659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-470352ed-ea9c-4f76-bf80-bb10a29ca465 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:41.967302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-470352ed-ea9c-4f76-bf80-bb10a29ca465 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:41.973258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-470352ed-ea9c-4f76-bf80-bb10a29ca465 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:41.973733 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-470352ed-ea9c-4f76-bf80-bb10a29ca465 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:41.974167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-470352ed-ea9c-4f76-bf80-bb10a29ca465 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:41.974891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-470352ed-ea9c-4f76-bf80-bb10a29ca465 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:41.975345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-470352ed-ea9c-4f76-bf80-bb10a29ca465 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:41.975766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-470352ed-ea9c-4f76-bf80-bb10a29ca465 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:42.104937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-470352ed-ea9c-4f76-bf80-bb10a29ca465 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:42.112870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-470352ed-ea9c-4f76-bf80-bb10a29ca465 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1680 microversion: 2.1 time: 0.150046 Sep 02 10:13:42.113424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1191/2457] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:41 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:13:42.863968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:42.864672 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:42.871211 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:42.871704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:42.872151 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:42.872847 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:42.873309 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:42.873749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:43.004026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:43.012103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:43.013560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:43.014732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-db7f488c-2bc1-4edd-bad6-f297a2d38646 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1597 microversion: 2.20 time: 0.155710 Sep 02 10:13:43.015308 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1267/2458] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:13:42 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1597 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:13:43.037805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-67d93913-1dec-42e1-bf9d-bf695c586844 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:43.042622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-67d93913-1dec-42e1-bf9d-bf695c586844 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:43.044926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67d93913-1dec-42e1-bf9d-bf695c586844 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:43.045398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67d93913-1dec-42e1-bf9d-bf695c586844 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:43.045833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67d93913-1dec-42e1-bf9d-bf695c586844 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:43.046627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67d93913-1dec-42e1-bf9d-bf695c586844 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:43.047107 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67d93913-1dec-42e1-bf9d-bf695c586844 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:43.047529 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-67d93913-1dec-42e1-bf9d-bf695c586844 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:43.128564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-67d93913-1dec-42e1-bf9d-bf695c586844 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091101 Sep 02 10:13:43.128564 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1192/2459] 10.222.0.57 () {60 vars in 1316 bytes} [Fri Sep 2 10:13:43 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 10:13:43.133664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6ffea70d-6816-4ca8-951b-2b8e30aa5a6c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:43.134273 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6ffea70d-6816-4ca8-951b-2b8e30aa5a6c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:43.141599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ffea70d-6816-4ca8-951b-2b8e30aa5a6c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:43.141599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ffea70d-6816-4ca8-951b-2b8e30aa5a6c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:43.141911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ffea70d-6816-4ca8-951b-2b8e30aa5a6c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:43.142594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ffea70d-6816-4ca8-951b-2b8e30aa5a6c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:43.143064 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ffea70d-6816-4ca8-951b-2b8e30aa5a6c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:43.143486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6ffea70d-6816-4ca8-951b-2b8e30aa5a6c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:43.271267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6ffea70d-6816-4ca8-951b-2b8e30aa5a6c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:43.278902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6ffea70d-6816-4ca8-951b-2b8e30aa5a6c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1680 microversion: 2.1 time: 0.149112 Sep 02 10:13:43.279462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1268/2460] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:43 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:44.068559 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-19c0b4e6-b8bd-48f6-95bb-94a6dd53661c req-d492b2ef-f1df-400d-a814-c261452564a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1922d53-bdcd-4824-aca7-31b78f883be0", "tag": "0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:44.078103 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-19c0b4e6-b8bd-48f6-95bb-94a6dd53661c req-d492b2ef-f1df-400d-a814-c261452564a8 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:44.078584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-19c0b4e6-b8bd-48f6-95bb-94a6dd53661c req-d492b2ef-f1df-400d-a814-c261452564a8 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:44.079042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-19c0b4e6-b8bd-48f6-95bb-94a6dd53661c req-d492b2ef-f1df-400d-a814-c261452564a8 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:44.089856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-19c0b4e6-b8bd-48f6-95bb-94a6dd53661c req-d492b2ef-f1df-400d-a814-c261452564a8 service nova] Creating event network-changed:0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569 for instance a1922d53-bdcd-4824-aca7-31b78f883be0 on hv-cinder-85083 Sep 02 10:13:44.095949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-19c0b4e6-b8bd-48f6-95bb-94a6dd53661c req-d492b2ef-f1df-400d-a814-c261452564a8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031520 Sep 02 10:13:44.096485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1193/2461] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:13:44.300838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b26af832-0643-4d48-94de-396c21d6ae0a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:44.302186 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b26af832-0643-4d48-94de-396c21d6ae0a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:44.309638 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b26af832-0643-4d48-94de-396c21d6ae0a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:44.310431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b26af832-0643-4d48-94de-396c21d6ae0a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:44.311389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b26af832-0643-4d48-94de-396c21d6ae0a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:44.312294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b26af832-0643-4d48-94de-396c21d6ae0a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:44.312915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b26af832-0643-4d48-94de-396c21d6ae0a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:44.313515 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b26af832-0643-4d48-94de-396c21d6ae0a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:44.529201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b26af832-0643-4d48-94de-396c21d6ae0a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:44.541629 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b26af832-0643-4d48-94de-396c21d6ae0a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1680 microversion: 2.1 time: 0.244987 Sep 02 10:13:44.543816 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1269/2462] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:44 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1680 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:45.565463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:45.566192 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:45.573345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:45.573766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:45.574215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:45.574939 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:45.575397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:45.575818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:45.610776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:45.611279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:45.611716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:45.612651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lazy-loading 'fault' on Instance uuid 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:13:45.655787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:45.664207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ef3142cc-caea-49f6-b59b-2d6d22e16c5e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 200 len: 1331 microversion: 2.1 time: 0.104200 Sep 02 10:13:45.676945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1194/2463] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:45 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:46.110776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-925a4d5c-bd11-4422-9391-cd724203ed9a req-a0c03295-d179-4f08-a719-884ac9c64884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1fc967-36d9-4d43-856d-9a9fdc5d9927", "name": "network-vif-deleted", "tag": "b9bad87a-862e-4252-9a66-f647196d1c4d"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:46.120905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-925a4d5c-bd11-4422-9391-cd724203ed9a req-a0c03295-d179-4f08-a719-884ac9c64884 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:46.121608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-925a4d5c-bd11-4422-9391-cd724203ed9a req-a0c03295-d179-4f08-a719-884ac9c64884 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:46.122042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-925a4d5c-bd11-4422-9391-cd724203ed9a req-a0c03295-d179-4f08-a719-884ac9c64884 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:46.133513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-925a4d5c-bd11-4422-9391-cd724203ed9a req-a0c03295-d179-4f08-a719-884ac9c64884 service nova] Creating event network-vif-deleted:b9bad87a-862e-4252-9a66-f647196d1c4d for instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 on hv-cinder-85083 Sep 02 10:13:46.139749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-925a4d5c-bd11-4422-9391-cd724203ed9a req-a0c03295-d179-4f08-a719-884ac9c64884 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033116 Sep 02 10:13:46.141046 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1270/2464] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:13:46.685392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:46.685998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:46.688914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:46.693599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:46.694034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:46.694460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:46.701603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:46.701603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:46.701603 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:46.711219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 HTTP/1.1 Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:13:46.712842 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:13:46.713891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '3e1fc967-36d9-4d43-856d-9a9fdc5d9927'} Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:13:46.714479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:13:46.715540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:13:46.716596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:13:46.716596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-137e61b1-0dd3-4737-80db-73c893c0ade2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 404 len: 111 microversion: 2.1 time: 0.032704 Sep 02 10:13:46.716596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1195/2465] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:46 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 10:13:46.723477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cc9b0dae-6397-4959-ae8a-18d58f7dc69d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '.version_select at 0x7f4e5fc4dd30>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:46.730597 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:13:46.809746 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cc9b0dae-6397-4959-ae8a-18d58f7dc69d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-400009572" status: 202 len: 0 microversion: 2.1 time: 0.090406 Sep 02 10:13:46.810302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1271/2466] 10.222.0.57 () {58 vars in 1218 bytes} [Fri Sep 2 10:13:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-400009572 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:13:47.825390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-de2791dd-6439-4457-96fe-38e10e701528 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: .version_select at 0x7f4e5fb889d0>, body: {"keypair": {"name": "tempest-keypair-1440783762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9TeOZ1yp/9erNdyyVkhULcNZCfv8z96LbEUSogG7g4EtazI/LkjYyEegBqHnsnLay1TfQUSjtk1a/pNYSs1J66H/NpdVTe7RXJZYTvkZ7LJPmvLCeU5yWgDHbDqQqp0A=="}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:47.842144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-de2791dd-6439-4457-96fe-38e10e701528 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:13:47.846947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-de2791dd-6439-4457-96fe-38e10e701528 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for user 65963d36fc4741c69534b3dde1e00857 and project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'key_pairs'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:13:47.970736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-de2791dd-6439-4457-96fe-38e10e701528 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149096 Sep 02 10:13:47.971385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1196/2467] 10.222.0.57 () {60 vars in 1159 bytes} [Fri Sep 2 10:13:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:13:50.116845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-319009979", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f26589e0-f0d0-4abe-9ad1-1113f17930dd"}], "security_groups": [{"name": "tempest-securitygroup--1629307671"}], "key_name": "tempest-keypair-1440783762", "user_data": "}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:50.219097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.network.neutron [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] validate_networks() for [('f26589e0-f0d0-4abe-9ad1-1113f17930dd', None, None, None, None, None)] {{(pid=127533) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 10:13:50.583480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Flavor limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 10:13:50.583904 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Image limits 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 10:13:50.584379 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Flavor pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 10:13:50.584782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Image pref 0:0:0 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 10:13:50.585188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.virt.hardware [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127533) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 10:13:50.593754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:50.594228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:50.594659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:50.595397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:50.595946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:50.596413 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:50.613312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:13:50.617156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for user 65963d36fc4741c69534b3dde1e00857 and project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'cores', 'instances', 'ram'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:13:50.628369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Going to run 1 instances... {{(pid=127533) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 10:13:50.630697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127533) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 10:13:50.770848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1b0bbe7a-609a-4454-a5ac-cf6d96c5e47c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.659201 Sep 02 10:13:50.771483 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1272/2468] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 10:13:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 10:13:50.782729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0a04aba5-e7af-4ae9-b274-2f248f16afd7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:50.783350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0a04aba5-e7af-4ae9-b274-2f248f16afd7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:50.839592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0a04aba5-e7af-4ae9-b274-2f248f16afd7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:50.848098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0a04aba5-e7af-4ae9-b274-2f248f16afd7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1241 microversion: 2.1 time: 0.069734 Sep 02 10:13:50.848741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1197/2469] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:50 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:51.869666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-815448e4-5791-4ffc-92ba-53ab32b823c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:51.870418 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-815448e4-5791-4ffc-92ba-53ab32b823c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:51.878856 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-815448e4-5791-4ffc-92ba-53ab32b823c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:51.879339 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-815448e4-5791-4ffc-92ba-53ab32b823c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:51.879772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-815448e4-5791-4ffc-92ba-53ab32b823c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:51.880510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-815448e4-5791-4ffc-92ba-53ab32b823c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:51.880955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-815448e4-5791-4ffc-92ba-53ab32b823c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:51.881372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-815448e4-5791-4ffc-92ba-53ab32b823c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:51.943882 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-815448e4-5791-4ffc-92ba-53ab32b823c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:51.952174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-815448e4-5791-4ffc-92ba-53ab32b823c7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1245 microversion: 2.1 time: 0.085865 Sep 02 10:13:51.952174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1273/2470] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:51 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:52.973550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-254f82f0-0068-4b1e-8f58-f64b6a631d69 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:52.974158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-254f82f0-0068-4b1e-8f58-f64b6a631d69 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:52.980833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-254f82f0-0068-4b1e-8f58-f64b6a631d69 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:52.981563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-254f82f0-0068-4b1e-8f58-f64b6a631d69 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:52.981987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-254f82f0-0068-4b1e-8f58-f64b6a631d69 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:52.982898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-254f82f0-0068-4b1e-8f58-f64b6a631d69 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:52.983353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-254f82f0-0068-4b1e-8f58-f64b6a631d69 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:52.983782 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-254f82f0-0068-4b1e-8f58-f64b6a631d69 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:53.062403 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-254f82f0-0068-4b1e-8f58-f64b6a631d69 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:53.070513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-254f82f0-0068-4b1e-8f58-f64b6a631d69 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1311 microversion: 2.1 time: 0.101449 Sep 02 10:13:53.071106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1198/2471] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:52 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:54.096574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-35127543-ad77-4a86-acfe-cfa5b0380e46 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:54.097188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-35127543-ad77-4a86-acfe-cfa5b0380e46 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:54.103754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35127543-ad77-4a86-acfe-cfa5b0380e46 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:54.104271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35127543-ad77-4a86-acfe-cfa5b0380e46 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:54.104702 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35127543-ad77-4a86-acfe-cfa5b0380e46 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:54.105410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35127543-ad77-4a86-acfe-cfa5b0380e46 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:54.106089 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35127543-ad77-4a86-acfe-cfa5b0380e46 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:54.106512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35127543-ad77-4a86-acfe-cfa5b0380e46 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:54.240310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-35127543-ad77-4a86-acfe-cfa5b0380e46 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:54.248146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-35127543-ad77-4a86-acfe-cfa5b0380e46 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1367 microversion: 2.1 time: 0.157196 Sep 02 10:13:54.248740 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1274/2472] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:54 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:54.376498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-1c21d2f6-dce3-42c3-8cbe-06847b90f7b5 req-57261b87-ad7e-44ee-b483-0ba4338fb006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c90657-d042-4f11-a914-14d1456401de", "tag": "811e1f28-cec3-410d-b9cf-eef1011400e8"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:54.386380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-1c21d2f6-dce3-42c3-8cbe-06847b90f7b5 req-57261b87-ad7e-44ee-b483-0ba4338fb006 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:54.390034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-1c21d2f6-dce3-42c3-8cbe-06847b90f7b5 req-57261b87-ad7e-44ee-b483-0ba4338fb006 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:54.390034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-1c21d2f6-dce3-42c3-8cbe-06847b90f7b5 req-57261b87-ad7e-44ee-b483-0ba4338fb006 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:54.399100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-1c21d2f6-dce3-42c3-8cbe-06847b90f7b5 req-57261b87-ad7e-44ee-b483-0ba4338fb006 service nova] Creating event network-changed:811e1f28-cec3-410d-b9cf-eef1011400e8 for instance 19c90657-d042-4f11-a914-14d1456401de on hv-cinder-85083 Sep 02 10:13:54.404227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-1c21d2f6-dce3-42c3-8cbe-06847b90f7b5 req-57261b87-ad7e-44ee-b483-0ba4338fb006 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033020 Sep 02 10:13:54.404818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1199/2473] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:13:55.269147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f6c37fde-7d17-4e51-b977-dda6383346f6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:55.269788 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f6c37fde-7d17-4e51-b977-dda6383346f6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:55.276228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6c37fde-7d17-4e51-b977-dda6383346f6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:55.278909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6c37fde-7d17-4e51-b977-dda6383346f6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:55.278909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6c37fde-7d17-4e51-b977-dda6383346f6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:55.278909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6c37fde-7d17-4e51-b977-dda6383346f6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:55.278909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6c37fde-7d17-4e51-b977-dda6383346f6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:55.279248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f6c37fde-7d17-4e51-b977-dda6383346f6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:55.405656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f6c37fde-7d17-4e51-b977-dda6383346f6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:55.413138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f6c37fde-7d17-4e51-b977-dda6383346f6 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1367 microversion: 2.1 time: 0.148501 Sep 02 10:13:55.413705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1275/2474] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:55 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:56.434181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-239491b7-5ef8-4232-bf79-b143040aa824 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:56.434913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-239491b7-5ef8-4232-bf79-b143040aa824 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:56.441912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239491b7-5ef8-4232-bf79-b143040aa824 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:56.442391 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239491b7-5ef8-4232-bf79-b143040aa824 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:56.442849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239491b7-5ef8-4232-bf79-b143040aa824 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:56.443784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239491b7-5ef8-4232-bf79-b143040aa824 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:56.444235 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239491b7-5ef8-4232-bf79-b143040aa824 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:56.444654 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-239491b7-5ef8-4232-bf79-b143040aa824 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:56.581396 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-239491b7-5ef8-4232-bf79-b143040aa824 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:56.588877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-239491b7-5ef8-4232-bf79-b143040aa824 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1367 microversion: 2.1 time: 0.158960 Sep 02 10:13:56.589431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1200/2475] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:56 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:57.609494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-816fe1be-e7dd-43ed-a45f-917f61766432 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:57.610105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-816fe1be-e7dd-43ed-a45f-917f61766432 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:57.616615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-816fe1be-e7dd-43ed-a45f-917f61766432 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:57.617096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-816fe1be-e7dd-43ed-a45f-917f61766432 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:57.617593 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-816fe1be-e7dd-43ed-a45f-917f61766432 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:57.618270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-816fe1be-e7dd-43ed-a45f-917f61766432 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:57.618734 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-816fe1be-e7dd-43ed-a45f-917f61766432 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:57.619165 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-816fe1be-e7dd-43ed-a45f-917f61766432 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:57.751274 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-816fe1be-e7dd-43ed-a45f-917f61766432 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:57.759491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-816fe1be-e7dd-43ed-a45f-917f61766432 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1367 microversion: 2.1 time: 0.154188 Sep 02 10:13:57.760059 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1276/2476] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:57 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:58.780792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c224f20f-ecc4-4da6-baf2-10ec7749e714 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:58.781406 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c224f20f-ecc4-4da6-baf2-10ec7749e714 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:58.788513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c224f20f-ecc4-4da6-baf2-10ec7749e714 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:58.788994 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c224f20f-ecc4-4da6-baf2-10ec7749e714 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:58.789432 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c224f20f-ecc4-4da6-baf2-10ec7749e714 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:58.790178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c224f20f-ecc4-4da6-baf2-10ec7749e714 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:58.790659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c224f20f-ecc4-4da6-baf2-10ec7749e714 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:58.791120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c224f20f-ecc4-4da6-baf2-10ec7749e714 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:58.920247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c224f20f-ecc4-4da6-baf2-10ec7749e714 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:13:58.927905 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c224f20f-ecc4-4da6-baf2-10ec7749e714 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1367 microversion: 2.1 time: 0.151084 Sep 02 10:13:58.928468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1201/2477] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:58 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:13:59.782215 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-eada4e69-5691-4a51-984b-f3ff4b7dc3e0 req-dc1f6356-b9fb-4b70-9eb6-f16ccdad32b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c90657-d042-4f11-a914-14d1456401de", "name": "network-vif-plugged", "status": "completed", "tag": "811e1f28-cec3-410d-b9cf-eef1011400e8"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:13:59.791975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-eada4e69-5691-4a51-984b-f3ff4b7dc3e0 req-dc1f6356-b9fb-4b70-9eb6-f16ccdad32b0 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:59.792454 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-eada4e69-5691-4a51-984b-f3ff4b7dc3e0 req-dc1f6356-b9fb-4b70-9eb6-f16ccdad32b0 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:59.792885 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-eada4e69-5691-4a51-984b-f3ff4b7dc3e0 req-dc1f6356-b9fb-4b70-9eb6-f16ccdad32b0 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:59.804093 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-eada4e69-5691-4a51-984b-f3ff4b7dc3e0 req-dc1f6356-b9fb-4b70-9eb6-f16ccdad32b0 service nova] Creating event network-vif-plugged:811e1f28-cec3-410d-b9cf-eef1011400e8 for instance 19c90657-d042-4f11-a914-14d1456401de on hv-cinder-85083 Sep 02 10:13:59.809016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-eada4e69-5691-4a51-984b-f3ff4b7dc3e0 req-dc1f6356-b9fb-4b70-9eb6-f16ccdad32b0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030559 Sep 02 10:13:59.809592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1277/2478] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:13:59.947819 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0555fad9-8996-44ef-9d8b-2fbc0ed8de82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:13:59.948424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0555fad9-8996-44ef-9d8b-2fbc0ed8de82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:13:59.954798 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0555fad9-8996-44ef-9d8b-2fbc0ed8de82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:59.955275 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0555fad9-8996-44ef-9d8b-2fbc0ed8de82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:59.955702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0555fad9-8996-44ef-9d8b-2fbc0ed8de82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:13:59.956376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0555fad9-8996-44ef-9d8b-2fbc0ed8de82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:13:59.956825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0555fad9-8996-44ef-9d8b-2fbc0ed8de82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:13:59.957240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0555fad9-8996-44ef-9d8b-2fbc0ed8de82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:14:00.087109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0555fad9-8996-44ef-9d8b-2fbc0ed8de82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:14:00.096422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0555fad9-8996-44ef-9d8b-2fbc0ed8de82 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1367 microversion: 2.1 time: 0.150799 Sep 02 10:14:00.096422 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1202/2479] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:13:59 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:14:01.114503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:14:01.118552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=6 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:14:01.119766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2d018403-ebda-4c5f-bcdd-1241150993e0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:14:01.120486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2d018403-ebda-4c5f-bcdd-1241150993e0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:14:01.126449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d018403-ebda-4c5f-bcdd-1241150993e0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:14:01.126967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d018403-ebda-4c5f-bcdd-1241150993e0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:14:01.128047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d018403-ebda-4c5f-bcdd-1241150993e0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:14:01.128719 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d018403-ebda-4c5f-bcdd-1241150993e0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:14:01.129166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d018403-ebda-4c5f-bcdd-1241150993e0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:14:01.129585 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2d018403-ebda-4c5f-bcdd-1241150993e0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:14:01.260307 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2d018403-ebda-4c5f-bcdd-1241150993e0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:14:01.267823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2d018403-ebda-4c5f-bcdd-1241150993e0 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1367 microversion: 2.1 time: 0.154383 Sep 02 10:14:01.268377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1278/2480] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:14:01 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:14:02.288061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ddece1c0-9055-46c6-ba03-081d33f0ac3c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:14:02.288668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ddece1c0-9055-46c6-ba03-081d33f0ac3c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:14:02.290899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:14:02.295690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddece1c0-9055-46c6-ba03-081d33f0ac3c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:14:02.296166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddece1c0-9055-46c6-ba03-081d33f0ac3c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:14:02.296598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddece1c0-9055-46c6-ba03-081d33f0ac3c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:14:02.297271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddece1c0-9055-46c6-ba03-081d33f0ac3c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:14:02.297919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddece1c0-9055-46c6-ba03-081d33f0ac3c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:14:02.298341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ddece1c0-9055-46c6-ba03-081d33f0ac3c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:14:02.429040 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ddece1c0-9055-46c6-ba03-081d33f0ac3c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:14:02.436690 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ddece1c0-9055-46c6-ba03-081d33f0ac3c tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1556 microversion: 2.1 time: 0.152475 Sep 02 10:14:02.439404 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1203/2481] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:14:02 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:14:02.457546 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-42d9e680-f57b-40c9-b076-e3af63a20315 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:14:02.458152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-42d9e680-f57b-40c9-b076-e3af63a20315 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:14:02.465137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42d9e680-f57b-40c9-b076-e3af63a20315 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:14:02.474000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42d9e680-f57b-40c9-b076-e3af63a20315 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:14:02.474000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42d9e680-f57b-40c9-b076-e3af63a20315 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:14:02.474000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42d9e680-f57b-40c9-b076-e3af63a20315 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:14:02.474000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42d9e680-f57b-40c9-b076-e3af63a20315 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:14:02.474404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42d9e680-f57b-40c9-b076-e3af63a20315 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:14:02.542898 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-42d9e680-f57b-40c9-b076-e3af63a20315 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089315 Sep 02 10:14:02.543761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1279/2482] 10.222.0.57 () {58 vars in 1275 bytes} [Fri Sep 2 10:14:02 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:14:03.554097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-f2007604-8c3b-4f48-91e5-5e00646fd947 req-07c5b5e2-f493-4b7d-af06-0023a4aaa58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c90657-d042-4f11-a914-14d1456401de", "tag": "811e1f28-cec3-410d-b9cf-eef1011400e8"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:14:03.563610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-f2007604-8c3b-4f48-91e5-5e00646fd947 req-07c5b5e2-f493-4b7d-af06-0023a4aaa58e service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:14:03.564089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-f2007604-8c3b-4f48-91e5-5e00646fd947 req-07c5b5e2-f493-4b7d-af06-0023a4aaa58e service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:14:03.564529 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-f2007604-8c3b-4f48-91e5-5e00646fd947 req-07c5b5e2-f493-4b7d-af06-0023a4aaa58e service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:14:03.578374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-f2007604-8c3b-4f48-91e5-5e00646fd947 req-07c5b5e2-f493-4b7d-af06-0023a4aaa58e service nova] Creating event network-changed:811e1f28-cec3-410d-b9cf-eef1011400e8 for instance 19c90657-d042-4f11-a914-14d1456401de on hv-cinder-85083 Sep 02 10:14:03.584982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-f2007604-8c3b-4f48-91e5-5e00646fd947 req-07c5b5e2-f493-4b7d-af06-0023a4aaa58e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092700 Sep 02 10:14:03.586485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1204/2483] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:14:59.063954 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75307c23-192c-4adc-9fe4-89c9e2c92650] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 10:14:59.064531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:14:59.065225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:14:59.149124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2336e946-a1a8-45bd-9f94-15f0d9921b00 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:14:59.149619 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2336e946-a1a8-45bd-9f94-15f0d9921b00 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:14:59.155467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2336e946-a1a8-45bd-9f94-15f0d9921b00 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:14:59.155934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2336e946-a1a8-45bd-9f94-15f0d9921b00 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:14:59.156372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2336e946-a1a8-45bd-9f94-15f0d9921b00 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:14:59.157054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2336e946-a1a8-45bd-9f94-15f0d9921b00 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:14:59.157511 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2336e946-a1a8-45bd-9f94-15f0d9921b00 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:14:59.157948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2336e946-a1a8-45bd-9f94-15f0d9921b00 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:14:59.182111 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2336e946-a1a8-45bd-9f94-15f0d9921b00 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/ips" status: 200 len: 151 microversion: 2.20 time: 0.119530 Sep 02 10:14:59.182658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1280/2484] 10.222.0.57 () {60 vars in 1289 bytes} [Fri Sep 2 10:14:59 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/ips => generated 151 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 10:15:02.238381 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c60ed460-705c-4fad-8472-17fdf69e7034 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:15:02.239020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c60ed460-705c-4fad-8472-17fdf69e7034 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:02.241310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:02.241940 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=88 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:02.247443 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c60ed460-705c-4fad-8472-17fdf69e7034 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:02.247914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c60ed460-705c-4fad-8472-17fdf69e7034 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:02.248341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c60ed460-705c-4fad-8472-17fdf69e7034 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:02.249010 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c60ed460-705c-4fad-8472-17fdf69e7034 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:02.249455 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c60ed460-705c-4fad-8472-17fdf69e7034 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:02.249871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c60ed460-705c-4fad-8472-17fdf69e7034 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:02.271826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-c60ed460-705c-4fad-8472-17fdf69e7034 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lazy-loading 'flavor' on Instance uuid a1922d53-bdcd-4824-aca7-31b78f883be0 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:15:02.720186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c60ed460-705c-4fad-8472-17fdf69e7034 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "POST /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/action" status: 202 len: 0 microversion: 2.20 time: 0.485883 Sep 02 10:15:02.720774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1205/2485] 10.222.0.57 () {62 vars in 1319 bytes} [Fri Sep 2 10:15:02 2022] POST /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:15:02.729625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:02.730244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:02.738886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:02.739389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:02.739864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:02.740545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:02.741001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:02.741429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:02.746848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] [75307c23-192c-4adc-9fe4-89c9e2c92650] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 59108. Sep 02 10:15:02.877067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:02.885644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:02.887138 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:02.888303 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-38f012bc-fa53-4e79-bf14-af9845f6d729 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.163321 Sep 02 10:15:02.888867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1281/2486] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:02 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:03.913782 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:03.914475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:03.920740 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:03.921219 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:03.921655 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:03.922337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:03.922824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:03.923250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:04.054370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:04.063031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:04.064524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:04.065653 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-12fca1d2-bc85-4822-804c-ab0235f78b26 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.156782 Sep 02 10:15:04.066208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1206/2487] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:03 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:05.090039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:05.090684 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:05.097348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:05.097779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:05.098213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:05.099207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:05.099663 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:05.100083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:05.225505 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:05.234098 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:05.235570 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:05.236717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4635ac81-a7ee-4b33-bacb-5acba5b64b96 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.151613 Sep 02 10:15:05.237272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1282/2488] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:05 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:06.259258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:06.259786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:06.266188 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:06.266692 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:06.267154 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:06.267829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:06.268279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:06.268702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:06.394984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:06.403593 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:06.405034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:06.406190 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d2594b34-a9ab-422d-8d88-fb98187de0ba tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.150934 Sep 02 10:15:06.406762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1207/2489] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:06 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:07.428990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:07.429649 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:07.436637 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:07.437118 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:07.437552 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:07.438233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:07.438683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:07.439132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:07.566074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:07.573997 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:07.575465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:07.576608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9a7ce0db-e778-49a0-9a56-57c3dd72a56b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.151508 Sep 02 10:15:07.577172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1283/2490] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:07 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:08.599726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:08.600348 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:08.607160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:08.607641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:08.608072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:08.608775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:08.609220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:08.609635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:08.733621 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:08.741649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:08.743147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:08.744295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a7976a44-2ca9-41a5-84df-1cf1228fbe29 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.148433 Sep 02 10:15:08.744859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1208/2491] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:08 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:09.766312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:09.766944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:09.773451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:09.773937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:09.774360 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:09.775559 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:09.776009 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:09.776437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:09.903674 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:09.911754 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:09.913199 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:09.914350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f9b94c67-83eb-4bfb-9654-92d333cb9e4c tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.151983 Sep 02 10:15:09.914944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1284/2492] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:09 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:10.938220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:10.938853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:10.945308 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:10.945790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:10.946222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:10.946927 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:10.947385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:10.947807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:11.076836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:11.084833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:11.086277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:11.087440 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-aa52e141-1e02-451e-87d4-5128a5384828 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.153152 Sep 02 10:15:11.087996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1209/2493] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:10 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:12.109623 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:12.110252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:12.116624 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:12.117100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:12.117534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:12.118208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:12.118657 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:12.119101 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:12.245603 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:12.253905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:12.255437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:12.256592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-107d43fe-41b0-4588-8399-ea6a29f6729d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.150907 Sep 02 10:15:12.257160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1285/2494] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:12 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:13.280685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:13.281293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:13.287643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:13.288123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:13.288549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:13.289222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:13.289670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:13.290087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:13.728011 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:13.737036 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:13.738513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:13.739687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ff5309a1-84dd-4ef0-b412-52301c38a27e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.463432 Sep 02 10:15:13.740247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1210/2495] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:13 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:14.762030 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:14.762640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:14.769067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:14.769550 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:14.770001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:14.770677 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:14.771150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:14.771571 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:14.902736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:14.910749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:14.912194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:14.913372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-96188fbf-e9ab-4038-aed0-16bdb9a6fdef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1743 microversion: 2.20 time: 0.155204 Sep 02 10:15:14.913921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1286/2496] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:14 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:15.937153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:15.941330 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:15.944378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:15.944862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:15.945300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:15.945987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:15.946441 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:15.946915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:16.230016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:16.238351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:16.239831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:16.241033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8a137857-1aed-4d16-b56f-3a834d711413 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1743 microversion: 2.20 time: 0.307895 Sep 02 10:15:16.241598 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1211/2497] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:15 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1743 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:17.265422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:17.265940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:17.272290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:17.272767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:17.273201 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:17.273876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:17.274325 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:17.274767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:17.400230 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:17.408267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:17.409707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:17.410891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7956737d-8401-4e3e-b79d-65ffedbcc8cc tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1743 microversion: 2.20 time: 0.150117 Sep 02 10:15:17.411446 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1287/2498] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:17 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:17.980039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-98cbff48-f42e-4ac0-9cb3-59dab84034a6 req-886cb058-3432-462a-a978-56ad14a13094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1922d53-bdcd-4824-aca7-31b78f883be0", "name": "network-vif-plugged", "status": "completed", "tag": "0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:15:17.988363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-98cbff48-f42e-4ac0-9cb3-59dab84034a6 req-886cb058-3432-462a-a978-56ad14a13094 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:17.988825 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-98cbff48-f42e-4ac0-9cb3-59dab84034a6 req-886cb058-3432-462a-a978-56ad14a13094 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:17.989241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-98cbff48-f42e-4ac0-9cb3-59dab84034a6 req-886cb058-3432-462a-a978-56ad14a13094 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:18.000388 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-98cbff48-f42e-4ac0-9cb3-59dab84034a6 req-886cb058-3432-462a-a978-56ad14a13094 service nova] Creating event network-vif-plugged:0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569 for instance a1922d53-bdcd-4824-aca7-31b78f883be0 on hv-cinder-85083 Sep 02 10:15:18.005338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-98cbff48-f42e-4ac0-9cb3-59dab84034a6 req-886cb058-3432-462a-a978-56ad14a13094 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082646 Sep 02 10:15:18.014509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1212/2499] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:15:18.433487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:18.434134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:18.440594 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:18.441081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:18.441522 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:18.442213 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:18.442671 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:18.443124 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:18.547244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-101046c0-65bd-4cd2-a4af-f16b70d154c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:18.547826 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-101046c0-65bd-4cd2-a4af-f16b70d154c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:18.553840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-101046c0-65bd-4cd2-a4af-f16b70d154c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:18.554335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-101046c0-65bd-4cd2-a4af-f16b70d154c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:18.554847 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-101046c0-65bd-4cd2-a4af-f16b70d154c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:18.555541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-101046c0-65bd-4cd2-a4af-f16b70d154c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:18.555993 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-101046c0-65bd-4cd2-a4af-f16b70d154c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:18.556415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-101046c0-65bd-4cd2-a4af-f16b70d154c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:18.575428 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:18.579915 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-101046c0-65bd-4cd2-a4af-f16b70d154c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/ips" status: 200 len: 148 microversion: 2.1 time: 0.088464 Sep 02 10:15:18.580468 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1213/2500] 10.222.0.57 () {58 vars in 1248 bytes} [Fri Sep 2 10:15:18 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/ips => generated 148 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:15:18.583595 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:18.585085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:18.586499 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3de7eece-71ba-45dd-bc99-0972b82e7f17 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1743 microversion: 2.20 time: 0.157306 Sep 02 10:15:18.587096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1288/2501] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:18 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:19.610539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:19.611167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:19.618698 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:19.619971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:19.619971 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:19.620594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:19.621048 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:19.621478 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:19.771550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:19.782374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:19.784177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:19.785937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b11d71ff-bd85-4e87-9f1c-4d17b65624e1 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1738 microversion: 2.20 time: 0.179474 Sep 02 10:15:19.787223 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1214/2502] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:19 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:20.221143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fdc85c1c-8aa1-4e5f-8c73-ad43e633f430 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:15:20.223851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fdc85c1c-8aa1-4e5f-8c73-ad43e633f430 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:20.230681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc85c1c-8aa1-4e5f-8c73-ad43e633f430 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:20.231222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc85c1c-8aa1-4e5f-8c73-ad43e633f430 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:20.231691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc85c1c-8aa1-4e5f-8c73-ad43e633f430 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:20.232408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc85c1c-8aa1-4e5f-8c73-ad43e633f430 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:20.232862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc85c1c-8aa1-4e5f-8c73-ad43e633f430 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:20.233334 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc85c1c-8aa1-4e5f-8c73-ad43e633f430 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:20.810123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:20.811359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:20.818269 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:20.818780 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:20.819374 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:20.820736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:20.821646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:20.822120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:20.989017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:21.000218 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:21.001955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:21.003377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5b28d986-4837-468b-b8f5-81cf924166f6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1738 microversion: 2.20 time: 0.197357 Sep 02 10:15:21.004105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1215/2503] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:20 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:15:21.045332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fdc85c1c-8aa1-4e5f-8c73-ad43e633f430 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.828123 Sep 02 10:15:21.045932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1289/2504] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 10:15:20 2022] POST /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:15:22.029128 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:22.029729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:22.036305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:22.038034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:22.038034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:22.038034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:22.038346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:22.038860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:22.187081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:22.202623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:22.204217 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:22.205380 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2e8363f7-29b6-4ee9-8f1a-2fe2c0f8e403 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1738 microversion: 2.20 time: 0.180986 Sep 02 10:15:22.205942 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1216/2505] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:22 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:23.231714 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:23.232450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:23.239953 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:23.240782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:23.241459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:23.242760 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:23.243556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:23.244531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:23.406043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:23.419404 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:23.420852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:23.422079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e2f0a561-698d-4346-aa9c-f18e4fa6b6d0 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1738 microversion: 2.20 time: 0.196605 Sep 02 10:15:23.423004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1290/2506] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:23 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:24.449313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:24.450132 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:24.466612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:24.467222 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:24.467735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:24.468526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:24.469054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:24.469548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:24.643717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:24.653398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:24.655569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:24.656741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8d5cb488-1845-49df-af46-92b17e02b287 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1738 microversion: 2.20 time: 0.212881 Sep 02 10:15:24.657567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1217/2507] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:24 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:25.694264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:25.695583 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:25.702858 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:25.703421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:25.703937 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:25.704703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:25.705228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:25.705726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:25.860869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:25.869496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:25.871627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:25.872783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-e6a6fc1c-cdc1-4170-8b47-98bc336109ff tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1738 microversion: 2.20 time: 0.182499 Sep 02 10:15:25.873631 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1291/2508] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:25 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:26.898683 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:26.900474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:26.911385 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:26.912702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:26.912702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:26.913668 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:26.914453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:26.915152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:27.068155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:27.077304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:27.078950 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:27.080284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1502e321-04d9-4267-8c8e-889bd1df44e6 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1738 microversion: 2.20 time: 0.187875 Sep 02 10:15:27.081046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1218/2509] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:26 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:28.105452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:28.105993 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:28.112348 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:28.112825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:28.113262 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:28.113975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:28.114426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:28.114886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:28.251279 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:28.260787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:28.260787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:28.261920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0d1e2f5d-f17f-496b-8bb1-70bbba8ab46b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1738 microversion: 2.20 time: 0.161561 Sep 02 10:15:28.262480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1292/2510] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:28 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:29.284837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:29.285447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:29.294111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:29.294686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:29.295252 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:29.296052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:29.296616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:29.297127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:29.437343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:29.445513 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:29.446982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:29.448139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-88f5d4b7-411b-4ccc-95d0-0ea94d64cb82 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1738 microversion: 2.20 time: 0.167227 Sep 02 10:15:29.449346 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1219/2511] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:29 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:29.689743 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:15:29.692264 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:29.698687 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:29.701810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:29.701810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:29.701810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:29.701810 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:29.702209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:29.779174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Invalid volume: volume 86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c is already attached to instances: 19c90657-d042-4f11-a914-14d1456401de Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: POST /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments HTTP/1.1 Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 74 Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:15:29.780875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {"volumeAttachment": {"volumeId": "86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c"}} Sep 02 10:15:29.782228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid volume: volume 86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c is already attached to instances: 19c90657-d042-4f11-a914-14d1456401de Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'server_id': '19c90657-d042-4f11-a914-14d1456401de', 'body': {'volumeAttachment': {'volumeId': '86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c'}}} Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c is already attached to instances: 19c90657-d042-4f11-a914-14d1456401de Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:15:29.786193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c is already attached to instances: 19c90657-d042-4f11-a914-14d1456401de Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:15:29.787620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:15:29.788880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:15:29.788880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:15:29.788880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:15:29.788880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c is already attached to instances: 19c90657-d042-4f11-a914-14d1456401de Sep 02 10:15:29.788880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:15:29.788880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 400 to user: Invalid volume: volume 86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c is already attached to instances: 19c90657-d042-4f11-a914-14d1456401de {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:15:29.788880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-68765b6d-ad12-4356-951c-7c5543fc0fc5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096607 Sep 02 10:15:29.788880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1293/2512] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 10:15:29 2022] POST /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 10:15:29.845059 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b599e70f-bd85-4b63-b5f8-22d30a32fcef tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:29.845547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b599e70f-bd85-4b63-b5f8-22d30a32fcef tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:29.851502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b599e70f-bd85-4b63-b5f8-22d30a32fcef tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:29.851974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b599e70f-bd85-4b63-b5f8-22d30a32fcef tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:29.852409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b599e70f-bd85-4b63-b5f8-22d30a32fcef tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:29.853332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b599e70f-bd85-4b63-b5f8-22d30a32fcef tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:29.853778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b599e70f-bd85-4b63-b5f8-22d30a32fcef tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:29.854193 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b599e70f-bd85-4b63-b5f8-22d30a32fcef tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:29.874909 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:29.936161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-b599e70f-bd85-4b63-b5f8-22d30a32fcef tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lazy-loading 'services' on Instance uuid 19c90657-d042-4f11-a914-14d1456401de {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:15:30.149072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b599e70f-bd85-4b63-b5f8-22d30a32fcef tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments/86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c" status: 202 len: 0 microversion: 2.1 time: 0.307781 Sep 02 10:15:30.149666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1220/2513] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 10:15:29 2022] DELETE /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments/86f8d4f4-a7bd-4ab5-9c99-1537f74a0f5c => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:15:30.158422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cb3a72e5-f861-4b14-b749-da1064aaabba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:30.160813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cb3a72e5-f861-4b14-b749-da1064aaabba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:30.166867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb3a72e5-f861-4b14-b749-da1064aaabba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:30.168029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb3a72e5-f861-4b14-b749-da1064aaabba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:30.168470 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb3a72e5-f861-4b14-b749-da1064aaabba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:30.169152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb3a72e5-f861-4b14-b749-da1064aaabba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:30.169605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb3a72e5-f861-4b14-b749-da1064aaabba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:30.170027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cb3a72e5-f861-4b14-b749-da1064aaabba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:30.199432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cb3a72e5-f861-4b14-b749-da1064aaabba tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Sep 02 10:15:30.199914 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1294/2514] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:15:30 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:15:30.472855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:30.473546 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:30.480047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:30.480530 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:30.480964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:30.481643 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:30.482095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:30.482522 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:30.615582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:30.624506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:30.626147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:30.627342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-59d7b118-76f3-4688-8737-c3d506687d55 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1720 microversion: 2.20 time: 0.159228 Sep 02 10:15:30.627899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1221/2515] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:30 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:31.212805 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6edd4ac2-9bbc-4449-8d92-8eb187cbba92 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:31.216368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6edd4ac2-9bbc-4449-8d92-8eb187cbba92 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:31.224320 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6edd4ac2-9bbc-4449-8d92-8eb187cbba92 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:31.225072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6edd4ac2-9bbc-4449-8d92-8eb187cbba92 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:31.225688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6edd4ac2-9bbc-4449-8d92-8eb187cbba92 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:31.226587 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6edd4ac2-9bbc-4449-8d92-8eb187cbba92 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:31.227297 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6edd4ac2-9bbc-4449-8d92-8eb187cbba92 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:31.227736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6edd4ac2-9bbc-4449-8d92-8eb187cbba92 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:31.246689 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:31.260700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6edd4ac2-9bbc-4449-8d92-8eb187cbba92 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052256 Sep 02 10:15:31.261317 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1295/2516] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:15:31 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:15:31.653320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:31.653855 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:31.660202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:31.660721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:31.661149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:31.661819 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:31.662271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:31.662687 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:31.789345 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:31.797221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:31.798660 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:31.799818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b37b9588-9bcf-4e87-9693-550ee53262f3 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1720 microversion: 2.20 time: 0.151044 Sep 02 10:15:31.800368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1222/2517] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:31 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:32.272297 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-172c6531-457a-4b7a-aa5e-6934f6e8cfaa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:32.274433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-172c6531-457a-4b7a-aa5e-6934f6e8cfaa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:32.281417 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172c6531-457a-4b7a-aa5e-6934f6e8cfaa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:32.281897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172c6531-457a-4b7a-aa5e-6934f6e8cfaa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:32.282330 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172c6531-457a-4b7a-aa5e-6934f6e8cfaa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:32.283031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172c6531-457a-4b7a-aa5e-6934f6e8cfaa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:32.283479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172c6531-457a-4b7a-aa5e-6934f6e8cfaa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:32.283897 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-172c6531-457a-4b7a-aa5e-6934f6e8cfaa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:32.313083 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-172c6531-457a-4b7a-aa5e-6934f6e8cfaa tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Sep 02 10:15:32.313636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1296/2518] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:15:32 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:15:32.822739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:32.823980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:32.826417 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=37 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:32.831137 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:32.831622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:32.832064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:32.832746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:32.833206 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:32.833631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:32.968088 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:32.976211 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:32.977645 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:32.979110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f6b4b969-8249-40bc-bf3e-e6edf6fa8301 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1720 microversion: 2.20 time: 0.160319 Sep 02 10:15:32.979664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1223/2519] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:32 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:33.325574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bb49e67c-201b-4fa2-8f2f-e3a2e901d3a2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:33.327770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bb49e67c-201b-4fa2-8f2f-e3a2e901d3a2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:33.329782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=35 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:33.334791 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb49e67c-201b-4fa2-8f2f-e3a2e901d3a2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:33.335277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb49e67c-201b-4fa2-8f2f-e3a2e901d3a2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:33.335717 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb49e67c-201b-4fa2-8f2f-e3a2e901d3a2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:33.336405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb49e67c-201b-4fa2-8f2f-e3a2e901d3a2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:33.336857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb49e67c-201b-4fa2-8f2f-e3a2e901d3a2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:33.337282 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bb49e67c-201b-4fa2-8f2f-e3a2e901d3a2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:33.366181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bb49e67c-201b-4fa2-8f2f-e3a2e901d3a2 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044917 Sep 02 10:15:33.366755 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1297/2520] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:15:33 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 10:15:33.427766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cb1bd695-ec3a-45ca-85d7-69266c67339b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:33.429379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cb1bd695-ec3a-45ca-85d7-69266c67339b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:33.434966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1bd695-ec3a-45ca-85d7-69266c67339b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:33.435453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1bd695-ec3a-45ca-85d7-69266c67339b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:33.435888 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1bd695-ec3a-45ca-85d7-69266c67339b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:33.436627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1bd695-ec3a-45ca-85d7-69266c67339b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:33.437077 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1bd695-ec3a-45ca-85d7-69266c67339b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:33.437502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb1bd695-ec3a-45ca-85d7-69266c67339b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:33.464054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cb1bd695-ec3a-45ca-85d7-69266c67339b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:15:33.721334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cb1bd695-ec3a-45ca-85d7-69266c67339b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 204 len: 0 microversion: 2.1 time: 0.297052 Sep 02 10:15:33.721872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1224/2521] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:15:33 2022] DELETE /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:15:33.731423 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d707c011-fd5e-410f-a73e-a2fed47e97cf tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:33.735983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d707c011-fd5e-410f-a73e-a2fed47e97cf tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:33.738208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d707c011-fd5e-410f-a73e-a2fed47e97cf tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:33.738685 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d707c011-fd5e-410f-a73e-a2fed47e97cf tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:33.739152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d707c011-fd5e-410f-a73e-a2fed47e97cf tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:33.739825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d707c011-fd5e-410f-a73e-a2fed47e97cf tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:33.740272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d707c011-fd5e-410f-a73e-a2fed47e97cf tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:33.740691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d707c011-fd5e-410f-a73e-a2fed47e97cf tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:33.883574 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d707c011-fd5e-410f-a73e-a2fed47e97cf tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:33.892249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d707c011-fd5e-410f-a73e-a2fed47e97cf tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1680 microversion: 2.1 time: 0.166071 Sep 02 10:15:33.906652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1298/2522] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:33 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:33.973684 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-94c7e1fe-2907-4ef4-89eb-81b33790f4fc req-97164fe0-4ab9-4f62-8882-59ef488b93c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1922d53-bdcd-4824-aca7-31b78f883be0", "name": "network-vif-unplugged", "status": "completed", "tag": "0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:15:33.984566 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-94c7e1fe-2907-4ef4-89eb-81b33790f4fc req-97164fe0-4ab9-4f62-8882-59ef488b93c9 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:33.985042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-94c7e1fe-2907-4ef4-89eb-81b33790f4fc req-97164fe0-4ab9-4f62-8882-59ef488b93c9 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:33.985470 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-94c7e1fe-2907-4ef4-89eb-81b33790f4fc req-97164fe0-4ab9-4f62-8882-59ef488b93c9 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:33.996512 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-94c7e1fe-2907-4ef4-89eb-81b33790f4fc req-97164fe0-4ab9-4f62-8882-59ef488b93c9 service nova] Creating event network-vif-unplugged:0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569 for instance a1922d53-bdcd-4824-aca7-31b78f883be0 on hv-cinder-85083 Sep 02 10:15:34.001343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-94c7e1fe-2907-4ef4-89eb-81b33790f4fc req-97164fe0-4ab9-4f62-8882-59ef488b93c9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031919 Sep 02 10:15:34.001931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1225/2523] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:15:34.002217 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:34.002875 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:34.008862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:34.011251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:34.011251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:34.011251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:34.011561 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:34.011983 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:34.147004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:34.156045 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:34.157547 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:34.158724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5ec717bf-e21a-47f6-bff8-5805a8faa2c4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1723 microversion: 2.20 time: 0.161213 Sep 02 10:15:34.159284 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1299/2524] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:33 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:15:34.181370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-265c9705-9cd0-4ced-ab64-2eec91af8778 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88d61b5f-f50a-4405-9685-9e03ab521486"}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:15:34.183926 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-265c9705-9cd0-4ced-ab64-2eec91af8778 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:34.190072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-265c9705-9cd0-4ced-ab64-2eec91af8778 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:34.190556 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-265c9705-9cd0-4ced-ab64-2eec91af8778 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:34.191028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-265c9705-9cd0-4ced-ab64-2eec91af8778 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:34.191720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-265c9705-9cd0-4ced-ab64-2eec91af8778 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:34.192180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-265c9705-9cd0-4ced-ab64-2eec91af8778 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:34.192602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-265c9705-9cd0-4ced-ab64-2eec91af8778 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:34.914193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-63696328-5492-4fd4-abe3-2681255c800e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:34.914929 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-63696328-5492-4fd4-abe3-2681255c800e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:34.921383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63696328-5492-4fd4-abe3-2681255c800e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:34.921862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63696328-5492-4fd4-abe3-2681255c800e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:34.922299 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63696328-5492-4fd4-abe3-2681255c800e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:34.923004 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63696328-5492-4fd4-abe3-2681255c800e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:34.924057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63696328-5492-4fd4-abe3-2681255c800e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:34.924057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-63696328-5492-4fd4-abe3-2681255c800e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:35.051630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-63696328-5492-4fd4-abe3-2681255c800e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:35.059373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-63696328-5492-4fd4-abe3-2681255c800e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1680 microversion: 2.1 time: 0.149019 Sep 02 10:15:35.062214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1300/2525] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:34 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:15:35.137982 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-265c9705-9cd0-4ced-ab64-2eec91af8778 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "POST /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.960894 Sep 02 10:15:35.138551 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1226/2526] 10.222.0.57 () {62 vars in 1364 bytes} [Fri Sep 2 10:15:34 2022] POST /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/os-volume_attachments => generated 188 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 10:15:35.270503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4d0e7dd1-8a8c-4f11-a7c1-5e635ca38701 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:35.271028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4d0e7dd1-8a8c-4f11-a7c1-5e635ca38701 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:35.276965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d0e7dd1-8a8c-4f11-a7c1-5e635ca38701 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:35.281100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d0e7dd1-8a8c-4f11-a7c1-5e635ca38701 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:35.281100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d0e7dd1-8a8c-4f11-a7c1-5e635ca38701 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:35.281100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d0e7dd1-8a8c-4f11-a7c1-5e635ca38701 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:35.281100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d0e7dd1-8a8c-4f11-a7c1-5e635ca38701 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:35.281441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4d0e7dd1-8a8c-4f11-a7c1-5e635ca38701 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:35.860967 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4d0e7dd1-8a8c-4f11-a7c1-5e635ca38701 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/os-volume_attachments/88d61b5f-f50a-4405-9685-9e03ab521486" status: 202 len: 0 microversion: 2.20 time: 0.594365 Sep 02 10:15:35.861747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1301/2527] 10.222.0.57 () {60 vars in 1457 bytes} [Fri Sep 2 10:15:35 2022] DELETE /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/os-volume_attachments/88d61b5f-f50a-4405-9685-9e03ab521486 => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:15:35.922967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6ffda02f-5346-47f4-bfd8-59658b3c79fa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:15:35.923592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6ffda02f-5346-47f4-bfd8-59658b3c79fa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:35.929586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ffda02f-5346-47f4-bfd8-59658b3c79fa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:35.930075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ffda02f-5346-47f4-bfd8-59658b3c79fa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:35.930545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ffda02f-5346-47f4-bfd8-59658b3c79fa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:35.931263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ffda02f-5346-47f4-bfd8-59658b3c79fa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:35.931721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ffda02f-5346-47f4-bfd8-59658b3c79fa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:35.932149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6ffda02f-5346-47f4-bfd8-59658b3c79fa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:35.962228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6ffda02f-5346-47f4-bfd8-59658b3c79fa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127531) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 10:15:36.080090 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-90c8a4b1-6c30-47e0-884e-27fcd29e0a4d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:36.080860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-90c8a4b1-6c30-47e0-884e-27fcd29e0a4d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:36.087742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90c8a4b1-6c30-47e0-884e-27fcd29e0a4d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:36.088227 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90c8a4b1-6c30-47e0-884e-27fcd29e0a4d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:36.088664 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90c8a4b1-6c30-47e0-884e-27fcd29e0a4d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:36.089877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90c8a4b1-6c30-47e0-884e-27fcd29e0a4d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:36.090382 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90c8a4b1-6c30-47e0-884e-27fcd29e0a4d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:36.090834 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-90c8a4b1-6c30-47e0-884e-27fcd29e0a4d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:36.201677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6ffda02f-5346-47f4-bfd8-59658b3c79fa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "POST /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/action" status: 202 len: 0 microversion: 2.20 time: 0.282796 Sep 02 10:15:36.202284 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1227/2528] 10.222.0.57 () {62 vars in 1319 bytes} [Fri Sep 2 10:15:35 2022] POST /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 02 10:15:36.211133 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:36.212025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:36.218746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:36.219278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:36.219703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:36.220390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:36.220913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:36.221350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:36.232531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-90c8a4b1-6c30-47e0-884e-27fcd29e0a4d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:36.240768 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-90c8a4b1-6c30-47e0-884e-27fcd29e0a4d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1680 microversion: 2.1 time: 0.164445 Sep 02 10:15:36.255200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1302/2529] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:36 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:15:36.426997 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:36.436095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:36.437543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:36.438725 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7753c17e-743d-4233-9250-9a6051161b84 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1671 microversion: 2.20 time: 0.231678 Sep 02 10:15:36.439290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1228/2530] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:36 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:36.932955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-873fddd1-34ea-4bab-8d82-7b8b2c6da515 req-13e8de3a-0299-4b03-8412-687f6cd128b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c90657-d042-4f11-a914-14d1456401de", "name": "network-vif-deleted", "tag": "811e1f28-cec3-410d-b9cf-eef1011400e8"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:15:36.944005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-873fddd1-34ea-4bab-8d82-7b8b2c6da515 req-13e8de3a-0299-4b03-8412-687f6cd128b1 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:36.944491 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-873fddd1-34ea-4bab-8d82-7b8b2c6da515 req-13e8de3a-0299-4b03-8412-687f6cd128b1 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:36.944921 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-873fddd1-34ea-4bab-8d82-7b8b2c6da515 req-13e8de3a-0299-4b03-8412-687f6cd128b1 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:36.956245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-873fddd1-34ea-4bab-8d82-7b8b2c6da515 req-13e8de3a-0299-4b03-8412-687f6cd128b1 service nova] Creating event network-vif-deleted:811e1f28-cec3-410d-b9cf-eef1011400e8 for instance 19c90657-d042-4f11-a914-14d1456401de on hv-cinder-85083 Sep 02 10:15:36.961630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-873fddd1-34ea-4bab-8d82-7b8b2c6da515 req-13e8de3a-0299-4b03-8412-687f6cd128b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032194 Sep 02 10:15:36.962119 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1303/2531] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:15:37.262519 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:37.263795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:37.270233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:37.270742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:37.271181 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:37.271898 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:37.272352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:37.272779 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:37.308236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:37.308729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:37.309161 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:37.309613 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lazy-loading 'fault' on Instance uuid 19c90657-d042-4f11-a914-14d1456401de {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:15:37.356187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:37.364234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9e40c784-fb6d-48f7-b194-27abf8c4f6e1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 200 len: 1331 microversion: 2.1 time: 0.106396 Sep 02 10:15:37.364808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1229/2532] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:37 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:37.462747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:37.464058 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:37.470272 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:37.470802 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:37.471250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:37.471946 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:37.472599 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:37.473033 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:37.618095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:37.627807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:37.629302 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:37.630477 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ebb8f323-f59c-400e-ad89-082c82285620 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1671 microversion: 2.20 time: 0.172763 Sep 02 10:15:37.631203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1304/2533] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:37 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:38.385160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:38.386224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:38.393034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:38.393524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:38.393960 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:38.394651 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:38.395148 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:38.395573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:38.411390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de HTTP/1.1 Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:15:38.413425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:15:38.414503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '19c90657-d042-4f11-a914-14d1456401de'} Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:15:38.415168 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:15:38.416160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:15:38.417720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:15:38.417720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c21d806b-77f8-48e0-8496-f9c854bdebd4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 404 len: 111 microversion: 2.1 time: 0.033527 Sep 02 10:15:38.417720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1230/2534] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:38 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:15:38.424204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-71977db8-3f90-4735-b83a-c3a4f84c22cc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '.version_select at 0x7f4e5c4743a0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:38.534030 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-71977db8-3f90-4735-b83a-c3a4f84c22cc tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440783762" status: 202 len: 0 microversion: 2.1 time: 0.113526 Sep 02 10:15:38.535036 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1305/2535] 10.222.0.57 () {58 vars in 1221 bytes} [Fri Sep 2 10:15:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440783762 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:15:38.653990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:38.654599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:38.661169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:38.661663 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:38.662095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:38.662989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:38.663449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:38.663879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:38.858787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:38.868195 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:38.869804 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:38.871012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6cebc16a-407d-478a-83f9-ad24f65f4741 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.221460 Sep 02 10:15:38.883809 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1231/2536] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:38 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:39.304931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0193c970-af2e-4e07-875b-35114d1ba9da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: .version_select at 0x7f4e5c4de940>, body: {"keypair": {"name": "tempest-keypair-163894425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbnTVicOpJWgMu+2ZI5cyzXv4YLxKbi6hn5D5TiHm3OVn1MeXfv+jbgG9o+5iVV4ahPwMB8aamIE74hbS+vx8eTftKG/cHHwfEsPdKMKE0rs0BvoQuAVnDRWnTnYsVaqw=="}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:15:39.321293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-0193c970-af2e-4e07-875b-35114d1ba9da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'key_pairs'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:15:39.325183 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-0193c970-af2e-4e07-875b-35114d1ba9da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for user 65963d36fc4741c69534b3dde1e00857 and project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'key_pairs'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:15:39.434965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0193c970-af2e-4e07-875b-35114d1ba9da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133920 Sep 02 10:15:39.435901 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1306/2537] 10.222.0.57 () {60 vars in 1159 bytes} [Fri Sep 2 10:15:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:15:39.894833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:39.895427 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:39.909521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:39.910045 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:39.910558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:39.916286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:39.917585 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:39.918320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:39.923183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:40.067612 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:40.076776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:40.078220 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:40.079662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-da90aaee-d149-4d17-92a6-1b52d5df1d1e tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.189103 Sep 02 10:15:40.080230 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1232/2538] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:39 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:41.107067 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:41.107774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:41.114027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:41.114752 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:41.115207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:41.115894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:41.116347 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:41.116772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:41.274194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:41.282822 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:41.288248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:41.289461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4242cab1-97ed-4b5f-b1c1-07194baaadd4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.187358 Sep 02 10:15:41.290028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1307/2539] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:41 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:41.883539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-913195072", "imageRef": "5629e487-43fb-4fae-9f63-5bd7dca44758", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f26589e0-f0d0-4abe-9ad1-1113f17930dd"}], "security_groups": [{"name": "tempest-securitygroup--846406224"}], "key_name": "tempest-keypair-163894425", "user_data": "}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:15:42.007159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] validate_networks() for [('f26589e0-f0d0-4abe-9ad1-1113f17930dd', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 10:15:42.313915 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:42.314449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:42.320892 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:42.321375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:42.321813 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:42.322500 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:42.323015 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:42.323441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:42.466541 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 10:15:42.466987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 10:15:42.467464 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 10:15:42.467871 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 10:15:42.468289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 10:15:42.471467 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:42.480661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:42.481156 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:42.481627 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:42.481861 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:42.482586 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:42.483071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:42.483369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:42.483492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:42.484707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fdc43f9a-f620-4246-a6c2-4a593732eaef tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.175385 Sep 02 10:15:42.485338 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1308/2540] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:42 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:15:42.508041 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:15:42.512105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Getting quotas for user 65963d36fc4741c69534b3dde1e00857 and project 903eb64927ad43f1a2f1f2addb1c1b16. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:15:42.523365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 10:15:42.525704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5629e487-43fb-4fae-9f63-5bd7dca44758',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 10:15:42.660968 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5c005996-a37d-415d-a226-479dc5562a7e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.781945 Sep 02 10:15:42.661864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1233/2541] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 10:15:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 10:15:42.673774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-406d09d7-424f-4c42-992f-4b704b461cad tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:42.674731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-406d09d7-424f-4c42-992f-4b704b461cad tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:42.748468 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-406d09d7-424f-4c42-992f-4b704b461cad tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:42.755770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-406d09d7-424f-4c42-992f-4b704b461cad tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1240 microversion: 2.1 time: 0.085956 Sep 02 10:15:42.756707 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1309/2542] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:42 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:15:43.511003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:43.511601 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:43.518990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:43.519479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:43.519913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:43.520605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:43.521058 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:43.521483 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:43.682868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:43.691338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:43.692796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:43.693955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2d9c5ee9-4b1e-4cc7-9db5-d33068ace1e2 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.188095 Sep 02 10:15:43.694532 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1234/2543] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:43 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:43.777336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0ec473dc-5da2-44a2-a0d5-5f30f6cc2405 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:43.778050 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0ec473dc-5da2-44a2-a0d5-5f30f6cc2405 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:43.788409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ec473dc-5da2-44a2-a0d5-5f30f6cc2405 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:43.788900 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ec473dc-5da2-44a2-a0d5-5f30f6cc2405 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:43.789342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ec473dc-5da2-44a2-a0d5-5f30f6cc2405 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:43.790072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ec473dc-5da2-44a2-a0d5-5f30f6cc2405 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:43.790535 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ec473dc-5da2-44a2-a0d5-5f30f6cc2405 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:43.790994 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ec473dc-5da2-44a2-a0d5-5f30f6cc2405 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:43.855458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0ec473dc-5da2-44a2-a0d5-5f30f6cc2405 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:43.863452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0ec473dc-5da2-44a2-a0d5-5f30f6cc2405 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.090612 Sep 02 10:15:43.864028 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1310/2544] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:43 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:44.718286 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:44.719070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:44.725802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:44.726299 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:44.726738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:44.727696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:44.728146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:44.728565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:44.867295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:44.882674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:44.884283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:44.885091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ba31b8d9-02c9-43e3-a34b-6f7104e19fd5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:44.886163 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-495fc42b-ba9e-4bc2-bb58-5482f1a273ec tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.171986 Sep 02 10:15:44.886263 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ba31b8d9-02c9-43e3-a34b-6f7104e19fd5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:44.886972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1235/2545] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:44 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:44.892833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba31b8d9-02c9-43e3-a34b-6f7104e19fd5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:44.893329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba31b8d9-02c9-43e3-a34b-6f7104e19fd5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:44.893764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba31b8d9-02c9-43e3-a34b-6f7104e19fd5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:44.894466 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba31b8d9-02c9-43e3-a34b-6f7104e19fd5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:44.894944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba31b8d9-02c9-43e3-a34b-6f7104e19fd5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:44.895371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ba31b8d9-02c9-43e3-a34b-6f7104e19fd5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:44.966652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ba31b8d9-02c9-43e3-a34b-6f7104e19fd5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:44.975390 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ba31b8d9-02c9-43e3-a34b-6f7104e19fd5 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.094219 Sep 02 10:15:44.976042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1311/2546] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:44 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:45.910808 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:45.911449 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:45.918292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:45.918815 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:45.919336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:45.920210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:45.920666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:45.921087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:45.997911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2e76ec2e-b4c8-408e-a754-e6c3e3b15663 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:45.998430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2e76ec2e-b4c8-408e-a754-e6c3e3b15663 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:46.005259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e76ec2e-b4c8-408e-a754-e6c3e3b15663 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:46.005773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e76ec2e-b4c8-408e-a754-e6c3e3b15663 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:46.006214 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e76ec2e-b4c8-408e-a754-e6c3e3b15663 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:46.007038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e76ec2e-b4c8-408e-a754-e6c3e3b15663 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:46.007517 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e76ec2e-b4c8-408e-a754-e6c3e3b15663 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:46.007938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2e76ec2e-b4c8-408e-a754-e6c3e3b15663 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:46.071378 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:46.083357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:46.083955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2e76ec2e-b4c8-408e-a754-e6c3e3b15663 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:46.085276 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:46.086474 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a84d376d-64cf-4faf-9c8f-682ab7d925b9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.180745 Sep 02 10:15:46.087399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1236/2547] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:45 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:46.094140 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2e76ec2e-b4c8-408e-a754-e6c3e3b15663 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.100614 Sep 02 10:15:46.098016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1312/2548] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:45 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:15:47.110027 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:47.110638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:47.115653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-aad341b5-3284-4c81-b40b-cceba74b0584 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:47.116814 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-aad341b5-3284-4c81-b40b-cceba74b0584 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:47.124581 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aad341b5-3284-4c81-b40b-cceba74b0584 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:47.125080 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aad341b5-3284-4c81-b40b-cceba74b0584 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:47.125753 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aad341b5-3284-4c81-b40b-cceba74b0584 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:47.126816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:47.126951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aad341b5-3284-4c81-b40b-cceba74b0584 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:47.127353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:47.127464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aad341b5-3284-4c81-b40b-cceba74b0584 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:47.127863 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:47.127979 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-aad341b5-3284-4c81-b40b-cceba74b0584 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:47.128614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:47.129072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:47.129504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:47.153022 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:47.197222 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-aad341b5-3284-4c81-b40b-cceba74b0584 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:47.206105 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-aad341b5-3284-4c81-b40b-cceba74b0584 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.094257 Sep 02 10:15:47.220632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1313/2549] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:47 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:47.328143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:47.337097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:47.339196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:47.340455 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-445a3bf6-7770-45e4-a9da-fb75c966b30b tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.234336 Sep 02 10:15:47.342812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1237/2550] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:47 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:48.226472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-210e41f4-96da-4219-adc5-5181d5d1d4ea tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:48.227187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-210e41f4-96da-4219-adc5-5181d5d1d4ea tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:48.234328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-210e41f4-96da-4219-adc5-5181d5d1d4ea tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:48.234942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-210e41f4-96da-4219-adc5-5181d5d1d4ea tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:48.235361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-210e41f4-96da-4219-adc5-5181d5d1d4ea tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:48.236040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-210e41f4-96da-4219-adc5-5181d5d1d4ea tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:48.236488 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-210e41f4-96da-4219-adc5-5181d5d1d4ea tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:48.236905 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-210e41f4-96da-4219-adc5-5181d5d1d4ea tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:48.298122 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-210e41f4-96da-4219-adc5-5181d5d1d4ea tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:48.305957 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-210e41f4-96da-4219-adc5-5181d5d1d4ea tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.083462 Sep 02 10:15:48.306525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1314/2551] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:48 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:48.364966 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:48.365577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:48.372697 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:48.373210 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:48.373650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:48.374334 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:48.374824 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:48.375253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:48.500535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:48.508560 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:48.510032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:48.511281 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9c66fde2-7c4c-4444-a76c-b6ae9e754822 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.150199 Sep 02 10:15:48.511853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1238/2552] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:48 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:49.327397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-7a8eb46f-21e8-4cb8-8dd4-1981adddfc0f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:49.328027 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-7a8eb46f-21e8-4cb8-8dd4-1981adddfc0f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:49.334331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a8eb46f-21e8-4cb8-8dd4-1981adddfc0f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:49.334844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a8eb46f-21e8-4cb8-8dd4-1981adddfc0f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:49.335277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a8eb46f-21e8-4cb8-8dd4-1981adddfc0f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:49.335952 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a8eb46f-21e8-4cb8-8dd4-1981adddfc0f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:49.336405 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a8eb46f-21e8-4cb8-8dd4-1981adddfc0f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:49.336823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-7a8eb46f-21e8-4cb8-8dd4-1981adddfc0f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:49.397665 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-7a8eb46f-21e8-4cb8-8dd4-1981adddfc0f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:49.405781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-7a8eb46f-21e8-4cb8-8dd4-1981adddfc0f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.082790 Sep 02 10:15:49.406341 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1315/2553] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:49 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:49.533949 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:49.534547 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:49.540922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:49.541403 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:49.541829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:49.542503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:49.542976 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:49.543399 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:49.671659 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:49.679664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:49.681097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:49.682753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8b9fd8b2-9356-48bb-9403-00c0d0761373 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.152323 Sep 02 10:15:49.683306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1239/2554] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:49 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:50.426310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fd13ad58-ecb1-4f82-aeb3-13a7a2b54194 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:50.426945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fd13ad58-ecb1-4f82-aeb3-13a7a2b54194 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:50.433292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd13ad58-ecb1-4f82-aeb3-13a7a2b54194 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:50.433774 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd13ad58-ecb1-4f82-aeb3-13a7a2b54194 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:50.434208 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd13ad58-ecb1-4f82-aeb3-13a7a2b54194 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:50.434910 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd13ad58-ecb1-4f82-aeb3-13a7a2b54194 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:50.435359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd13ad58-ecb1-4f82-aeb3-13a7a2b54194 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:50.435779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fd13ad58-ecb1-4f82-aeb3-13a7a2b54194 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:50.500680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fd13ad58-ecb1-4f82-aeb3-13a7a2b54194 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:50.508811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fd13ad58-ecb1-4f82-aeb3-13a7a2b54194 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.086394 Sep 02 10:15:50.509369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1316/2555] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:50 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:50.706558 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:50.707197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:50.714214 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:50.714724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:50.715157 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:50.715836 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:50.716338 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:50.716759 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:50.841290 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:50.849591 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:50.851071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:50.852496 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8fedda81-f65a-4c81-8809-8194365201a4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.149634 Sep 02 10:15:50.853046 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1240/2556] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:50 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:51.529543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-faf72851-acf7-436a-ad17-a6dc660931a9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:51.530062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-faf72851-acf7-436a-ad17-a6dc660931a9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:51.536544 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-faf72851-acf7-436a-ad17-a6dc660931a9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:51.537024 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-faf72851-acf7-436a-ad17-a6dc660931a9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:51.537484 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-faf72851-acf7-436a-ad17-a6dc660931a9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:51.538160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-faf72851-acf7-436a-ad17-a6dc660931a9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:51.538609 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-faf72851-acf7-436a-ad17-a6dc660931a9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:51.539057 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-faf72851-acf7-436a-ad17-a6dc660931a9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:51.598747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-faf72851-acf7-436a-ad17-a6dc660931a9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:51.606966 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-faf72851-acf7-436a-ad17-a6dc660931a9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.081362 Sep 02 10:15:51.607531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1317/2557] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:51 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:51.875123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:51.875735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:51.882397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:51.882964 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:51.883402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:51.884087 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:51.884537 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:51.884957 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:52.014972 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:52.023072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:52.026365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:52.026365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4fb687b9-eb04-4166-820a-8b5084a4a5d8 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.154454 Sep 02 10:15:52.026814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1241/2558] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:51 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:52.629700 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d0a43668-e8a0-4826-9e03-52dcd42c27c4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:52.651695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d0a43668-e8a0-4826-9e03-52dcd42c27c4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:52.651695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0a43668-e8a0-4826-9e03-52dcd42c27c4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:52.651695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0a43668-e8a0-4826-9e03-52dcd42c27c4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:52.651695 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0a43668-e8a0-4826-9e03-52dcd42c27c4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:52.652154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0a43668-e8a0-4826-9e03-52dcd42c27c4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:52.652154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0a43668-e8a0-4826-9e03-52dcd42c27c4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:52.652154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0a43668-e8a0-4826-9e03-52dcd42c27c4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:52.704675 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d0a43668-e8a0-4826-9e03-52dcd42c27c4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:52.712294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d0a43668-e8a0-4826-9e03-52dcd42c27c4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.086583 Sep 02 10:15:52.712859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1318/2559] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:52 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:53.050005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:53.050605 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:53.052460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:53.053183 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:53.059248 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:53.059727 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:53.060159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:53.060831 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:53.061279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:53.061734 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:53.189335 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:53.197460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:53.201552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:53.201552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6c3c2927-e7f3-4051-bf01-ce0db67c5e73 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.154709 Sep 02 10:15:53.201552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1242/2560] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:53 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:53.733486 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-28b092d2-f89b-49ed-873c-86ac810aaeca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:53.734096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-28b092d2-f89b-49ed-873c-86ac810aaeca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:53.735959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=6 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:15:53.741380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28b092d2-f89b-49ed-873c-86ac810aaeca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:53.741859 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28b092d2-f89b-49ed-873c-86ac810aaeca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:53.742296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28b092d2-f89b-49ed-873c-86ac810aaeca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:53.743031 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28b092d2-f89b-49ed-873c-86ac810aaeca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:53.743480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28b092d2-f89b-49ed-873c-86ac810aaeca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:53.743902 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-28b092d2-f89b-49ed-873c-86ac810aaeca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:53.803415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-28b092d2-f89b-49ed-873c-86ac810aaeca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:53.811508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-28b092d2-f89b-49ed-873c-86ac810aaeca tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.082505 Sep 02 10:15:53.818198 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1319/2561] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:53 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:54.224258 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:54.224857 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:54.231853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:54.232323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:54.232749 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:54.233415 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:54.233862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:54.234277 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:54.364013 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:54.372661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:54.374079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:54.375250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-af4673be-e5ce-4d62-a188-fcce319fad19 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.155565 Sep 02 10:15:54.375822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1243/2562] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:54 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:54.832669 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a75a7ee7-2554-47a5-881a-5f1586507dd8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:54.833301 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-a75a7ee7-2554-47a5-881a-5f1586507dd8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:54.840809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a75a7ee7-2554-47a5-881a-5f1586507dd8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:54.841107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a75a7ee7-2554-47a5-881a-5f1586507dd8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:54.841543 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a75a7ee7-2554-47a5-881a-5f1586507dd8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:54.842234 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a75a7ee7-2554-47a5-881a-5f1586507dd8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:54.843137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a75a7ee7-2554-47a5-881a-5f1586507dd8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:54.843137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-a75a7ee7-2554-47a5-881a-5f1586507dd8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:54.908143 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-a75a7ee7-2554-47a5-881a-5f1586507dd8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:54.915773 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a75a7ee7-2554-47a5-881a-5f1586507dd8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.086977 Sep 02 10:15:54.916337 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1320/2563] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:54 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:55.398002 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:55.398610 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:55.405503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:55.405990 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:55.406425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:55.407141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:55.407594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:55.408019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:55.535521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:55.544209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:55.545658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:55.546867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8ee4194c-996b-4e19-9a81-9f2e57f73d11 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.152761 Sep 02 10:15:55.547423 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1244/2564] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:55 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:55.936851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f3f53c58-e261-4013-be91-27660d5e7686 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:55.937465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f3f53c58-e261-4013-be91-27660d5e7686 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:55.943848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3f53c58-e261-4013-be91-27660d5e7686 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:55.944333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3f53c58-e261-4013-be91-27660d5e7686 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:55.944775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3f53c58-e261-4013-be91-27660d5e7686 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:55.945485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3f53c58-e261-4013-be91-27660d5e7686 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:55.945941 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3f53c58-e261-4013-be91-27660d5e7686 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:55.946363 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f3f53c58-e261-4013-be91-27660d5e7686 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:56.007255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-f3f53c58-e261-4013-be91-27660d5e7686 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:56.015424 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f3f53c58-e261-4013-be91-27660d5e7686 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.082395 Sep 02 10:15:56.015987 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1321/2565] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:55 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:56.569089 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:56.569696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:56.576109 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:56.576590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:56.577025 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:56.577702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:56.578153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:56.578572 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:56.703768 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:56.711867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:56.713300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:56.714485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d1b006ea-4341-485a-8399-7cc8be43d9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.149382 Sep 02 10:15:56.715067 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1245/2566] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:56 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:57.036951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1878aaad-9573-400d-91b2-95ea91b3722a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:57.037512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-1878aaad-9573-400d-91b2-95ea91b3722a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:57.044567 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1878aaad-9573-400d-91b2-95ea91b3722a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:57.045042 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1878aaad-9573-400d-91b2-95ea91b3722a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:57.045474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1878aaad-9573-400d-91b2-95ea91b3722a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:57.046145 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1878aaad-9573-400d-91b2-95ea91b3722a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:57.046592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1878aaad-9573-400d-91b2-95ea91b3722a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:57.047038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-1878aaad-9573-400d-91b2-95ea91b3722a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:57.108807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-1878aaad-9573-400d-91b2-95ea91b3722a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:57.116251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1878aaad-9573-400d-91b2-95ea91b3722a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.083258 Sep 02 10:15:57.116824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1322/2567] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:57 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:57.738848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:57.739450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:57.746266 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:57.746760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:57.747191 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:57.747859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:57.748337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:57.748754 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:57.878357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:57.887141 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:57.888589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:57.889740 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-81c45f37-43b3-455a-82b4-3b95f57e4f80 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.154817 Sep 02 10:15:57.890296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1246/2568] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:57 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:58.136681 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-35a905ad-4cba-49a5-afbd-45b523d55a0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:58.137290 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-35a905ad-4cba-49a5-afbd-45b523d55a0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:58.143912 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35a905ad-4cba-49a5-afbd-45b523d55a0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:58.144399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35a905ad-4cba-49a5-afbd-45b523d55a0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:58.144841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35a905ad-4cba-49a5-afbd-45b523d55a0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:58.145532 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35a905ad-4cba-49a5-afbd-45b523d55a0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:58.145990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35a905ad-4cba-49a5-afbd-45b523d55a0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:58.146420 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-35a905ad-4cba-49a5-afbd-45b523d55a0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:58.206549 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-35a905ad-4cba-49a5-afbd-45b523d55a0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:58.214146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-35a905ad-4cba-49a5-afbd-45b523d55a0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1244 microversion: 2.1 time: 0.081339 Sep 02 10:15:58.214725 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1323/2569] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:58 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:15:58.912568 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:58.913110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:58.919599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:58.920085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:58.920524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:58.921203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:58.921656 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:58.922080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:59.050140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:59.058224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:59.060180 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:59.061327 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fb376cd2-35ea-49a8-a208-838d0d355110 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.152793 Sep 02 10:15:59.061900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1247/2570] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:15:58 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:15:59.234688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-466238e5-cd33-42de-a001-92a5999bf9c9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:15:59.235352 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-466238e5-cd33-42de-a001-92a5999bf9c9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:15:59.241890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-466238e5-cd33-42de-a001-92a5999bf9c9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:59.242449 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-466238e5-cd33-42de-a001-92a5999bf9c9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:59.242920 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-466238e5-cd33-42de-a001-92a5999bf9c9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:59.243618 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-466238e5-cd33-42de-a001-92a5999bf9c9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:15:59.244075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-466238e5-cd33-42de-a001-92a5999bf9c9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:15:59.244519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-466238e5-cd33-42de-a001-92a5999bf9c9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:15:59.314100 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-466238e5-cd33-42de-a001-92a5999bf9c9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:15:59.328007 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-466238e5-cd33-42de-a001-92a5999bf9c9 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1300 microversion: 2.1 time: 0.097129 Sep 02 10:15:59.328849 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1324/2571] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:15:59 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:16:00.085401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:00.086570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:00.093877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:00.094596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:00.095068 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:00.095766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:00.096221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:00.096647 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:00.319864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:00.329142 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:00.330908 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:00.331802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b5f57472-8983-4225-a94f-2f884d015d02 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.250747 Sep 02 10:16:00.332521 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1248/2572] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:16:00 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:16:00.352462 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2f119032-d9a3-4c4f-a4de-82ded77e500d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:00.353722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2f119032-d9a3-4c4f-a4de-82ded77e500d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:00.360373 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f119032-d9a3-4c4f-a4de-82ded77e500d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:00.360999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f119032-d9a3-4c4f-a4de-82ded77e500d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:00.361441 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f119032-d9a3-4c4f-a4de-82ded77e500d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:00.362146 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f119032-d9a3-4c4f-a4de-82ded77e500d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:00.362632 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f119032-d9a3-4c4f-a4de-82ded77e500d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:00.363107 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2f119032-d9a3-4c4f-a4de-82ded77e500d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:00.505524 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-2f119032-d9a3-4c4f-a4de-82ded77e500d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:00.515944 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2f119032-d9a3-4c4f-a4de-82ded77e500d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1365 microversion: 2.1 time: 0.167551 Sep 02 10:16:00.516521 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1325/2573] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:16:00 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:16:01.142005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-124a2237-b7ec-4f02-84e2-6d2d9de7f14f req-9baab8b1-420f-4566-811e-3a74ed43e152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a894746b-15c0-48aa-8543-39baf7860971", "tag": "24c08ecc-05f6-4618-af75-9244495b939d"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:16:01.152055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-124a2237-b7ec-4f02-84e2-6d2d9de7f14f req-9baab8b1-420f-4566-811e-3a74ed43e152 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:01.152527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-124a2237-b7ec-4f02-84e2-6d2d9de7f14f req-9baab8b1-420f-4566-811e-3a74ed43e152 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:01.153031 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-124a2237-b7ec-4f02-84e2-6d2d9de7f14f req-9baab8b1-420f-4566-811e-3a74ed43e152 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:01.164154 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-124a2237-b7ec-4f02-84e2-6d2d9de7f14f req-9baab8b1-420f-4566-811e-3a74ed43e152 service nova] Creating event network-changed:24c08ecc-05f6-4618-af75-9244495b939d for instance a894746b-15c0-48aa-8543-39baf7860971 on hv-cinder-85083 Sep 02 10:16:01.169236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-124a2237-b7ec-4f02-84e2-6d2d9de7f14f req-9baab8b1-420f-4566-811e-3a74ed43e152 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031046 Sep 02 10:16:01.169986 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1249/2574] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:16:01.360148 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:01.360789 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:01.367383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:01.367864 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:01.368298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:01.368981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:01.369459 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:01.369891 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:01.503927 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:01.512063 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:01.513598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:01.514808 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0ed44fbf-b160-4ccc-bced-647c7dbf169d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.159066 Sep 02 10:16:01.515374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1326/2575] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:16:01 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:16:01.539017 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-035a7bfa-c247-4a05-aa4b-b1bd81b28574 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:01.539666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-035a7bfa-c247-4a05-aa4b-b1bd81b28574 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:01.546313 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-035a7bfa-c247-4a05-aa4b-b1bd81b28574 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:01.546818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-035a7bfa-c247-4a05-aa4b-b1bd81b28574 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:01.547253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-035a7bfa-c247-4a05-aa4b-b1bd81b28574 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:01.547930 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-035a7bfa-c247-4a05-aa4b-b1bd81b28574 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:01.548376 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-035a7bfa-c247-4a05-aa4b-b1bd81b28574 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:01.548792 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-035a7bfa-c247-4a05-aa4b-b1bd81b28574 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:01.553170 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=100 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:16:01.756291 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-035a7bfa-c247-4a05-aa4b-b1bd81b28574 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:01.764503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-035a7bfa-c247-4a05-aa4b-b1bd81b28574 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1365 microversion: 2.1 time: 0.230448 Sep 02 10:16:01.765158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1250/2576] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:16:01 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:16:02.220662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-d7b5d7b9-2ae5-4ded-88a3-e4155094e1bc req-fbbabf74-023e-41eb-b73f-86d2161c7819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1922d53-bdcd-4824-aca7-31b78f883be0", "name": "network-vif-plugged", "status": "completed", "tag": "0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:16:02.230296 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-d7b5d7b9-2ae5-4ded-88a3-e4155094e1bc req-fbbabf74-023e-41eb-b73f-86d2161c7819 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:02.230793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-d7b5d7b9-2ae5-4ded-88a3-e4155094e1bc req-fbbabf74-023e-41eb-b73f-86d2161c7819 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:02.231226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-d7b5d7b9-2ae5-4ded-88a3-e4155094e1bc req-fbbabf74-023e-41eb-b73f-86d2161c7819 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:02.241862 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-d7b5d7b9-2ae5-4ded-88a3-e4155094e1bc req-fbbabf74-023e-41eb-b73f-86d2161c7819 service nova] Creating event network-vif-plugged:0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569 for instance a1922d53-bdcd-4824-aca7-31b78f883be0 on hv-cinder-85083 Sep 02 10:16:02.246868 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-d7b5d7b9-2ae5-4ded-88a3-e4155094e1bc req-fbbabf74-023e-41eb-b73f-86d2161c7819 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029814 Sep 02 10:16:02.247444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1327/2577] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:16:02.538553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:02.539178 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:02.545705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:02.546158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:02.546575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:02.547272 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:02.547716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:02.548130 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:02.675506 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:02.683790 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:02.685236 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:02.687042 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-77575310-c1a8-478b-9e2c-79be5bf1d464 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.152400 Sep 02 10:16:02.687604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1251/2578] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:16:02 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:16:02.786837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4b016ffc-92f0-4379-b7c8-face8695a0c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:02.787463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4b016ffc-92f0-4379-b7c8-face8695a0c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:02.793534 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b016ffc-92f0-4379-b7c8-face8695a0c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:02.794020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b016ffc-92f0-4379-b7c8-face8695a0c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:02.794458 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b016ffc-92f0-4379-b7c8-face8695a0c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:02.795175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b016ffc-92f0-4379-b7c8-face8695a0c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:02.796174 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b016ffc-92f0-4379-b7c8-face8695a0c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:02.796628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b016ffc-92f0-4379-b7c8-face8695a0c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:02.924555 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4b016ffc-92f0-4379-b7c8-face8695a0c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:02.931526 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4b016ffc-92f0-4379-b7c8-face8695a0c8 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1365 microversion: 2.1 time: 0.149803 Sep 02 10:16:02.932086 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1328/2579] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:16:02 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:16:03.709555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:03.710158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:03.712504 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:16:03.717205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:03.717688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:03.718121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:03.719250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:03.719716 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:03.720143 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:03.847945 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:03.856288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:03.858043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:03.859240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a102041d-f353-4eb9-9940-4268d6dbb773 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.153665 Sep 02 10:16:03.859805 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1252/2580] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:16:03 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:16:03.952426 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8b9f59e9-e49a-4931-837c-bb021a7bce0d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:03.953034 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8b9f59e9-e49a-4931-837c-bb021a7bce0d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:03.955644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:16:03.966869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b9f59e9-e49a-4931-837c-bb021a7bce0d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:03.966869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b9f59e9-e49a-4931-837c-bb021a7bce0d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:03.966869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b9f59e9-e49a-4931-837c-bb021a7bce0d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:03.966869 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b9f59e9-e49a-4931-837c-bb021a7bce0d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:03.967253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b9f59e9-e49a-4931-837c-bb021a7bce0d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:03.967253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8b9f59e9-e49a-4931-837c-bb021a7bce0d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:04.092369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8b9f59e9-e49a-4931-837c-bb021a7bce0d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:04.100084 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8b9f59e9-e49a-4931-837c-bb021a7bce0d tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1365 microversion: 2.1 time: 0.151485 Sep 02 10:16:04.102848 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1329/2581] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:16:03 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:16:04.882676 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:04.883305 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:04.890362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:04.890865 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:04.891300 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:04.891973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:04.892424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:04.892840 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:05.019302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:05.027370 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:05.028830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:05.030611 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-df388538-0f25-4d88-b0e9-9460c7025258 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.151875 Sep 02 10:16:05.031205 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1253/2582] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:16:04 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:16:05.121238 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-6d6d8ce3-4eb5-446d-8e5f-50f1e6a5c547 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:05.121792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-6d6d8ce3-4eb5-446d-8e5f-50f1e6a5c547 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:05.128781 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d6d8ce3-4eb5-446d-8e5f-50f1e6a5c547 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:05.129271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d6d8ce3-4eb5-446d-8e5f-50f1e6a5c547 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:05.129716 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d6d8ce3-4eb5-446d-8e5f-50f1e6a5c547 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:05.130406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d6d8ce3-4eb5-446d-8e5f-50f1e6a5c547 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:05.130895 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d6d8ce3-4eb5-446d-8e5f-50f1e6a5c547 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:05.131327 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-6d6d8ce3-4eb5-446d-8e5f-50f1e6a5c547 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:05.496800 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-6d6d8ce3-4eb5-446d-8e5f-50f1e6a5c547 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:05.499652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=100 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:16:05.505724 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-6d6d8ce3-4eb5-446d-8e5f-50f1e6a5c547 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1365 microversion: 2.1 time: 0.388370 Sep 02 10:16:05.506293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1330/2583] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:16:05 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1365 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:16:06.053599 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:06.054244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:06.061174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:06.061666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:06.062108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:06.062837 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:06.063298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:06.063732 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:06.196037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:06.204310 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:06.207892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:06.207892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8ae73e70-c515-4522-8b52-def0406f8089 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.157398 Sep 02 10:16:06.207892 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1254/2584] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:16:06 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:16:06.525276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3faa1d59-def8-4a08-b6be-4ae91ca96f56 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:06.525917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3faa1d59-def8-4a08-b6be-4ae91ca96f56 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:06.533557 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3faa1d59-def8-4a08-b6be-4ae91ca96f56 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:06.534048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3faa1d59-def8-4a08-b6be-4ae91ca96f56 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:06.534542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3faa1d59-def8-4a08-b6be-4ae91ca96f56 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:06.535267 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3faa1d59-def8-4a08-b6be-4ae91ca96f56 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:06.535803 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3faa1d59-def8-4a08-b6be-4ae91ca96f56 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:06.536226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3faa1d59-def8-4a08-b6be-4ae91ca96f56 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:06.725403 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3faa1d59-def8-4a08-b6be-4ae91ca96f56 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:06.734032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3faa1d59-def8-4a08-b6be-4ae91ca96f56 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1365 microversion: 2.1 time: 0.211977 Sep 02 10:16:06.734606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1331/2585] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:16:06 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:16:07.229819 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:07.230384 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:07.237108 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:07.237596 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:07.238037 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:07.238744 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:07.239201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:07.239628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:07.411751 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:07.420167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:07.422473 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:07.423701 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-be1d6058-e914-4371-b528-59f66ad49744 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1729 microversion: 2.20 time: 0.198260 Sep 02 10:16:07.424271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1255/2586] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:16:07 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:16:07.753863 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d0f01cc4-de36-4993-b562-90f47aae2e8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:07.754503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d0f01cc4-de36-4993-b562-90f47aae2e8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:07.761097 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0f01cc4-de36-4993-b562-90f47aae2e8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:07.761580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0f01cc4-de36-4993-b562-90f47aae2e8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:07.762023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0f01cc4-de36-4993-b562-90f47aae2e8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:07.762726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0f01cc4-de36-4993-b562-90f47aae2e8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:07.763179 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0f01cc4-de36-4993-b562-90f47aae2e8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:07.763605 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0f01cc4-de36-4993-b562-90f47aae2e8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:07.896434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-d0f01cc4-de36-4993-b562-90f47aae2e8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:07.903988 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d0f01cc4-de36-4993-b562-90f47aae2e8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1365 microversion: 2.1 time: 0.154023 Sep 02 10:16:07.904556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1332/2587] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:16:07 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:16:08.276402 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-d02c8270-5085-42d3-8d60-a687f5766753 req-c94f394a-2a2a-46c6-aa4a-886988400c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a894746b-15c0-48aa-8543-39baf7860971", "name": "network-vif-plugged", "status": "completed", "tag": "24c08ecc-05f6-4618-af75-9244495b939d"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:16:08.286503 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d02c8270-5085-42d3-8d60-a687f5766753 req-c94f394a-2a2a-46c6-aa4a-886988400c9d service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:08.287085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d02c8270-5085-42d3-8d60-a687f5766753 req-c94f394a-2a2a-46c6-aa4a-886988400c9d service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:08.287518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d02c8270-5085-42d3-8d60-a687f5766753 req-c94f394a-2a2a-46c6-aa4a-886988400c9d service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:08.298561 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-d02c8270-5085-42d3-8d60-a687f5766753 req-c94f394a-2a2a-46c6-aa4a-886988400c9d service nova] Creating event network-vif-plugged:24c08ecc-05f6-4618-af75-9244495b939d for instance a894746b-15c0-48aa-8543-39baf7860971 on hv-cinder-85083 Sep 02 10:16:08.303823 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-d02c8270-5085-42d3-8d60-a687f5766753 req-c94f394a-2a2a-46c6-aa4a-886988400c9d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031117 Sep 02 10:16:08.304500 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1256/2588] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:16:08.446938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:08.447476 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:08.453588 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:08.454062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:08.454494 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:08.455207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:08.455925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:08.456353 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:08.582172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:08.590374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:08.591877 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:08.593011 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5ba112f0-efb3-4b1c-b99b-e2760803862d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1716 microversion: 2.20 time: 0.150406 Sep 02 10:16:08.593564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1333/2589] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:16:08 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:16:08.925984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dcb36468-300c-4042-9cb1-6c92d05b128b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:08.926678 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dcb36468-300c-4042-9cb1-6c92d05b128b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:08.932934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcb36468-300c-4042-9cb1-6c92d05b128b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:08.933413 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcb36468-300c-4042-9cb1-6c92d05b128b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:08.933848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcb36468-300c-4042-9cb1-6c92d05b128b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:08.934529 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcb36468-300c-4042-9cb1-6c92d05b128b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:08.935009 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcb36468-300c-4042-9cb1-6c92d05b128b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:08.935438 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dcb36468-300c-4042-9cb1-6c92d05b128b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:09.066873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dcb36468-300c-4042-9cb1-6c92d05b128b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:09.074514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dcb36468-300c-4042-9cb1-6c92d05b128b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1365 microversion: 2.1 time: 0.153413 Sep 02 10:16:09.075115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1257/2590] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:16:08 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:16:10.095177 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c8fabeda-5d50-4643-b68f-11769d8d3b01 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:10.095812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c8fabeda-5d50-4643-b68f-11769d8d3b01 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:10.102479 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8fabeda-5d50-4643-b68f-11769d8d3b01 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:10.102940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8fabeda-5d50-4643-b68f-11769d8d3b01 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:10.103374 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8fabeda-5d50-4643-b68f-11769d8d3b01 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:10.104081 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8fabeda-5d50-4643-b68f-11769d8d3b01 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:10.104539 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8fabeda-5d50-4643-b68f-11769d8d3b01 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:10.104950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c8fabeda-5d50-4643-b68f-11769d8d3b01 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:10.232844 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c8fabeda-5d50-4643-b68f-11769d8d3b01 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:10.240828 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c8fabeda-5d50-4643-b68f-11769d8d3b01 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1365 microversion: 2.1 time: 0.149518 Sep 02 10:16:10.241385 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1334/2591] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:16:10 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:16:11.261357 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-922c67e0-9fa2-4b29-bb8a-3c7fa05c29da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:11.261967 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-922c67e0-9fa2-4b29-bb8a-3c7fa05c29da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:11.268958 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-922c67e0-9fa2-4b29-bb8a-3c7fa05c29da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:11.269469 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-922c67e0-9fa2-4b29-bb8a-3c7fa05c29da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:11.269870 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-922c67e0-9fa2-4b29-bb8a-3c7fa05c29da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:11.274955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-922c67e0-9fa2-4b29-bb8a-3c7fa05c29da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:11.274955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-922c67e0-9fa2-4b29-bb8a-3c7fa05c29da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:11.274955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-922c67e0-9fa2-4b29-bb8a-3c7fa05c29da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:11.400575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-922c67e0-9fa2-4b29-bb8a-3c7fa05c29da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:16:11.408414 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-922c67e0-9fa2-4b29-bb8a-3c7fa05c29da tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1554 microversion: 2.1 time: 0.150911 Sep 02 10:16:11.408900 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1258/2592] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:16:11 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:16:11.428434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8203d238-4138-4103-8cab-3497f9bca009 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:16:11.428938 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8203d238-4138-4103-8cab-3497f9bca009 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:16:11.435228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8203d238-4138-4103-8cab-3497f9bca009 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:11.435705 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8203d238-4138-4103-8cab-3497f9bca009 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:11.436135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8203d238-4138-4103-8cab-3497f9bca009 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:11.437474 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8203d238-4138-4103-8cab-3497f9bca009 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:11.437922 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8203d238-4138-4103-8cab-3497f9bca009 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:11.438344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8203d238-4138-4103-8cab-3497f9bca009 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:11.513173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8203d238-4138-4103-8cab-3497f9bca009 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088482 Sep 02 10:16:11.513770 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1335/2593] 10.222.0.57 () {58 vars in 1275 bytes} [Fri Sep 2 10:16:11 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:16:12.601185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-3e30c3c5-2801-4732-8a7f-d54dd3d2dc22 req-801f763e-2b05-489b-a589-0fff65a9f41f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a894746b-15c0-48aa-8543-39baf7860971", "tag": "24c08ecc-05f6-4618-af75-9244495b939d"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:16:12.610735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-3e30c3c5-2801-4732-8a7f-d54dd3d2dc22 req-801f763e-2b05-489b-a589-0fff65a9f41f service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:16:12.611207 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-3e30c3c5-2801-4732-8a7f-d54dd3d2dc22 req-801f763e-2b05-489b-a589-0fff65a9f41f service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:16:12.611631 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-3e30c3c5-2801-4732-8a7f-d54dd3d2dc22 req-801f763e-2b05-489b-a589-0fff65a9f41f service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:16:12.624553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-3e30c3c5-2801-4732-8a7f-d54dd3d2dc22 req-801f763e-2b05-489b-a589-0fff65a9f41f service nova] Creating event network-changed:24c08ecc-05f6-4618-af75-9244495b939d for instance a894746b-15c0-48aa-8543-39baf7860971 on hv-cinder-85083 Sep 02 10:16:12.629666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-3e30c3c5-2801-4732-8a7f-d54dd3d2dc22 req-801f763e-2b05-489b-a589-0fff65a9f41f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086075 Sep 02 10:16:12.630486 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1259/2594] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:17:03.938147 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=13 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:17:03.939613 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=29 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:17:03.940621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:17:03.940767 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 10:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/os-volume_attachments (ip 10.222.0.57) !!! Sep 02 10:17:03.946731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0981bd11-22f0-4ab1-8364-1e0890440d2a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:03.948933 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0981bd11-22f0-4ab1-8364-1e0890440d2a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:03.955911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0981bd11-22f0-4ab1-8364-1e0890440d2a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:03.956392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0981bd11-22f0-4ab1-8364-1e0890440d2a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:03.956826 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0981bd11-22f0-4ab1-8364-1e0890440d2a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:03.957501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0981bd11-22f0-4ab1-8364-1e0890440d2a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:03.957945 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0981bd11-22f0-4ab1-8364-1e0890440d2a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:03.958365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0981bd11-22f0-4ab1-8364-1e0890440d2a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:03.988884 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0981bd11-22f0-4ab1-8364-1e0890440d2a tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052260 Sep 02 10:17:03.989429 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1336/2595] 10.222.0.57 () {60 vars in 1343 bytes} [Fri Sep 2 10:17:03 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:17:04.049052 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=15 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:17:04.049778 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=50 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:17:04.050793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:17:04.050938 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:17:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 (ip 10.222.0.57) !!! Sep 02 10:17:04.055765 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cf65abe7-938c-47a1-a7cb-e386e675beae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:04.059224 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cf65abe7-938c-47a1-a7cb-e386e675beae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:04.063405 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf65abe7-938c-47a1-a7cb-e386e675beae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:04.064419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf65abe7-938c-47a1-a7cb-e386e675beae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:04.064879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf65abe7-938c-47a1-a7cb-e386e675beae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:04.065555 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf65abe7-938c-47a1-a7cb-e386e675beae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:04.066004 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf65abe7-938c-47a1-a7cb-e386e675beae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:04.066419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cf65abe7-938c-47a1-a7cb-e386e675beae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:04.092026 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cf65abe7-938c-47a1-a7cb-e386e675beae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:17:04.395201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cf65abe7-938c-47a1-a7cb-e386e675beae tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 204 len: 0 microversion: 2.20 time: 0.348019 Sep 02 10:17:04.395786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1260/2596] 10.222.0.57 () {60 vars in 1280 bytes} [Fri Sep 2 10:17:04 2022] DELETE /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 10:17:04.404287 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:04.404924 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:04.411867 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:04.416389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:04.416389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:04.416389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:04.416389 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:04.416736 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:04.546162 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:04.554160 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:04.555661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:04.556806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b3ca5985-36c5-45c5-ac37-062b488542b7 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.156524 Sep 02 10:17:04.557366 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1337/2597] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:17:04 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 10:17:05.580569 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:05.581268 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:05.587670 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:05.588153 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:05.588589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:05.589271 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:05.589726 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:05.590149 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:05.724029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:05.732303 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:05.733741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:05.734922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8205e76e-8452-41e1-8abd-7f655463d3ca tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1722 microversion: 2.20 time: 0.158661 Sep 02 10:17:05.735479 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1261/2598] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:17:05 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:17:06.760032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:06.760654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:06.767890 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:06.768448 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:06.768887 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:06.769572 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:06.770166 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:06.770513 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:06.833640 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:06.841703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:06.843600 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:06.844764 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-309f0d74-2d4f-4f82-b467-1f1caeedf817 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1655 microversion: 2.20 time: 0.088686 Sep 02 10:17:06.845691 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1338/2599] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:17:06 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:17:07.013959 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-4b73a5a1-7bc7-452b-8d14-4f6085eaa523 req-9033f444-ab4d-4122-9edb-fb4d7cd3b65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1922d53-bdcd-4824-aca7-31b78f883be0", "name": "network-vif-deleted", "tag": "0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:17:07.024867 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-4b73a5a1-7bc7-452b-8d14-4f6085eaa523 req-9033f444-ab4d-4122-9edb-fb4d7cd3b65f service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:07.025666 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-4b73a5a1-7bc7-452b-8d14-4f6085eaa523 req-9033f444-ab4d-4122-9edb-fb4d7cd3b65f service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:07.026106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-4b73a5a1-7bc7-452b-8d14-4f6085eaa523 req-9033f444-ab4d-4122-9edb-fb4d7cd3b65f service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:07.037416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-4b73a5a1-7bc7-452b-8d14-4f6085eaa523 req-9033f444-ab4d-4122-9edb-fb4d7cd3b65f service nova] Creating event network-vif-deleted:0ff7e0a5-5f32-43fb-93c2-eb5ff0ad2569 for instance a1922d53-bdcd-4824-aca7-31b78f883be0 on hv-cinder-85083 Sep 02 10:17:07.042771 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-4b73a5a1-7bc7-452b-8d14-4f6085eaa523 req-9033f444-ab4d-4122-9edb-fb4d7cd3b65f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032514 Sep 02 10:17:07.043366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1262/2600] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:17:07.868235 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:07.868853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:07.875188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:07.875680 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:07.876120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:07.877416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:07.877866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:07.878292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:07.909478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:07.909957 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:07.910386 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:07.910852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lazy-loading 'fault' on Instance uuid a1922d53-bdcd-4824-aca7-31b78f883be0 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:17:07.951438 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:07.959434 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:07.960870 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf7d0cc498e94ba49f258c38a3c4c410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78a4f092ae254358b4e54190c2c4a1a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:07.962020 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-32b7b3de-24d0-4957-bcf2-34f70f4909c9 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 200 len: 1371 microversion: 2.20 time: 0.097962 Sep 02 10:17:07.962556 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1339/2601] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:17:07 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 10:17:08.987820 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:08.988633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:08.994969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:08.995450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:08.995881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:08.996580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:08.997029 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:08.997448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:09.010896 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] HTTP exception thrown: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Request method failure captured: Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 HTTP/1.1 Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdZNVk9NxIsm7g0skexQeuyohDafBp8jBxMuzPFhySsQx7WMGbCrUwoMD1n_ihuM06-8E7zy1lfzUyN3ps4koUk28fIQICoIW2bSwKFk7gsgl6wt85iaHmzbln4wAEyWHROQpBX1awrJLhZusWPYdfJhT0BvLYqiTgkg4O9aKvwnPiQ Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:17:09.012516 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_78a4f092ae254358b4e54190c2c4a1a1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: cf7d0cc498e94ba49f258c38a3c4c410 Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:09.013973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'a1922d53-bdcd-4824-aca7-31b78f883be0'} Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:09.014875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:09.015973 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:09.017520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Returning 404 to user: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:09.017520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5de49640-9fb5-456b-a97f-4c96b4dacf7f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 404 len: 111 microversion: 2.20 time: 0.031217 Sep 02 10:17:09.017520 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1263/2602] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:17:08 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 10:17:09.023255 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f7e425c6-414f-4eae-abdc-46af047f1f6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '.version_select at 0x7f4e5c54c9d0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:09.099167 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f7e425c6-414f-4eae-abdc-46af047f1f6d tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486978791" status: 204 len: 0 microversion: 2.20 time: 0.079504 Sep 02 10:17:09.099683 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1340/2603] 10.222.0.57 () {60 vars in 1259 bytes} [Fri Sep 2 10:17:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486978791 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 10:17:11.162602 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:11.163162 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:11.190570 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:11.191135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:11.191567 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:11.192349 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:11.192795 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:11.193262 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:11.207947 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] HTTP exception thrown: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Request method failure captured: Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 HTTP/1.1 Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdZNVk9NxIsm7g0skexQeuyohDafBp8jBxMuzPFhySsQx7WMGbCrUwoMD1n_ihuM06-8E7zy1lfzUyN3ps4koUk28fIQICoIW2bSwKFk7gsgl6wt85iaHmzbln4wAEyWHROQpBX1awrJLhZusWPYdfJhT0BvLYqiTgkg4O9aKvwnPiQ Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:17:11.209583 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_78a4f092ae254358b4e54190c2c4a1a1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: cf7d0cc498e94ba49f258c38a3c4c410 Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:11.210766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'a1922d53-bdcd-4824-aca7-31b78f883be0'} Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:11.211377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:11.213234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:11.214426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Returning 404 to user: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:11.214426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-af8371c2-6fc7-4dc1-b654-863183c0b9e4 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 404 len: 111 microversion: 2.20 time: 0.052431 Sep 02 10:17:11.214426 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1264/2604] 10.222.0.57 () {60 vars in 1280 bytes} [Fri Sep 2 10:17:11 2022] DELETE /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 02 10:17:11.221188 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:11.221874 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: a1922d53-bdcd-4824-aca7-31b78f883be0] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:11.228722 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:11.229203 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:11.229634 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:11.230312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:11.230783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:11.231207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:11.244885 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] HTTP exception thrown: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Request method failure captured: Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 HTTP/1.1 Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdZNVk9NxIsm7g0skexQeuyohDafBp8jBxMuzPFhySsQx7WMGbCrUwoMD1n_ihuM06-8E7zy1lfzUyN3ps4koUk28fIQICoIW2bSwKFk7gsgl6wt85iaHmzbln4wAEyWHROQpBX1awrJLhZusWPYdfJhT0BvLYqiTgkg4O9aKvwnPiQ Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:17:11.246512 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_78a4f092ae254358b4e54190c2c4a1a1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: cf7d0cc498e94ba49f258c38a3c4c410 Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:11.251359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': 'a1922d53-bdcd-4824-aca7-31b78f883be0'} Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:11.251974 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. Sep 02 10:17:11.252917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:11.253776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Returning 404 to user: Instance a1922d53-bdcd-4824-aca7-31b78f883be0 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:11.253776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-34c4db54-6860-4edf-9616-53f6065fd9aa tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0" status: 404 len: 111 microversion: 2.20 time: 0.031973 Sep 02 10:17:11.253776 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1341/2605] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:17:11 2022] GET /compute/v2.1/servers/a1922d53-bdcd-4824-aca7-31b78f883be0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 02 10:17:12.535447 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:12.535932 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:12.542355 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:12.542884 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:12.543320 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:12.544008 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:12.544461 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:12.544882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:12.558576 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] HTTP exception thrown: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Request method failure captured: Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 HTTP/1.1 Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdZNVk9NxIsm7g0skexQeuyohDafBp8jBxMuzPFhySsQx7WMGbCrUwoMD1n_ihuM06-8E7zy1lfzUyN3ps4koUk28fIQICoIW2bSwKFk7gsgl6wt85iaHmzbln4wAEyWHROQpBX1awrJLhZusWPYdfJhT0BvLYqiTgkg4O9aKvwnPiQ Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:17:12.560173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_78a4f092ae254358b4e54190c2c4a1a1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: cf7d0cc498e94ba49f258c38a3c4c410 Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:17:12.561475 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '7800ab6f-02d9-4d8f-a038-32b2676ec781'} Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:12.562115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:17:12.563144 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:12.564110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Returning 404 to user: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:12.564110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6bf210b1-c114-42c0-a8ed-63f58451b400 tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 404 len: 111 microversion: 2.20 time: 0.030519 Sep 02 10:17:12.564110 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1265/2606] 10.222.0.57 () {60 vars in 1280 bytes} [Fri Sep 2 10:17:12 2022] DELETE /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 10:17:12.570469 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:12.571135 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] [instance: 7800ab6f-02d9-4d8f-a038-32b2676ec781] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:12.577510 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:12.577989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:12.578421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:12.579128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:12.579841 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:12.580271 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:12.593416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] HTTP exception thrown: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Request method failure captured: Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 HTTP/1.1 Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdZNVk9NxIsm7g0skexQeuyohDafBp8jBxMuzPFhySsQx7WMGbCrUwoMD1n_ihuM06-8E7zy1lfzUyN3ps4koUk28fIQICoIW2bSwKFk7gsgl6wt85iaHmzbln4wAEyWHROQpBX1awrJLhZusWPYdfJhT0BvLYqiTgkg4O9aKvwnPiQ Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:17:12.595432 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/78a4f092ae254358b4e54190c2c4a1a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_78a4f092ae254358b4e54190c2c4a1a1", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 78a4f092ae254358b4e54190c2c4a1a1 Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-619468329 Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: cf7d0cc498e94ba49f258c38a3c4c410 Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeShelveTestJSON-619468329-project Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:17:12.596830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '7800ab6f-02d9-4d8f-a038-32b2676ec781'} Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:12.597580 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. Sep 02 10:17:12.598811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:12.600191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] Returning 404 to user: Instance 7800ab6f-02d9-4d8f-a038-32b2676ec781 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:12.600191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c0288585-afc2-4740-b707-7f371ad92e5f tempest-AttachVolumeShelveTestJSON-619468329 tempest-AttachVolumeShelveTestJSON-619468329-project] 10.222.0.57 "GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781" status: 404 len: 111 microversion: 2.20 time: 0.030603 Sep 02 10:17:12.600191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1342/2607] 10.222.0.57 () {60 vars in 1277 bytes} [Fri Sep 2 10:17:12 2022] GET /compute/v2.1/servers/7800ab6f-02d9-4d8f-a038-32b2676ec781 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 10:17:26.504578 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b6b48444-32bd-41b0-ae3c-664e9cfb9580 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:26.505159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b6b48444-32bd-41b0-ae3c-664e9cfb9580 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:26.507638 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:17:26.509789 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:17:26.513100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b48444-32bd-41b0-ae3c-664e9cfb9580 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:26.513575 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b48444-32bd-41b0-ae3c-664e9cfb9580 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:26.514034 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b48444-32bd-41b0-ae3c-664e9cfb9580 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:26.514724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b48444-32bd-41b0-ae3c-664e9cfb9580 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:26.515177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b48444-32bd-41b0-ae3c-664e9cfb9580 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:26.515592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b6b48444-32bd-41b0-ae3c-664e9cfb9580 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:26.542238 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b6b48444-32bd-41b0-ae3c-664e9cfb9580 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/ips" status: 200 len: 149 microversion: 2.1 time: 0.041637 Sep 02 10:17:26.542853 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1266/2608] 10.222.0.57 () {58 vars in 1248 bytes} [Fri Sep 2 10:17:26 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:17:29.330569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2c9689dc-89d5-4cb6-8985-a123896896e7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0195ce6-468b-4c9f-89a4-2cec3f205b2e"}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:17:29.332991 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2c9689dc-89d5-4cb6-8985-a123896896e7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:29.335615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:17:29.336278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=30 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:17:29.341336 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c9689dc-89d5-4cb6-8985-a123896896e7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:29.341888 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c9689dc-89d5-4cb6-8985-a123896896e7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:29.342331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c9689dc-89d5-4cb6-8985-a123896896e7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:29.343061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c9689dc-89d5-4cb6-8985-a123896896e7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:29.350172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c9689dc-89d5-4cb6-8985-a123896896e7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:29.350172 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2c9689dc-89d5-4cb6-8985-a123896896e7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:30.147531 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2c9689dc-89d5-4cb6-8985-a123896896e7 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "POST /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821584 Sep 02 10:17:30.148136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1343/2609] 10.222.0.57 () {60 vars in 1323 bytes} [Fri Sep 2 10:17:29 2022] POST /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-volume_attachments => generated 194 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:17:37.773676 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-cb812060-4bf7-4dd5-875e-fb41123d1ffb tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:37.774155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-cb812060-4bf7-4dd5-875e-fb41123d1ffb tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:37.781215 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb812060-4bf7-4dd5-875e-fb41123d1ffb tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:37.781689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb812060-4bf7-4dd5-875e-fb41123d1ffb tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:37.782150 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb812060-4bf7-4dd5-875e-fb41123d1ffb tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:37.788080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb812060-4bf7-4dd5-875e-fb41123d1ffb tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:37.788080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb812060-4bf7-4dd5-875e-fb41123d1ffb tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:37.788080 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-cb812060-4bf7-4dd5-875e-fb41123d1ffb tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:37.865984 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.objects.instance [None req-cb812060-4bf7-4dd5-875e-fb41123d1ffb tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lazy-loading 'services' on Instance uuid a894746b-15c0-48aa-8543-39baf7860971 {{(pid=127531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:17:38.125244 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-cb812060-4bf7-4dd5-875e-fb41123d1ffb tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-volume_attachments/e0195ce6-468b-4c9f-89a4-2cec3f205b2e" status: 202 len: 0 microversion: 2.1 time: 0.355868 Sep 02 10:17:38.125856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1267/2610] 10.222.0.57 () {58 vars in 1416 bytes} [Fri Sep 2 10:17:37 2022] DELETE /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-volume_attachments/e0195ce6-468b-4c9f-89a4-2cec3f205b2e => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:17:38.135361 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b7278a98-58e5-432a-9a8a-7c3f48861f5a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:38.137670 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b7278a98-58e5-432a-9a8a-7c3f48861f5a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:38.144071 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7278a98-58e5-432a-9a8a-7c3f48861f5a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:38.144372 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7278a98-58e5-432a-9a8a-7c3f48861f5a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:38.144806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7278a98-58e5-432a-9a8a-7c3f48861f5a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:38.145493 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7278a98-58e5-432a-9a8a-7c3f48861f5a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:38.145939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7278a98-58e5-432a-9a8a-7c3f48861f5a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:38.146356 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b7278a98-58e5-432a-9a8a-7c3f48861f5a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:38.178530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b7278a98-58e5-432a-9a8a-7c3f48861f5a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047994 Sep 02 10:17:38.179248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1344/2611] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:17:38 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:17:39.192838 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-11f1d03e-5748-4035-a24d-3093bb512484 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:39.195135 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-11f1d03e-5748-4035-a24d-3093bb512484 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:39.201814 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f1d03e-5748-4035-a24d-3093bb512484 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:39.202293 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f1d03e-5748-4035-a24d-3093bb512484 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:39.202745 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f1d03e-5748-4035-a24d-3093bb512484 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:39.203429 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f1d03e-5748-4035-a24d-3093bb512484 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:39.203879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f1d03e-5748-4035-a24d-3093bb512484 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:39.204315 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-11f1d03e-5748-4035-a24d-3093bb512484 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:39.235707 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-11f1d03e-5748-4035-a24d-3093bb512484 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048370 Sep 02 10:17:39.236263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1268/2612] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:17:39 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:17:40.259630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-df19e8ee-7db1-4aab-9ba4-f85943ed6ee4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:40.261797 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-df19e8ee-7db1-4aab-9ba4-f85943ed6ee4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:40.268951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df19e8ee-7db1-4aab-9ba4-f85943ed6ee4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:40.269431 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df19e8ee-7db1-4aab-9ba4-f85943ed6ee4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:40.269866 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df19e8ee-7db1-4aab-9ba4-f85943ed6ee4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:40.270554 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df19e8ee-7db1-4aab-9ba4-f85943ed6ee4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:40.271029 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df19e8ee-7db1-4aab-9ba4-f85943ed6ee4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:40.271456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-df19e8ee-7db1-4aab-9ba4-f85943ed6ee4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:40.300421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-df19e8ee-7db1-4aab-9ba4-f85943ed6ee4 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044684 Sep 02 10:17:40.301321 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1345/2613] 10.222.0.57 () {58 vars in 1302 bytes} [Fri Sep 2 10:17:40 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 10:17:40.363079 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-119021f9-49b8-4f7f-ada2-a28bb585ab74 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:40.363584 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-119021f9-49b8-4f7f-ada2-a28bb585ab74 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:40.370032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-119021f9-49b8-4f7f-ada2-a28bb585ab74 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:40.370455 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-119021f9-49b8-4f7f-ada2-a28bb585ab74 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:40.370921 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-119021f9-49b8-4f7f-ada2-a28bb585ab74 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:40.371608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-119021f9-49b8-4f7f-ada2-a28bb585ab74 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:40.372061 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-119021f9-49b8-4f7f-ada2-a28bb585ab74 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:40.372491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-119021f9-49b8-4f7f-ada2-a28bb585ab74 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:40.398934 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-119021f9-49b8-4f7f-ada2-a28bb585ab74 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:17:40.674881 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-119021f9-49b8-4f7f-ada2-a28bb585ab74 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 204 len: 0 microversion: 2.1 time: 0.314998 Sep 02 10:17:40.675684 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1269/2614] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:17:40 2022] DELETE /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:17:40.683795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-10c9ece9-ae87-4f37-b19a-342b3da25088 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:40.684410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-10c9ece9-ae87-4f37-b19a-342b3da25088 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:40.690984 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10c9ece9-ae87-4f37-b19a-342b3da25088 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:40.691472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10c9ece9-ae87-4f37-b19a-342b3da25088 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:40.692039 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10c9ece9-ae87-4f37-b19a-342b3da25088 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:40.692911 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10c9ece9-ae87-4f37-b19a-342b3da25088 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:40.693368 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10c9ece9-ae87-4f37-b19a-342b3da25088 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:40.693795 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-10c9ece9-ae87-4f37-b19a-342b3da25088 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:40.825456 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-10c9ece9-ae87-4f37-b19a-342b3da25088 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:40.833489 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-10c9ece9-ae87-4f37-b19a-342b3da25088 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1679 microversion: 2.1 time: 0.153664 Sep 02 10:17:40.839421 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1346/2615] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:17:40 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:17:41.858326 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6d568ade-d1c9-41c7-9891-1bbd2331284f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:41.859101 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6d568ade-d1c9-41c7-9891-1bbd2331284f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:41.869166 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d568ade-d1c9-41c7-9891-1bbd2331284f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:41.869981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d568ade-d1c9-41c7-9891-1bbd2331284f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:41.870696 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d568ade-d1c9-41c7-9891-1bbd2331284f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:41.871874 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d568ade-d1c9-41c7-9891-1bbd2331284f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:41.872539 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d568ade-d1c9-41c7-9891-1bbd2331284f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:41.873022 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6d568ade-d1c9-41c7-9891-1bbd2331284f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:42.045928 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6d568ade-d1c9-41c7-9891-1bbd2331284f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:42.055488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6d568ade-d1c9-41c7-9891-1bbd2331284f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1679 microversion: 2.1 time: 0.202143 Sep 02 10:17:42.056126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1270/2616] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:17:41 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1679 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:17:43.077630 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-ee29165f-db1a-4da9-b61b-aa45c5363de1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:43.078278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-ee29165f-db1a-4da9-b61b-aa45c5363de1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:43.084782 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee29165f-db1a-4da9-b61b-aa45c5363de1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:43.090253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee29165f-db1a-4da9-b61b-aa45c5363de1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:43.090253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee29165f-db1a-4da9-b61b-aa45c5363de1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:43.090253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee29165f-db1a-4da9-b61b-aa45c5363de1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:43.090253 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee29165f-db1a-4da9-b61b-aa45c5363de1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:43.090654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-ee29165f-db1a-4da9-b61b-aa45c5363de1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:43.229654 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-ee29165f-db1a-4da9-b61b-aa45c5363de1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:43.240527 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-ee29165f-db1a-4da9-b61b-aa45c5363de1 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1679 microversion: 2.1 time: 0.166818 Sep 02 10:17:43.241342 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1347/2617] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:17:43 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:17:43.697969 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-d31b80ac-607c-4965-9585-d2493193f5d1 req-3a01fb66-453e-4c35-86e4-1ab59808f836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a894746b-15c0-48aa-8543-39baf7860971", "name": "network-vif-deleted", "tag": "24c08ecc-05f6-4618-af75-9244495b939d"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:17:43.708875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d31b80ac-607c-4965-9585-d2493193f5d1 req-3a01fb66-453e-4c35-86e4-1ab59808f836 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:43.709365 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d31b80ac-607c-4965-9585-d2493193f5d1 req-3a01fb66-453e-4c35-86e4-1ab59808f836 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:43.709787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d31b80ac-607c-4965-9585-d2493193f5d1 req-3a01fb66-453e-4c35-86e4-1ab59808f836 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:43.721632 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-d31b80ac-607c-4965-9585-d2493193f5d1 req-3a01fb66-453e-4c35-86e4-1ab59808f836 service nova] Creating event network-vif-deleted:24c08ecc-05f6-4618-af75-9244495b939d for instance a894746b-15c0-48aa-8543-39baf7860971 on hv-cinder-85083 Sep 02 10:17:43.726953 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-d31b80ac-607c-4965-9585-d2493193f5d1 req-3a01fb66-453e-4c35-86e4-1ab59808f836 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032774 Sep 02 10:17:43.727553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1271/2618] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:17:44.264644 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:44.266076 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:44.275737 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:44.276596 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:44.277311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:44.278120 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:44.278688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:44.279224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:44.319989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:44.319989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:44.319989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:44.319989 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lazy-loading 'fault' on Instance uuid a894746b-15c0-48aa-8543-39baf7860971 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:17:44.365394 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65963d36fc4741c69534b3dde1e00857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903eb64927ad43f1a2f1f2addb1c1b16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:17:44.373378 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-4b9033da-b143-4c67-815a-25f7b94b7b41 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 200 len: 1330 microversion: 2.1 time: 0.115509 Sep 02 10:17:44.378395 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1348/2619] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:17:44 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 1330 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:17:45.396055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:45.397526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:45.404075 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:45.404363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:45.404800 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:45.405498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:45.406323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:45.406450 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:45.420247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 HTTP/1.1 Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:17:45.421903 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:45.427318 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'a894746b-15c0-48aa-8543-39baf7860971'} Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:45.428020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:45.429102 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:45.430054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:45.430054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6802644d-e69e-498f-8d54-73b4f48cdc15 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 404 len: 111 microversion: 2.1 time: 0.032733 Sep 02 10:17:45.430054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1272/2620] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:17:45 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:17:45.432540 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-497f0e0d-164d-479f-9c64-025c48e43b73 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '.version_select at 0x7f4e5c624dc0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:45.538126 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-497f0e0d-164d-479f-9c64-025c48e43b73 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163894425" status: 202 len: 0 microversion: 2.1 time: 0.109382 Sep 02 10:17:45.538653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1349/2621] 10.222.0.57 () {58 vars in 1218 bytes} [Fri Sep 2 10:17:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163894425 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:17:48.039159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:48.039159 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:48.043510 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:48.044003 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:48.044444 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:48.045139 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:48.045592 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:48.046019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:48.059844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 HTTP/1.1 Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:17:48.061431 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:48.067705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'a894746b-15c0-48aa-8543-39baf7860971'} Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:48.068646 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:48.074862 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:48.075872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:48.075872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8b21ffd4-ba97-40e1-936c-d57f9c266fc3 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 404 len: 111 microversion: 2.1 time: 0.031097 Sep 02 10:17:48.075872 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1273/2622] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:17:48 2022] DELETE /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:17:48.076053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:48.076053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: a894746b-15c0-48aa-8543-39baf7860971] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:48.081437 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:48.081940 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:48.082388 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:48.083164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:48.088180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:48.088180 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:48.098807 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 HTTP/1.1 Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:17:48.100485 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:48.102001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': 'a894746b-15c0-48aa-8543-39baf7860971'} Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:48.102917 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. Sep 02 10:17:48.103923 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:48.104820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance a894746b-15c0-48aa-8543-39baf7860971 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:48.104820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-004c2ca7-bae4-488d-bb13-216e7f5be33a tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971" status: 404 len: 111 microversion: 2.1 time: 0.034328 Sep 02 10:17:48.104820 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1350/2623] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:17:48 2022] GET /compute/v2.1/servers/a894746b-15c0-48aa-8543-39baf7860971 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:17:49.403158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:49.403158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:49.403158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:49.403158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:49.403787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:49.403996 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:49.404618 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:49.405054 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:49.430980 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de HTTP/1.1 Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:17:49.432644 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:17:49.434112 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '19c90657-d042-4f11-a914-14d1456401de'} Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:49.434946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:17:49.436231 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.437688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:49.437688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e6292e49-38db-4c01-bb4a-62852c13a097 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 404 len: 111 microversion: 2.1 time: 0.043214 Sep 02 10:17:49.437688 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1274/2624] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:17:49 2022] DELETE /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 10:17:49.446132 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:49.446779 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 19c90657-d042-4f11-a914-14d1456401de] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:49.453207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:49.453690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:49.454110 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:49.461972 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:49.462464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:49.462951 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:49.479249 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de HTTP/1.1 Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:17:49.480794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:17:49.485359 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '19c90657-d042-4f11-a914-14d1456401de'} Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:49.485977 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. Sep 02 10:17:49.487060 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.488831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance 19c90657-d042-4f11-a914-14d1456401de could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:49.488831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d0100fd8-aa7e-4fb4-93c4-3006d63d540b tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de" status: 404 len: 111 microversion: 2.1 time: 0.039937 Sep 02 10:17:49.488831 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1351/2625] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:17:49 2022] GET /compute/v2.1/servers/19c90657-d042-4f11-a914-14d1456401de => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:17:49.492409 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:49.492911 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:49.499187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:49.499674 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:49.500165 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:49.500848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:49.501297 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:49.501720 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:49.515849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 HTTP/1.1 Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:17:49.518063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:17:49.520298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '96ede06e-7501-4396-9431-6a17dfaadc36'} Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:49.521100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:17:49.522160 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.523517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:49.523517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-fa8e987d-caf4-4dea-bea2-96f0953d8670 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 404 len: 111 microversion: 2.1 time: 0.030970 Sep 02 10:17:49.523517 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1275/2626] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:17:49 2022] DELETE /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:17:49.530221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:49.530221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 96ede06e-7501-4396-9431-6a17dfaadc36] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:49.537907 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:49.538761 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:49.539333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:49.540161 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:49.540860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:49.541661 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 HTTP/1.1 Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:17:49.561688 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:17:49.563065 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '96ede06e-7501-4396-9431-6a17dfaadc36'} Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:49.563712 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. Sep 02 10:17:49.565975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:49.569005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance 96ede06e-7501-4396-9431-6a17dfaadc36 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:49.569005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-bcc1fbc3-e1f2-4e80-8d39-857e3828df8f tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36" status: 404 len: 111 microversion: 2.1 time: 0.038794 Sep 02 10:17:49.569005 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1352/2627] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:17:49 2022] GET /compute/v2.1/servers/96ede06e-7501-4396-9431-6a17dfaadc36 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:17:50.879032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:50.879548 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:50.886005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:50.886486 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:50.886954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:50.887633 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:50.888086 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:50.888508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:50.902505 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 HTTP/1.1 Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:17:50.904123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:17:50.905756 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '3e1fc967-36d9-4d43-856d-9a9fdc5d9927'} Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:50.906589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:17:50.907999 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:17:50.909803 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:50.909803 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-2d5c9c56-43e0-41a3-8b84-c1e4a5136b0e tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 404 len: 111 microversion: 2.1 time: 0.030466 Sep 02 10:17:50.909803 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1276/2628] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:17:50 2022] DELETE /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 10:17:50.914783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:50.915401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] [instance: 3e1fc967-36d9-4d43-856d-9a9fdc5d9927] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:17:50.922038 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:50.922939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:50.923072 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:50.923726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:17:50.924823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:17:50.925250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:17:50.938653 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] HTTP exception thrown: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Request method failure captured: Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 HTTP/1.1 Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdZ3ZZPcf3wNLMcDAzSMfnG58y4-yx26UXdPEzTI7toVpAoAbb5wseWuu13Kx7Pi7jk2wVZHv_Uqs9sOHKS3jKd9vuLoTmpM80snpASTh7MlljzLWkeX5m5KjL-yIH2MJzwwgErn5CGeARjaDN-TeDhT9LjxlFurFg2adAU1e8ZMc2A Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:17:50.940216 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/903eb64927ad43f1a2f1f2addb1c1b16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_903eb64927ad43f1a2f1f2addb1c1b16", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 903eb64927ad43f1a2f1f2addb1c1b16 Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-111715239 Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 65963d36fc4741c69534b3dde1e00857 Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-AttachVolumeNegativeTest-111715239-project Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: > Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:17:50.941606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': '3e1fc967-36d9-4d43-856d-9a9fdc5d9927'} Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:17:50.942401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. Sep 02 10:17:50.943692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:17:50.944879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] Returning 404 to user: Instance 3e1fc967-36d9-4d43-856d-9a9fdc5d9927 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:17:50.944879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-cfc71d55-1753-4e41-b738-bb389f75f179 tempest-AttachVolumeNegativeTest-111715239 tempest-AttachVolumeNegativeTest-111715239-project] 10.222.0.57 "GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927" status: 404 len: 111 microversion: 2.1 time: 0.030757 Sep 02 10:17:50.944879 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1353/2629] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:17:50 2022] GET /compute/v2.1/servers/3e1fc967-36d9-4d43-856d-9a9fdc5d9927 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:17:58.178628 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-53564a1f-8e20-46be-a5ac-86c86910ed35 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5fb88670>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:58.230501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-53564a1f-8e20-46be-a5ac-86c86910ed35 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/3d8b0353-4be7-4dc3-b3a7-142aa1789c52" status: 200 len: 349 microversion: 2.1 time: 0.053099 Sep 02 10:17:58.230501 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1277/2630] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 10:17:58 2022] GET /compute/v2.1/os-volumes/3d8b0353-4be7-4dc3-b3a7-142aa1789c52 => generated 349 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:17:59.919193 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-a15addc2-c0a1-4748-b13d-157051e1065a tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5c488ca0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:17:59.966939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-a15addc2-c0a1-4748-b13d-157051e1065a tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/fcb59da1-92dd-4570-8b36-4978d2cee932" status: 200 len: 351 microversion: 2.1 time: 0.051702 Sep 02 10:17:59.967503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1354/2631] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 10:17:59 2022] GET /compute/v2.1/os-volumes/fcb59da1-92dd-4570-8b36-4978d2cee932 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:18:01.663634 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:18:01.664649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:18:01.668809 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-06d6fedc-4748-4f98-8cc9-1d9a50eb4331 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5c2e6e50>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:01.717115 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-06d6fedc-4748-4f98-8cc9-1d9a50eb4331 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/465f7641-b3cd-4a8b-99ad-6e1a433c2693" status: 200 len: 351 microversion: 2.1 time: 0.054810 Sep 02 10:18:01.717762 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1278/2632] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 10:18:01 2022] GET /compute/v2.1/os-volumes/465f7641-b3cd-4a8b-99ad-6e1a433c2693 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 10:18:01.727523 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:18:01.728747 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:18:01.732666 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9c72ed1f-13ca-441a-b1f1-9e7987c890eb tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5c44ee50>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:01.819091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9c72ed1f-13ca-441a-b1f1-9e7987c890eb tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090188 Sep 02 10:18:01.819091 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1355/2633] 10.222.0.57 () {58 vars in 1134 bytes} [Fri Sep 2 10:18:01 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:18:01.832390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-1a92ad4f-7f9c-44f8-b55b-e141cfc81d88 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5fbfcaf0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:01.919446 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-1a92ad4f-7f9c-44f8-b55b-e141cfc81d88 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091841 Sep 02 10:18:01.920100 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1279/2634] 10.222.0.57 () {58 vars in 1149 bytes} [Fri Sep 2 10:18:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:18:01.933811 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-430dcc2b-6342-420f-9930-ddaeeced4f11 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5c613af0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:02.015668 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-430dcc2b-6342-420f-9930-ddaeeced4f11 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085564 Sep 02 10:18:02.016244 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1356/2635] 10.222.0.57 () {58 vars in 1134 bytes} [Fri Sep 2 10:18:01 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:18:02.029187 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b756d307-6753-4f35-a081-7bef1de33705 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5fb88ca0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:02.114662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b756d307-6753-4f35-a081-7bef1de33705 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089584 Sep 02 10:18:02.115736 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1280/2636] 10.222.0.57 () {58 vars in 1167 bytes} [Fri Sep 2 10:18:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:18:02.129615 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-d7f36747-5ef9-49f9-b873-a5374c4aea5c tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5c789ca0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:02.220787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-d7f36747-5ef9-49f9-b873-a5374c4aea5c tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087954 Sep 02 10:18:02.220787 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1357/2637] 10.222.0.57 () {58 vars in 1170 bytes} [Fri Sep 2 10:18:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:18:02.227514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c618b7de-2491-45d2-a332-66f8156e5d5e tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5fbe3b80>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:02.312538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c618b7de-2491-45d2-a332-66f8156e5d5e tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086942 Sep 02 10:18:02.312538 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1281/2638] 10.222.0.57 () {58 vars in 1155 bytes} [Fri Sep 2 10:18:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:18:02.324606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3a10b7db-2fc5-4428-b273-3d160021100f tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5c3c60d0>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:02.410662 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3a10b7db-2fc5-4428-b273-3d160021100f tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090319 Sep 02 10:18:02.411292 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1358/2639] 10.222.0.57 () {58 vars in 1188 bytes} [Fri Sep 2 10:18:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:18:02.426000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a95c3f75-ee0c-47ae-9287-b34f3f3c5576 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] Calling method '.version_select at 0x7f4e5fbe3430>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:02.513301 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a95c3f75-ee0c-47ae-9287-b34f3f3c5576 tempest-VolumesTestJSON-1093843204 tempest-VolumesTestJSON-1093843204-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093006 Sep 02 10:18:02.513873 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1282/2640] 10.222.0.57 () {58 vars in 1155 bytes} [Fri Sep 2 10:18:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:18:08.535181 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9f9b3f6a-63f6-46a7-a9bd-099673ec426c tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Action: 'create', calling method: .version_select at 0x7f4e5c3c6790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-478627071", "metadata": {"Type": "work"}}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9f9b3f6a-63f6-46a7-a9bd-099673ec426c tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Request method failure captured: Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 121 Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdhgK6XM9KTkm3EtYcN9E8HnMM6yLwj6qJa-I-LoJfP4mxli6yLmX2EaD-QYHHznVpo2AJQJ6t7--SXORthRTctCkJ2bpXgMs3gYj1-CZXbO-E06c-388qt6x8598rDkTMLD6778x8RDI6oYX5JIPg4oynD8Qh9syrmfUH-A2ikB2n8 Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:18:08.544981 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9bc60b330b2b49f7a4fab36f03eeb4ed", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 4680e1478c024aa0b0f08a7a81074eb5 Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-478627071", "metadata": {"Type": "work"}}} Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: Sep 02 10:18:08.546451 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-478627071', 'metadata': {'Type': 'work'}}}} Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise error Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi '#$%' Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:18:08.547369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 10:18:08.548894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 10:18:08.550200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 10:18:08.550200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.550200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9f9b3f6a-63f6-46a7-a9bd-099673ec426c tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:18:08.550200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9f9b3f6a-63f6-46a7-a9bd-099673ec426c tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131478 Sep 02 10:18:08.550200 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1359/2641] 10.222.0.57 () {60 vars in 1156 bytes} [Fri Sep 2 10:18:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 10:18:08.559020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a1d78dfa-1a58-4fdc-b738-fddc093713b7 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Action: 'create', calling method: .version_select at 0x7f4e5c1edc10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-533849476", "metadata": {"Type": "work"}}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a1d78dfa-1a58-4fdc-b738-fddc093713b7 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Request method failure captured: Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 119 Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdhgK6XM9KTkm3EtYcN9E8HnMM6yLwj6qJa-I-LoJfP4mxli6yLmX2EaD-QYHHznVpo2AJQJ6t7--SXORthRTctCkJ2bpXgMs3gYj1-CZXbO-E06c-388qt6x8598rDkTMLD6778x8RDI6oYX5JIPg4oynD8Qh9syrmfUH-A2ikB2n8 Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:18:08.563577 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9bc60b330b2b49f7a4fab36f03eeb4ed", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 4680e1478c024aa0b0f08a7a81074eb5 Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-533849476", "metadata": {"Type": "work"}}} Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: Sep 02 10:18:08.565071 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-533849476', 'metadata': {'Type': 'work'}}}} Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise error Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi '0' Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:18:08.565946 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 10:18:08.567495 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 10:18:08.568721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 10:18:08.568721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.568721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a1d78dfa-1a58-4fdc-b738-fddc093713b7 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:18:08.568721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a1d78dfa-1a58-4fdc-b738-fddc093713b7 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010483 Sep 02 10:18:08.568721 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1283/2642] 10.222.0.57 () {60 vars in 1156 bytes} [Fri Sep 2 10:18:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 10:18:08.573962 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f06f9cc5-7ea6-455a-9dcc-22fb5994035b tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Action: 'create', calling method: .version_select at 0x7f4e5c22d940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1936079571", "metadata": {"Type": "work"}}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f06f9cc5-7ea6-455a-9dcc-22fb5994035b tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Request method failure captured: Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 119 Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdhgK6XM9KTkm3EtYcN9E8HnMM6yLwj6qJa-I-LoJfP4mxli6yLmX2EaD-QYHHznVpo2AJQJ6t7--SXORthRTctCkJ2bpXgMs3gYj1-CZXbO-E06c-388qt6x8598rDkTMLD6778x8RDI6oYX5JIPg4oynD8Qh9syrmfUH-A2ikB2n8 Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:18:08.577621 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9bc60b330b2b49f7a4fab36f03eeb4ed", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 4680e1478c024aa0b0f08a7a81074eb5 Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1936079571", "metadata": {"Type": "work"}}} Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: Sep 02 10:18:08.579075 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1936079571', 'metadata': {'Type': 'work'}}}} Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise error Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi '' Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:18:08.579964 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 10:18:08.581401 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 10:18:08.582625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 10:18:08.582625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.582625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f06f9cc5-7ea6-455a-9dcc-22fb5994035b tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:18:08.582625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f06f9cc5-7ea6-455a-9dcc-22fb5994035b tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008707 Sep 02 10:18:08.582625 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1360/2643] 10.222.0.57 () {60 vars in 1156 bytes} [Fri Sep 2 10:18:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 10:18:08.589028 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d81f491-13d2-4bf1-a6e8-b2c358caad97 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Calling method '.version_select at 0x7f4e5c20b0d0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:08.617466 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-5d81f491-13d2-4bf1-a6e8-b2c358caad97 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] HTTP exception thrown: Volume tempest-invalid-639498382 could not be found. Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d81f491-13d2-4bf1-a6e8-b2c358caad97 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Request method failure captured: Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-639498382 HTTP/1.1 Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdhgK6XM9KTkm3EtYcN9E8HnMM6yLwj6qJa-I-LoJfP4mxli6yLmX2EaD-QYHHznVpo2AJQJ6t7--SXORthRTctCkJ2bpXgMs3gYj1-CZXbO-E06c-388qt6x8598rDkTMLD6778x8RDI6oYX5JIPg4oynD8Qh9syrmfUH-A2ikB2n8 Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:18:08.619499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9bc60b330b2b49f7a4fab36f03eeb4ed", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 4680e1478c024aa0b0f08a7a81074eb5 Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Volume tempest-invalid-639498382 could not be found. Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'tempest-invalid-639498382'} Sep 02 10:18:08.620899 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-639498382 could not be found. (HTTP 404) (Request-ID: req-d8123654-c9dc-48bb-8b65-cd0f2812157a) Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.621704 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 10:18:08.622868 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-639498382 could not be found. Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:18:08.624095 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-639498382 could not be found. Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-639498382 could not be found. Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5d81f491-13d2-4bf1-a6e8-b2c358caad97 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Returning 404 to user: Volume tempest-invalid-639498382 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5d81f491-13d2-4bf1-a6e8-b2c358caad97 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-639498382" status: 404 len: 98 microversion: 2.1 time: 0.036509 Sep 02 10:18:08.625354 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1284/2644] 10.222.0.57 () {58 vars in 1215 bytes} [Fri Sep 2 10:18:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-639498382 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 02 10:18:08.631948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-edada0ca-8737-4e20-a536-b0a63f8b5aa5 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003729 Sep 02 10:18:08.632452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1361/2645] 10.222.0.57 () {58 vars in 1140 bytes} [Fri Sep 2 10:18:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 02 10:18:08.640786 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-9be5bbb4-34a9-4606-924f-385d8efe3643 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003778 Sep 02 10:18:08.641278 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1285/2646] 10.222.0.57 () {58 vars in 1137 bytes} [Fri Sep 2 10:18:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 02 10:18:08.649878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1205723d-780a-4cfe-bc32-552ba0ca1b4b tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Calling method '.version_select at 0x7f4e5c454c10>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:08.678293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.wsgi [None req-1205723d-780a-4cfe-bc32-552ba0ca1b4b tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] HTTP exception thrown: Volume baae9879-c960-45c5-8da3-18d0391cca28 could not be found. Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1205723d-780a-4cfe-bc32-552ba0ca1b4b tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Request method failure captured: Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: request: DELETE /compute/v2.1/os-volumes/baae9879-c960-45c5-8da3-18d0391cca28 HTTP/1.1 Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept: application/json Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Accept-Encoding: identity Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Connection: close Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Length: 0 Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Content-Type: application/json Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Host: 10.222.0.57 Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Openstack-System-Scope: None Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: User-Agent: python-urllib3/1.26.12 Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Auth-Token: gAAAAABjEdhgK6XM9KTkm3EtYcN9E8HnMM6yLwj6qJa-I-LoJfP4mxli6yLmX2EaD-QYHHznVpo2AJQJ6t7--SXORthRTctCkJ2bpXgMs3gYj1-CZXbO-E06c-388qt6x8598rDkTMLD6778x8RDI6oYX5JIPg4oynD8Qh9syrmfUH-A2ikB2n8 Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Id: None Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Domain-Name: None Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Identity-Status: Confirmed Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Is-Admin-Project: True Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Id: default Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Domain-Name: Default Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Project-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Role: reader,member Sep 02 10:18:08.680257 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Roles: reader,member Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9bc60b330b2b49f7a4fab36f03eeb4ed", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-Tenant-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Id: default Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Domain-Name: Default Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Id: 4680e1478c024aa0b0f08a7a81074eb5 Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: X-User-Name: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: method: Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: exception: Volume baae9879-c960-45c5-8da3-18d0391cca28 could not be found. Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: action_args: {'id': 'baae9879-c960-45c5-8da3-18d0391cca28'} Sep 02 10:18:08.681692 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume baae9879-c960-45c5-8da3-18d0391cca28 could not be found. (HTTP 404) (Request-ID: req-26762aa4-b52c-4adb-be5c-d05ea96d62a3) Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.682584 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 10:18:08.683824 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume baae9879-c960-45c5-8da3-18d0391cca28 could not be found. Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 10:18:08.685012 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume baae9879-c960-45c5-8da3-18d0391cca28 could not be found. Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume baae9879-c960-45c5-8da3-18d0391cca28 could not be found. Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-1205723d-780a-4cfe-bc32-552ba0ca1b4b tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Returning 404 to user: Volume baae9879-c960-45c5-8da3-18d0391cca28 could not be found. {{(pid=127533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-1205723d-780a-4cfe-bc32-552ba0ca1b4b tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/baae9879-c960-45c5-8da3-18d0391cca28" status: 404 len: 109 microversion: 2.1 time: 0.035647 Sep 02 10:18:08.686209 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1362/2647] 10.222.0.57 () {58 vars in 1248 bytes} [Fri Sep 2 10:18:08 2022] DELETE /compute/v2.1/os-volumes/baae9879-c960-45c5-8da3-18d0391cca28 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:18:08.691822 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b988c6c2-e159-4a74-b24c-c7ed085dffd6 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Calling method '.version_select at 0x7f4e5c2e69d0>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:18:08.719463 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-b988c6c2-e159-4a74-b24c-c7ed085dffd6 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] HTTP exception thrown: Volume 28e6a60e-1e54-43ce-9621-198b295cf0d4 could not be found. Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b988c6c2-e159-4a74-b24c-c7ed085dffd6 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Request method failure captured: Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/os-volumes/28e6a60e-1e54-43ce-9621-198b295cf0d4 HTTP/1.1 Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdhgK6XM9KTkm3EtYcN9E8HnMM6yLwj6qJa-I-LoJfP4mxli6yLmX2EaD-QYHHznVpo2AJQJ6t7--SXORthRTctCkJ2bpXgMs3gYj1-CZXbO-E06c-388qt6x8598rDkTMLD6778x8RDI6oYX5JIPg4oynD8Qh9syrmfUH-A2ikB2n8 Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:18:08.721386 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9bc60b330b2b49f7a4fab36f03eeb4ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9bc60b330b2b49f7a4fab36f03eeb4ed", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: 9bc60b330b2b49f7a4fab36f03eeb4ed Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-VolumesNegativeTest-764960314 Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: 4680e1478c024aa0b0f08a7a81074eb5 Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-VolumesNegativeTest-764960314-project Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Volume 28e6a60e-1e54-43ce-9621-198b295cf0d4 could not be found. Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': '28e6a60e-1e54-43ce-9621-198b295cf0d4'} Sep 02 10:18:08.723234 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 28e6a60e-1e54-43ce-9621-198b295cf0d4 could not be found. (HTTP 404) (Request-ID: req-022d42f3-0240-4a3d-8b5a-0b0537b5dcea) Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.724127 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 10:18:08.725419 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 28e6a60e-1e54-43ce-9621-198b295cf0d4 could not be found. Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 10:18:08.726565 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 28e6a60e-1e54-43ce-9621-198b295cf0d4 could not be found. Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 28e6a60e-1e54-43ce-9621-198b295cf0d4 could not be found. Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b988c6c2-e159-4a74-b24c-c7ed085dffd6 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] Returning 404 to user: Volume 28e6a60e-1e54-43ce-9621-198b295cf0d4 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b988c6c2-e159-4a74-b24c-c7ed085dffd6 tempest-VolumesNegativeTest-764960314 tempest-VolumesNegativeTest-764960314-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/28e6a60e-1e54-43ce-9621-198b295cf0d4" status: 404 len: 109 microversion: 2.1 time: 0.034842 Sep 02 10:18:08.727746 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1286/2648] 10.222.0.57 () {58 vars in 1245 bytes} [Fri Sep 2 10:18:08 2022] GET /compute/v2.1/os-volumes/28e6a60e-1e54-43ce-9621-198b295cf0d4 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 10:19:36.183079 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3798216d-9c57-492d-bb6c-f3964e418669 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Action: 'create', calling method: .version_select at 0x7f4e5c22df70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1701919701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZBtgLTa4FDU8qjiKJlAnEMOQw4zz6mSWY+2nhU/b0CnF/hnVRV23WBY8tskT5wQONQULo04i+mmU8hxDNl9aQbjydk7MCC9m6BkDBTnsUqSHmJ77AoCoM97TSea/SQ+g=="}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:19:36.199409 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-3798216d-9c57-492d-bb6c-f3964e418669 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Getting quotas for project bfd00fdbe14e451fb3634ef9077b3a76. Resources: {'key_pairs'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:19:36.203237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.quota [None req-3798216d-9c57-492d-bb6c-f3964e418669 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Getting quotas for user a29bbe80a3cc44a58ddcd0dd784f11bf and project bfd00fdbe14e451fb3634ef9077b3a76. Resources: {'key_pairs'} {{(pid=127533) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:19:36.295095 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3798216d-9c57-492d-bb6c-f3964e418669 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.278408 Sep 02 10:19:36.295697 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1363/2649] 10.222.0.57 () {60 vars in 1159 bytes} [Fri Sep 2 10:19:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:20:01.663241 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5e95a49e-bd86-458a-aec2-60d12b23e554] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 10:20:01.663912 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:20:01.664074 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:20:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.57) !!! Sep 02 10:20:01.666363 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 02 10:20:01.666486 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:20:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.57) !!! Sep 02 10:20:01.682401 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1331692349", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1701919701", "security_groups": [{"name": "tempest-secgroup-smoke-494930464"}], "networks": [{"uuid": "a61f8a7c-5f79-41d7-9fb5-b3e39ee5033a"}], "block_device_mapping_v2": [{"uuid": "e4dc086c-39de-4990-8947-bc3d5876111c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:20:01.792860 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.network.neutron [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] validate_networks() for [('a61f8a7c-5f79-41d7-9fb5-b3e39ee5033a', None, None, None, None, None)] {{(pid=127531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 02 10:20:02.152738 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Flavor limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 10:20:02.153111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Image limits 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 10:20:02.153582 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Flavor pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 10:20:02.153989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Image pref 0:0:0 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 10:20:02.154424 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.virt.hardware [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 10:20:02.163439 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:02.163913 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:02.164343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:02.165062 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:02.165508 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:02.165937 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:02.182835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Getting quotas for project bfd00fdbe14e451fb3634ef9077b3a76. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 10:20:02.186731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.quota [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Getting quotas for user a29bbe80a3cc44a58ddcd0dd784f11bf and project bfd00fdbe14e451fb3634ef9077b3a76. Resources: {'cores', 'instances', 'ram'} {{(pid=127531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 10:20:02.242212 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Going to run 1 instances... {{(pid=127531) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 10:20:02.244325 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4dc086c-39de-4990-8947-bc3d5876111c',volume_size=None,volume_type=None)] {{(pid=127531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 10:20:02.620856 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-26df04be-405a-480d-8a5d-279c1fc952b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.959930 Sep 02 10:20:02.621493 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1287/2650] 10.222.0.57 () {60 vars in 1147 bytes} [Fri Sep 2 10:20:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 10:20:02.629578 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=4 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:20:02.630861 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:20:02.634720 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-846170f1-564a-4b02-837f-8992f1b321a3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:02.635346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-846170f1-564a-4b02-837f-8992f1b321a3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:02.691827 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-846170f1-564a-4b02-837f-8992f1b321a3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:02.700170 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-846170f1-564a-4b02-837f-8992f1b321a3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1089 microversion: 2.1 time: 0.071889 Sep 02 10:20:02.700732 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1364/2651] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:02 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:03.724728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-5ed488a9-8ef3-46e2-a3d7-9d32c724aa22 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:03.725341 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-5ed488a9-8ef3-46e2-a3d7-9d32c724aa22 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:03.733352 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] [5e95a49e-bd86-458a-aec2-60d12b23e554] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 32946. Sep 02 10:20:03.734829 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ed488a9-8ef3-46e2-a3d7-9d32c724aa22 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:03.735309 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ed488a9-8ef3-46e2-a3d7-9d32c724aa22 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:03.735742 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ed488a9-8ef3-46e2-a3d7-9d32c724aa22 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:03.736416 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ed488a9-8ef3-46e2-a3d7-9d32c724aa22 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:03.736861 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ed488a9-8ef3-46e2-a3d7-9d32c724aa22 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:03.737279 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-5ed488a9-8ef3-46e2-a3d7-9d32c724aa22 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:03.798523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-5ed488a9-8ef3-46e2-a3d7-9d32c724aa22 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:03.806741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-5ed488a9-8ef3-46e2-a3d7-9d32c724aa22 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1139 microversion: 2.1 time: 0.088331 Sep 02 10:20:03.807304 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1288/2652] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:03 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:04.828329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-fffb4c73-4224-4db0-8e74-4ec9bb652e15 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:04.828943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-fffb4c73-4224-4db0-8e74-4ec9bb652e15 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:04.836356 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fffb4c73-4224-4db0-8e74-4ec9bb652e15 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:04.836851 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fffb4c73-4224-4db0-8e74-4ec9bb652e15 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:04.837306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fffb4c73-4224-4db0-8e74-4ec9bb652e15 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:04.837982 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fffb4c73-4224-4db0-8e74-4ec9bb652e15 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:04.838620 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fffb4c73-4224-4db0-8e74-4ec9bb652e15 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:04.839709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-fffb4c73-4224-4db0-8e74-4ec9bb652e15 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:04.904315 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-fffb4c73-4224-4db0-8e74-4ec9bb652e15 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:04.912002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-fffb4c73-4224-4db0-8e74-4ec9bb652e15 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1195 microversion: 2.1 time: 0.087575 Sep 02 10:20:04.915399 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1365/2653] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:04 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1195 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:05.935337 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b37d5a4d-c039-4d78-9b0f-43d332c57b93 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:05.936122 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b37d5a4d-c039-4d78-9b0f-43d332c57b93 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:05.942514 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37d5a4d-c039-4d78-9b0f-43d332c57b93 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:05.943694 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37d5a4d-c039-4d78-9b0f-43d332c57b93 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:05.944292 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37d5a4d-c039-4d78-9b0f-43d332c57b93 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:05.945113 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37d5a4d-c039-4d78-9b0f-43d332c57b93 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:05.945848 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37d5a4d-c039-4d78-9b0f-43d332c57b93 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:05.946247 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b37d5a4d-c039-4d78-9b0f-43d332c57b93 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:06.132270 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b37d5a4d-c039-4d78-9b0f-43d332c57b93 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:06.140072 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b37d5a4d-c039-4d78-9b0f-43d332c57b93 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1272 microversion: 2.1 time: 0.210444 Sep 02 10:20:06.140757 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1289/2654] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:05 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:06.550169 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-108fcba6-700f-47d5-ac4d-dc0b4dead8ad req-7c87b14d-3457-4e0e-92e8-22ee99cb1b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89f4d17-4d9d-4900-aef8-cdfca02f5260", "tag": "979cdc50-d477-426a-b650-4d2eecfc46ef"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:20:06.560294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-108fcba6-700f-47d5-ac4d-dc0b4dead8ad req-7c87b14d-3457-4e0e-92e8-22ee99cb1b97 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:06.560772 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-108fcba6-700f-47d5-ac4d-dc0b4dead8ad req-7c87b14d-3457-4e0e-92e8-22ee99cb1b97 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:06.561204 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-108fcba6-700f-47d5-ac4d-dc0b4dead8ad req-7c87b14d-3457-4e0e-92e8-22ee99cb1b97 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:06.572103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-108fcba6-700f-47d5-ac4d-dc0b4dead8ad req-7c87b14d-3457-4e0e-92e8-22ee99cb1b97 service nova] Creating event network-changed:979cdc50-d477-426a-b650-4d2eecfc46ef for instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 on hv-cinder-85083 Sep 02 10:20:06.575495 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR oslo.messaging._drivers.impl_rabbit [req-108fcba6-700f-47d5-ac4d-dc0b4dead8ad req-7c87b14d-3457-4e0e-92e8-22ee99cb1b97 service nova] [302f5a15-9235-4699-9c0f-3c55b75ae57c] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 10:20:07.161123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-14c18cda-68a7-49f1-8e0d-d673a0ebb462 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:07.161775 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-14c18cda-68a7-49f1-8e0d-d673a0ebb462 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:07.168384 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c18cda-68a7-49f1-8e0d-d673a0ebb462 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:07.168864 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c18cda-68a7-49f1-8e0d-d673a0ebb462 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:07.169289 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c18cda-68a7-49f1-8e0d-d673a0ebb462 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:07.170033 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c18cda-68a7-49f1-8e0d-d673a0ebb462 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:07.170477 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c18cda-68a7-49f1-8e0d-d673a0ebb462 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:07.170924 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-14c18cda-68a7-49f1-8e0d-d673a0ebb462 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:07.297850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-14c18cda-68a7-49f1-8e0d-d673a0ebb462 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:07.305384 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-14c18cda-68a7-49f1-8e0d-d673a0ebb462 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.148200 Sep 02 10:20:07.305931 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1290/2655] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:07 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:20:07.582008 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [req-108fcba6-700f-47d5-ac4d-dc0b4dead8ad req-7c87b14d-3457-4e0e-92e8-22ee99cb1b97 service nova] [302f5a15-9235-4699-9c0f-3c55b75ae57c] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 32958. Sep 02 10:20:07.586048 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-108fcba6-700f-47d5-ac4d-dc0b4dead8ad req-7c87b14d-3457-4e0e-92e8-22ee99cb1b97 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.107690 Sep 02 10:20:07.586659 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1366/2656] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:20:08.326535 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-4451808d-c1b4-4f08-880c-4d63618bafef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:08.327171 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-4451808d-c1b4-4f08-880c-4d63618bafef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:08.333518 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4451808d-c1b4-4f08-880c-4d63618bafef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:08.334000 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4451808d-c1b4-4f08-880c-4d63618bafef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:08.334437 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4451808d-c1b4-4f08-880c-4d63618bafef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:08.335152 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4451808d-c1b4-4f08-880c-4d63618bafef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:08.335608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4451808d-c1b4-4f08-880c-4d63618bafef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:08.336032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-4451808d-c1b4-4f08-880c-4d63618bafef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:08.576329 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-4451808d-c1b4-4f08-880c-4d63618bafef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:08.584232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-4451808d-c1b4-4f08-880c-4d63618bafef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.261634 Sep 02 10:20:08.584807 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1291/2657] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:08 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:09.606422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-5a9be067-11e6-4e4b-9b3c-c14c5b92656a tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:09.607154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-5a9be067-11e6-4e4b-9b3c-c14c5b92656a tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:09.613329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a9be067-11e6-4e4b-9b3c-c14c5b92656a tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:09.613812 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a9be067-11e6-4e4b-9b3c-c14c5b92656a tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:09.614252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a9be067-11e6-4e4b-9b3c-c14c5b92656a tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:09.615465 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a9be067-11e6-4e4b-9b3c-c14c5b92656a tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:09.615918 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a9be067-11e6-4e4b-9b3c-c14c5b92656a tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:09.616346 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-5a9be067-11e6-4e4b-9b3c-c14c5b92656a tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:09.744818 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-5a9be067-11e6-4e4b-9b3c-c14c5b92656a tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:09.752345 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-5a9be067-11e6-4e4b-9b3c-c14c5b92656a tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.150718 Sep 02 10:20:09.752908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1367/2658] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:09 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:10.772801 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-b549f332-9b80-4fd4-8e64-975918c2edfa tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:10.773336 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-b549f332-9b80-4fd4-8e64-975918c2edfa tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:10.779703 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b549f332-9b80-4fd4-8e64-975918c2edfa tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:10.780184 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b549f332-9b80-4fd4-8e64-975918c2edfa tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:10.780615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b549f332-9b80-4fd4-8e64-975918c2edfa tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:10.781295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b549f332-9b80-4fd4-8e64-975918c2edfa tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:10.781741 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b549f332-9b80-4fd4-8e64-975918c2edfa tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:10.782158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-b549f332-9b80-4fd4-8e64-975918c2edfa tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:10.909782 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-b549f332-9b80-4fd4-8e64-975918c2edfa tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:10.917331 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-b549f332-9b80-4fd4-8e64-975918c2edfa tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.149061 Sep 02 10:20:10.917879 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1292/2659] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:10 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:11.937311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-43f7ae61-61bc-41d8-a3d7-5be7de2502c9 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:11.937950 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-43f7ae61-61bc-41d8-a3d7-5be7de2502c9 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:11.945051 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43f7ae61-61bc-41d8-a3d7-5be7de2502c9 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:11.945533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43f7ae61-61bc-41d8-a3d7-5be7de2502c9 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:11.945968 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43f7ae61-61bc-41d8-a3d7-5be7de2502c9 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:11.946650 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43f7ae61-61bc-41d8-a3d7-5be7de2502c9 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:11.947134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43f7ae61-61bc-41d8-a3d7-5be7de2502c9 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:11.947560 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-43f7ae61-61bc-41d8-a3d7-5be7de2502c9 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:12.078430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-43f7ae61-61bc-41d8-a3d7-5be7de2502c9 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:12.085998 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-43f7ae61-61bc-41d8-a3d7-5be7de2502c9 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.152520 Sep 02 10:20:12.086564 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1368/2660] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:11 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:13.107020 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e3de6d09-b53e-40da-a8ce-f1c273a9740c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:13.107669 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e3de6d09-b53e-40da-a8ce-f1c273a9740c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:13.109965 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=2 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:20:13.110623 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell0:SELECT=6 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:20:13.115970 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3de6d09-b53e-40da-a8ce-f1c273a9740c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:13.116488 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3de6d09-b53e-40da-a8ce-f1c273a9740c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:13.116922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3de6d09-b53e-40da-a8ce-f1c273a9740c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:13.117604 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3de6d09-b53e-40da-a8ce-f1c273a9740c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:13.118057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3de6d09-b53e-40da-a8ce-f1c273a9740c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:13.118485 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e3de6d09-b53e-40da-a8ce-f1c273a9740c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:13.251550 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e3de6d09-b53e-40da-a8ce-f1c273a9740c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:13.259259 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e3de6d09-b53e-40da-a8ce-f1c273a9740c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.156236 Sep 02 10:20:13.259818 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1293/2661] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:13 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:14.279542 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-38f74483-4a32-42b1-910e-992062126751 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:14.280150 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-38f74483-4a32-42b1-910e-992062126751 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:14.282144 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell0:SELECT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:20:14.287943 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f74483-4a32-42b1-910e-992062126751 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:14.288422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f74483-4a32-42b1-910e-992062126751 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:14.293156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f74483-4a32-42b1-910e-992062126751 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:14.293156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f74483-4a32-42b1-910e-992062126751 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:14.293156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f74483-4a32-42b1-910e-992062126751 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:14.293156 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-38f74483-4a32-42b1-910e-992062126751 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:14.421745 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-38f74483-4a32-42b1-910e-992062126751 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:14.429903 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-38f74483-4a32-42b1-910e-992062126751 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.154332 Sep 02 10:20:14.430473 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1369/2662] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:14 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:15.449885 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a65617fc-558c-4554-b40e-4ed80891e63d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:15.450525 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a65617fc-558c-4554-b40e-4ed80891e63d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:15.457350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a65617fc-558c-4554-b40e-4ed80891e63d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:15.457830 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a65617fc-558c-4554-b40e-4ed80891e63d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:15.458954 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a65617fc-558c-4554-b40e-4ed80891e63d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:15.459636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a65617fc-558c-4554-b40e-4ed80891e63d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:15.460097 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a65617fc-558c-4554-b40e-4ed80891e63d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:15.460523 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a65617fc-558c-4554-b40e-4ed80891e63d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:15.590761 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a65617fc-558c-4554-b40e-4ed80891e63d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:15.598616 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a65617fc-558c-4554-b40e-4ed80891e63d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.152677 Sep 02 10:20:15.599197 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1294/2663] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:15 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:16.619443 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-42bc096b-8155-467a-a9ed-2ad66cb3165e tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:16.620047 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-42bc096b-8155-467a-a9ed-2ad66cb3165e tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:16.626380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42bc096b-8155-467a-a9ed-2ad66cb3165e tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:16.626909 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42bc096b-8155-467a-a9ed-2ad66cb3165e tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:16.627344 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42bc096b-8155-467a-a9ed-2ad66cb3165e tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:16.628014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42bc096b-8155-467a-a9ed-2ad66cb3165e tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:16.628461 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42bc096b-8155-467a-a9ed-2ad66cb3165e tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:16.628876 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-42bc096b-8155-467a-a9ed-2ad66cb3165e tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:16.755798 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-42bc096b-8155-467a-a9ed-2ad66cb3165e tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:16.763406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-42bc096b-8155-467a-a9ed-2ad66cb3165e tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.147757 Sep 02 10:20:16.763963 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1370/2664] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:16 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:17.783527 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6c3af43d-619f-4b67-b242-49de31ebe656 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:17.784851 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6c3af43d-619f-4b67-b242-49de31ebe656 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:17.791573 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3af43d-619f-4b67-b242-49de31ebe656 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:17.792064 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3af43d-619f-4b67-b242-49de31ebe656 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:17.792499 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3af43d-619f-4b67-b242-49de31ebe656 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:17.793186 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3af43d-619f-4b67-b242-49de31ebe656 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:17.793639 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3af43d-619f-4b67-b242-49de31ebe656 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:17.794070 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6c3af43d-619f-4b67-b242-49de31ebe656 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:17.927120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6c3af43d-619f-4b67-b242-49de31ebe656 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:17.934974 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6c3af43d-619f-4b67-b242-49de31ebe656 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.155288 Sep 02 10:20:17.935533 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1295/2665] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:17 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:18.508784 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-9c251c2a-7332-4f99-8357-51dbf209c1f5 req-75f3bbd1-ef01-4be1-a0c0-df76ef39f6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89f4d17-4d9d-4900-aef8-cdfca02f5260", "name": "network-vif-plugged", "status": "completed", "tag": "979cdc50-d477-426a-b650-4d2eecfc46ef"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:20:18.518061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-9c251c2a-7332-4f99-8357-51dbf209c1f5 req-75f3bbd1-ef01-4be1-a0c0-df76ef39f6f6 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:18.518541 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-9c251c2a-7332-4f99-8357-51dbf209c1f5 req-75f3bbd1-ef01-4be1-a0c0-df76ef39f6f6 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:18.519000 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-9c251c2a-7332-4f99-8357-51dbf209c1f5 req-75f3bbd1-ef01-4be1-a0c0-df76ef39f6f6 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:18.529591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-9c251c2a-7332-4f99-8357-51dbf209c1f5 req-75f3bbd1-ef01-4be1-a0c0-df76ef39f6f6 service nova] Creating event network-vif-plugged:979cdc50-d477-426a-b650-4d2eecfc46ef for instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 on hv-cinder-85083 Sep 02 10:20:18.535052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-9c251c2a-7332-4f99-8357-51dbf209c1f5 req-75f3bbd1-ef01-4be1-a0c0-df76ef39f6f6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085238 Sep 02 10:20:18.535656 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1371/2666] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:20:18.956057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-57001393-d2b3-4371-8d66-8f210bb673b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:18.956685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-57001393-d2b3-4371-8d66-8f210bb673b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:18.964249 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57001393-d2b3-4371-8d66-8f210bb673b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:18.964728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57001393-d2b3-4371-8d66-8f210bb673b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:18.965158 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57001393-d2b3-4371-8d66-8f210bb673b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:18.965844 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57001393-d2b3-4371-8d66-8f210bb673b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:18.966295 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57001393-d2b3-4371-8d66-8f210bb673b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:18.966760 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-57001393-d2b3-4371-8d66-8f210bb673b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:19.155641 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-57001393-d2b3-4371-8d66-8f210bb673b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:19.163502 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-57001393-d2b3-4371-8d66-8f210bb673b6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.211236 Sep 02 10:20:19.164057 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1296/2667] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:18 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:20.184833 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-11287301-1cf8-4454-93b0-0bcc86447e54 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:20.185533 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-11287301-1cf8-4454-93b0-0bcc86447e54 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:20.191652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11287301-1cf8-4454-93b0-0bcc86447e54 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:20.192134 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11287301-1cf8-4454-93b0-0bcc86447e54 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:20.192569 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11287301-1cf8-4454-93b0-0bcc86447e54 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:20.193248 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11287301-1cf8-4454-93b0-0bcc86447e54 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:20.193703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11287301-1cf8-4454-93b0-0bcc86447e54 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:20.194128 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-11287301-1cf8-4454-93b0-0bcc86447e54 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:20.325175 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-11287301-1cf8-4454-93b0-0bcc86447e54 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:20.332731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-11287301-1cf8-4454-93b0-0bcc86447e54 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1260 microversion: 2.1 time: 0.152595 Sep 02 10:20:20.333306 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1372/2668] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:20 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:21.354246 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-8e6022bb-29e3-4fce-ac59-e1690b4654ff tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:21.354875 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-8e6022bb-29e3-4fce-ac59-e1690b4654ff tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:21.361253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e6022bb-29e3-4fce-ac59-e1690b4654ff tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:21.361729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e6022bb-29e3-4fce-ac59-e1690b4654ff tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:21.362155 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e6022bb-29e3-4fce-ac59-e1690b4654ff tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:21.362849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e6022bb-29e3-4fce-ac59-e1690b4654ff tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:21.363298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e6022bb-29e3-4fce-ac59-e1690b4654ff tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:21.363717 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-8e6022bb-29e3-4fce-ac59-e1690b4654ff tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:21.496227 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-8e6022bb-29e3-4fce-ac59-e1690b4654ff tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:21.503989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-8e6022bb-29e3-4fce-ac59-e1690b4654ff tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1445 microversion: 2.1 time: 0.154103 Sep 02 10:20:21.504543 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1297/2669] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:21 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:21.523400 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-c744a6fa-c086-48b3-97fe-0867adc3b459 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:20:21.524016 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-c744a6fa-c086-48b3-97fe-0867adc3b459 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:20:21.530331 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c744a6fa-c086-48b3-97fe-0867adc3b459 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:21.531270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c744a6fa-c086-48b3-97fe-0867adc3b459 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:21.531270 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c744a6fa-c086-48b3-97fe-0867adc3b459 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:21.531959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c744a6fa-c086-48b3-97fe-0867adc3b459 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:21.532415 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c744a6fa-c086-48b3-97fe-0867adc3b459 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:21.532843 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-c744a6fa-c086-48b3-97fe-0867adc3b459 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:21.664520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-c744a6fa-c086-48b3-97fe-0867adc3b459 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:20:21.672305 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-c744a6fa-c086-48b3-97fe-0867adc3b459 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1445 microversion: 2.1 time: 0.152673 Sep 02 10:20:21.672880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1373/2670] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:20:21 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:20:23.654683 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-ef83222b-5042-4f2a-970f-13dfd245d9f4 req-46b135d5-87fb-4220-ba40-a26db33b4b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89f4d17-4d9d-4900-aef8-cdfca02f5260", "tag": "979cdc50-d477-426a-b650-4d2eecfc46ef"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:20:23.664705 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ef83222b-5042-4f2a-970f-13dfd245d9f4 req-46b135d5-87fb-4220-ba40-a26db33b4b5a service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:20:23.665177 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ef83222b-5042-4f2a-970f-13dfd245d9f4 req-46b135d5-87fb-4220-ba40-a26db33b4b5a service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:20:23.665597 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-ef83222b-5042-4f2a-970f-13dfd245d9f4 req-46b135d5-87fb-4220-ba40-a26db33b4b5a service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:20:23.676342 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-ef83222b-5042-4f2a-970f-13dfd245d9f4 req-46b135d5-87fb-4220-ba40-a26db33b4b5a service nova] Creating event network-changed:979cdc50-d477-426a-b650-4d2eecfc46ef for instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 on hv-cinder-85083 Sep 02 10:20:23.682453 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-ef83222b-5042-4f2a-970f-13dfd245d9f4 req-46b135d5-87fb-4220-ba40-a26db33b4b5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031466 Sep 02 10:20:23.683273 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1298/2671] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:22:37.533508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: ERROR oslo.messaging._drivers.impl_rabbit [-] [75307c23-192c-4adc-9fe4-89c9e2c92650] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 02 10:22:37.534103 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=22 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:22:37.534825 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=46 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:22:37.536298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 02 10:22:37.536464 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 10:22:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260/action (ip 10.222.0.57) !!! Sep 02 10:22:37.537427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:22:37.537576 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: Fri Sep 2 10:22:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260/action (ip 10.222.0.57) !!! Sep 02 10:22:37.542837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-f61e77bb-19a3-491f-a1ad-ee355e03884b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:22:37.544836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-f61e77bb-19a3-491f-a1ad-ee355e03884b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:37.551942 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f61e77bb-19a3-491f-a1ad-ee355e03884b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:37.552425 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f61e77bb-19a3-491f-a1ad-ee355e03884b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:37.552860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f61e77bb-19a3-491f-a1ad-ee355e03884b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:37.553545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f61e77bb-19a3-491f-a1ad-ee355e03884b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:37.554001 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f61e77bb-19a3-491f-a1ad-ee355e03884b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:37.554427 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-f61e77bb-19a3-491f-a1ad-ee355e03884b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:37.577975 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-f61e77bb-19a3-491f-a1ad-ee355e03884b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lazy-loading 'flavor' on Instance uuid a89f4d17-4d9d-4900-aef8-cdfca02f5260 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:22:37.908195 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-f61e77bb-19a3-491f-a1ad-ee355e03884b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "POST /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260/action" status: 202 len: 0 microversion: 2.1 time: 0.376556 Sep 02 10:22:37.908777 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1374/2672] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 10:22:37 2022] POST /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:22:37.916492 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:22:37.917253 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=64 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:22:37.918043 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:22:37.918185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:22:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 (ip 10.222.0.57) !!! Sep 02 10:22:37.924123 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-3df70e75-0246-4218-975b-73a5def228e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:37.927306 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-3df70e75-0246-4218-975b-73a5def228e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:37.933185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3df70e75-0246-4218-975b-73a5def228e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:37.933650 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3df70e75-0246-4218-975b-73a5def228e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:37.934090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3df70e75-0246-4218-975b-73a5def228e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:37.934843 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3df70e75-0246-4218-975b-73a5def228e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:37.935302 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3df70e75-0246-4218-975b-73a5def228e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:37.935731 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-3df70e75-0246-4218-975b-73a5def228e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:38.200111 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-3df70e75-0246-4218-975b-73a5def228e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:38.207755 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-3df70e75-0246-4218-975b-73a5def228e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.293601 Sep 02 10:22:38.212032 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1299/2673] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:37 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:39.231487 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b034a0d5-687d-4747-9ae3-3f7347df9e64 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:39.232137 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b034a0d5-687d-4747-9ae3-3f7347df9e64 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:39.239333 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b034a0d5-687d-4747-9ae3-3f7347df9e64 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:39.239819 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b034a0d5-687d-4747-9ae3-3f7347df9e64 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:39.240259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b034a0d5-687d-4747-9ae3-3f7347df9e64 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:39.240934 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b034a0d5-687d-4747-9ae3-3f7347df9e64 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:39.241384 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b034a0d5-687d-4747-9ae3-3f7347df9e64 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:39.241806 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b034a0d5-687d-4747-9ae3-3f7347df9e64 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:39.245196 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO oslo.messaging._drivers.impl_rabbit [-] [75307c23-192c-4adc-9fe4-89c9e2c92650] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 33058. Sep 02 10:22:39.464726 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b034a0d5-687d-4747-9ae3-3f7347df9e64 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:39.472506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b034a0d5-687d-4747-9ae3-3f7347df9e64 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.247614 Sep 02 10:22:39.473074 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1375/2674] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:39 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:40.493667 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-ee645932-480e-4f9b-ad9a-c18b58ecaf2d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:40.494280 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-ee645932-480e-4f9b-ad9a-c18b58ecaf2d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:40.501702 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee645932-480e-4f9b-ad9a-c18b58ecaf2d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:40.502185 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee645932-480e-4f9b-ad9a-c18b58ecaf2d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:40.502617 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee645932-480e-4f9b-ad9a-c18b58ecaf2d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:40.503323 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee645932-480e-4f9b-ad9a-c18b58ecaf2d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:40.503787 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee645932-480e-4f9b-ad9a-c18b58ecaf2d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:40.504196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-ee645932-480e-4f9b-ad9a-c18b58ecaf2d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:40.634553 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-ee645932-480e-4f9b-ad9a-c18b58ecaf2d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:40.642361 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-ee645932-480e-4f9b-ad9a-c18b58ecaf2d tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.152760 Sep 02 10:22:40.642955 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1300/2675] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:40 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:41.664472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-530ac235-85a2-4cd1-add2-1055c8e193f7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:41.665228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-530ac235-85a2-4cd1-add2-1055c8e193f7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:41.671568 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-530ac235-85a2-4cd1-add2-1055c8e193f7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:41.672062 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-530ac235-85a2-4cd1-add2-1055c8e193f7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:41.672530 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-530ac235-85a2-4cd1-add2-1055c8e193f7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:41.673245 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-530ac235-85a2-4cd1-add2-1055c8e193f7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:41.673708 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-530ac235-85a2-4cd1-add2-1055c8e193f7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:41.674136 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-530ac235-85a2-4cd1-add2-1055c8e193f7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:41.814237 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-530ac235-85a2-4cd1-add2-1055c8e193f7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:41.822397 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-530ac235-85a2-4cd1-add2-1055c8e193f7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.161840 Sep 02 10:22:41.823032 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1376/2676] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:41 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:42.844451 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-0bdddbc8-4855-4838-bb27-557b9a82a082 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:42.845196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-0bdddbc8-4855-4838-bb27-557b9a82a082 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:42.851622 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bdddbc8-4855-4838-bb27-557b9a82a082 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:42.852106 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bdddbc8-4855-4838-bb27-557b9a82a082 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:42.852540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bdddbc8-4855-4838-bb27-557b9a82a082 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:42.853229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bdddbc8-4855-4838-bb27-557b9a82a082 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:42.853677 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bdddbc8-4855-4838-bb27-557b9a82a082 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:42.854099 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-0bdddbc8-4855-4838-bb27-557b9a82a082 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:42.990835 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-0bdddbc8-4855-4838-bb27-557b9a82a082 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:42.998420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-0bdddbc8-4855-4838-bb27-557b9a82a082 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.158434 Sep 02 10:22:42.999012 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1301/2677] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:42 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:44.019154 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-58487b72-21b1-4902-b869-87cc4dc8039b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:44.019763 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-58487b72-21b1-4902-b869-87cc4dc8039b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:44.026233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58487b72-21b1-4902-b869-87cc4dc8039b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:44.026749 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58487b72-21b1-4902-b869-87cc4dc8039b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:44.027191 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58487b72-21b1-4902-b869-87cc4dc8039b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:44.027880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58487b72-21b1-4902-b869-87cc4dc8039b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:44.028335 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58487b72-21b1-4902-b869-87cc4dc8039b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:44.028758 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-58487b72-21b1-4902-b869-87cc4dc8039b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:44.161266 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-58487b72-21b1-4902-b869-87cc4dc8039b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:44.169069 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-58487b72-21b1-4902-b869-87cc4dc8039b tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.153778 Sep 02 10:22:44.169636 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1377/2678] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:44 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:45.190126 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6a9b5ede-e311-4397-bcac-784cf9ed9109 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:45.190658 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6a9b5ede-e311-4397-bcac-784cf9ed9109 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:45.197090 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a9b5ede-e311-4397-bcac-784cf9ed9109 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:45.197580 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a9b5ede-e311-4397-bcac-784cf9ed9109 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:45.198016 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a9b5ede-e311-4397-bcac-784cf9ed9109 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:45.198693 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a9b5ede-e311-4397-bcac-784cf9ed9109 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:45.199167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a9b5ede-e311-4397-bcac-784cf9ed9109 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:45.199590 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6a9b5ede-e311-4397-bcac-784cf9ed9109 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:45.334063 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6a9b5ede-e311-4397-bcac-784cf9ed9109 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:45.342098 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6a9b5ede-e311-4397-bcac-784cf9ed9109 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.156497 Sep 02 10:22:45.342664 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1302/2679] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:45 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:46.362852 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-8c7665b3-1ff9-4df3-9732-7fa1ac0fcd25 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:46.363463 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-8c7665b3-1ff9-4df3-9732-7fa1ac0fcd25 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:46.370113 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c7665b3-1ff9-4df3-9732-7fa1ac0fcd25 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:46.370591 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c7665b3-1ff9-4df3-9732-7fa1ac0fcd25 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:46.371054 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c7665b3-1ff9-4df3-9732-7fa1ac0fcd25 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:46.371738 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c7665b3-1ff9-4df3-9732-7fa1ac0fcd25 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:46.372187 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c7665b3-1ff9-4df3-9732-7fa1ac0fcd25 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:46.372606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-8c7665b3-1ff9-4df3-9732-7fa1ac0fcd25 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:46.504408 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-8c7665b3-1ff9-4df3-9732-7fa1ac0fcd25 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:46.512043 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-8c7665b3-1ff9-4df3-9732-7fa1ac0fcd25 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.153055 Sep 02 10:22:46.512616 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1378/2680] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:46 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:47.533448 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e77101f8-b594-4192-a679-eb8f32e3bba8 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:47.534055 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e77101f8-b594-4192-a679-eb8f32e3bba8 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:47.540614 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e77101f8-b594-4192-a679-eb8f32e3bba8 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:47.541094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e77101f8-b594-4192-a679-eb8f32e3bba8 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:47.541526 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e77101f8-b594-4192-a679-eb8f32e3bba8 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:47.542202 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e77101f8-b594-4192-a679-eb8f32e3bba8 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:47.542649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e77101f8-b594-4192-a679-eb8f32e3bba8 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:47.543094 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e77101f8-b594-4192-a679-eb8f32e3bba8 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:47.673608 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e77101f8-b594-4192-a679-eb8f32e3bba8 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:47.678134 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e77101f8-b594-4192-a679-eb8f32e3bba8 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.149091 Sep 02 10:22:47.678735 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1303/2681] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:47 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:48.699837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-9224952a-61b7-41f9-897d-a996b8059fb6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:48.700501 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-9224952a-61b7-41f9-897d-a996b8059fb6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:48.707756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9224952a-61b7-41f9-897d-a996b8059fb6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:48.708241 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9224952a-61b7-41f9-897d-a996b8059fb6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:48.708675 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9224952a-61b7-41f9-897d-a996b8059fb6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:48.709392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9224952a-61b7-41f9-897d-a996b8059fb6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:48.709838 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9224952a-61b7-41f9-897d-a996b8059fb6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:48.710293 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-9224952a-61b7-41f9-897d-a996b8059fb6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:48.846433 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-9224952a-61b7-41f9-897d-a996b8059fb6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:48.854176 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-9224952a-61b7-41f9-897d-a996b8059fb6 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.158338 Sep 02 10:22:48.854756 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1379/2682] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:48 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:49.875491 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-f59e0512-5c12-46a4-a76d-3721b4871cc1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:49.876140 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-f59e0512-5c12-46a4-a76d-3721b4871cc1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:49.882753 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59e0512-5c12-46a4-a76d-3721b4871cc1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:49.883213 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59e0512-5c12-46a4-a76d-3721b4871cc1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:49.883649 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59e0512-5c12-46a4-a76d-3721b4871cc1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:49.884332 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59e0512-5c12-46a4-a76d-3721b4871cc1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:49.884783 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59e0512-5c12-46a4-a76d-3721b4871cc1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:49.885229 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-f59e0512-5c12-46a4-a76d-3721b4871cc1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:50.019137 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-f59e0512-5c12-46a4-a76d-3721b4871cc1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:50.026890 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-f59e0512-5c12-46a4-a76d-3721b4871cc1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.155421 Sep 02 10:22:50.027460 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1304/2683] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:49 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:51.048281 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-69e454ab-9764-421e-912b-2460a3f90132 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:51.048894 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-69e454ab-9764-421e-912b-2460a3f90132 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:51.055598 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69e454ab-9764-421e-912b-2460a3f90132 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:51.057164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69e454ab-9764-421e-912b-2460a3f90132 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:51.057164 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69e454ab-9764-421e-912b-2460a3f90132 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:51.057362 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69e454ab-9764-421e-912b-2460a3f90132 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:51.057794 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69e454ab-9764-421e-912b-2460a3f90132 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:51.058228 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-69e454ab-9764-421e-912b-2460a3f90132 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:51.195298 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-69e454ab-9764-421e-912b-2460a3f90132 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:51.203380 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-69e454ab-9764-421e-912b-2460a3f90132 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.159004 Sep 02 10:22:51.204558 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1380/2684] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:51 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:52.225816 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-7307e83b-7e3f-4b28-b1d4-c249bc765d3c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:52.226350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-7307e83b-7e3f-4b28-b1d4-c249bc765d3c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:52.232834 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7307e83b-7e3f-4b28-b1d4-c249bc765d3c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:52.233319 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7307e83b-7e3f-4b28-b1d4-c249bc765d3c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:52.233877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7307e83b-7e3f-4b28-b1d4-c249bc765d3c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:52.234563 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7307e83b-7e3f-4b28-b1d4-c249bc765d3c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:52.235715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7307e83b-7e3f-4b28-b1d4-c249bc765d3c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:52.236167 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-7307e83b-7e3f-4b28-b1d4-c249bc765d3c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:52.364922 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-7307e83b-7e3f-4b28-b1d4-c249bc765d3c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:52.372635 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-7307e83b-7e3f-4b28-b1d4-c249bc765d3c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1511 microversion: 2.1 time: 0.150953 Sep 02 10:22:52.373201 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1305/2685] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:52 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:52.393053 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-2cc27c39-ce1a-41c9-962f-d5af20fc979c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:22:52.393658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2cc27c39-ce1a-41c9-962f-d5af20fc979c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:52.400037 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cc27c39-ce1a-41c9-962f-d5af20fc979c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:52.400520 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cc27c39-ce1a-41c9-962f-d5af20fc979c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:52.400955 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cc27c39-ce1a-41c9-962f-d5af20fc979c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:52.401642 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cc27c39-ce1a-41c9-962f-d5af20fc979c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:52.402096 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cc27c39-ce1a-41c9-962f-d5af20fc979c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:52.402519 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-2cc27c39-ce1a-41c9-962f-d5af20fc979c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:52.487880 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-2cc27c39-ce1a-41c9-962f-d5af20fc979c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127533) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 10:22:52.859592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-2cc27c39-ce1a-41c9-962f-d5af20fc979c tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "POST /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260/action" status: 202 len: 0 microversion: 2.1 time: 0.470832 Sep 02 10:22:52.860853 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1381/2686] 10.222.0.57 () {60 vars in 1278 bytes} [Fri Sep 2 10:22:52 2022] POST /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 10:22:52.868941 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-92906df4-5930-498a-b2dd-9d8b520273bd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:52.869925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-92906df4-5930-498a-b2dd-9d8b520273bd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:52.877173 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92906df4-5930-498a-b2dd-9d8b520273bd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:52.877662 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92906df4-5930-498a-b2dd-9d8b520273bd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:52.878085 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92906df4-5930-498a-b2dd-9d8b520273bd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:52.878810 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92906df4-5930-498a-b2dd-9d8b520273bd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:52.879260 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92906df4-5930-498a-b2dd-9d8b520273bd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:52.879675 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-92906df4-5930-498a-b2dd-9d8b520273bd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:53.013390 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-92906df4-5930-498a-b2dd-9d8b520273bd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:53.021627 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-92906df4-5930-498a-b2dd-9d8b520273bd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1519 microversion: 2.1 time: 0.156574 Sep 02 10:22:53.022208 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1306/2687] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:52 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:54.044225 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-0026d9ba-39b4-4c53-9a60-bd180e50c3d1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:54.044771 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-0026d9ba-39b4-4c53-9a60-bd180e50c3d1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:54.051701 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0026d9ba-39b4-4c53-9a60-bd180e50c3d1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:54.052190 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0026d9ba-39b4-4c53-9a60-bd180e50c3d1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:54.052628 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0026d9ba-39b4-4c53-9a60-bd180e50c3d1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:54.053328 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0026d9ba-39b4-4c53-9a60-bd180e50c3d1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:54.053783 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0026d9ba-39b4-4c53-9a60-bd180e50c3d1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:54.054246 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-0026d9ba-39b4-4c53-9a60-bd180e50c3d1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:54.185686 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-0026d9ba-39b4-4c53-9a60-bd180e50c3d1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:54.194252 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-0026d9ba-39b4-4c53-9a60-bd180e50c3d1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1519 microversion: 2.1 time: 0.154608 Sep 02 10:22:54.194872 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1382/2688] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:54 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:55.112176 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-d38c521f-3763-4d58-82d6-9605f883bf49 req-0c4984b6-b208-4685-9ce6-cf79027da121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89f4d17-4d9d-4900-aef8-cdfca02f5260", "name": "network-vif-unplugged", "status": "completed", "tag": "979cdc50-d477-426a-b650-4d2eecfc46ef"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:22:55.123018 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d38c521f-3763-4d58-82d6-9605f883bf49 req-0c4984b6-b208-4685-9ce6-cf79027da121 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:55.123465 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d38c521f-3763-4d58-82d6-9605f883bf49 req-0c4984b6-b208-4685-9ce6-cf79027da121 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:55.123893 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d38c521f-3763-4d58-82d6-9605f883bf49 req-0c4984b6-b208-4685-9ce6-cf79027da121 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:55.135549 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.compute.server_external_events [req-d38c521f-3763-4d58-82d6-9605f883bf49 req-0c4984b6-b208-4685-9ce6-cf79027da121 service nova] Unable to find a host for instance a89f4d17-4d9d-4900-aef8-cdfca02f5260. Dropping event network-vif-unplugged {{(pid=127531) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 02 10:22:55.136420 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-d38c521f-3763-4d58-82d6-9605f883bf49 req-0c4984b6-b208-4685-9ce6-cf79027da121 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028264 Sep 02 10:22:55.136998 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1307/2689] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 02 10:22:55.215606 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-dd996e19-c173-40dc-8aaf-5beb59d93799 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:55.216250 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-dd996e19-c173-40dc-8aaf-5beb59d93799 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:55.222899 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd996e19-c173-40dc-8aaf-5beb59d93799 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:55.223392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd996e19-c173-40dc-8aaf-5beb59d93799 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:55.223837 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd996e19-c173-40dc-8aaf-5beb59d93799 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:55.224525 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd996e19-c173-40dc-8aaf-5beb59d93799 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:55.224980 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd996e19-c173-40dc-8aaf-5beb59d93799 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:55.225406 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-dd996e19-c173-40dc-8aaf-5beb59d93799 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:55.361226 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-dd996e19-c173-40dc-8aaf-5beb59d93799 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:55.369269 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-dd996e19-c173-40dc-8aaf-5beb59d93799 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1521 microversion: 2.1 time: 0.157841 Sep 02 10:22:55.369865 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1383/2690] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:55 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:56.391362 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-dfb7d96f-d948-4385-be91-143f954800ae tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:56.392005 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-dfb7d96f-d948-4385-be91-143f954800ae tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:56.399379 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfb7d96f-d948-4385-be91-143f954800ae tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:56.399891 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfb7d96f-d948-4385-be91-143f954800ae tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:56.400371 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfb7d96f-d948-4385-be91-143f954800ae tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:56.401091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfb7d96f-d948-4385-be91-143f954800ae tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:56.401750 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfb7d96f-d948-4385-be91-143f954800ae tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:56.402212 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-dfb7d96f-d948-4385-be91-143f954800ae tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:56.613661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-dfb7d96f-d948-4385-be91-143f954800ae tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:56.621793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-dfb7d96f-d948-4385-be91-143f954800ae tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.234487 Sep 02 10:22:56.622397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1308/2691] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:56 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:57.643612 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-efdde537-5eb3-433c-a2ea-de9db5655beb tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:57.644224 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-efdde537-5eb3-433c-a2ea-de9db5655beb tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:57.651194 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efdde537-5eb3-433c-a2ea-de9db5655beb tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:57.651703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efdde537-5eb3-433c-a2ea-de9db5655beb tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:57.652141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efdde537-5eb3-433c-a2ea-de9db5655beb tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:57.652823 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efdde537-5eb3-433c-a2ea-de9db5655beb tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:57.653276 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efdde537-5eb3-433c-a2ea-de9db5655beb tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:57.653704 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-efdde537-5eb3-433c-a2ea-de9db5655beb tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:57.789908 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-efdde537-5eb3-433c-a2ea-de9db5655beb tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:57.797703 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-efdde537-5eb3-433c-a2ea-de9db5655beb tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.158056 Sep 02 10:22:57.798277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1384/2692] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:57 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:22:58.819209 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-65417822-b62b-47b7-a16b-4e7db8240b09 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:22:58.819784 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-65417822-b62b-47b7-a16b-4e7db8240b09 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:22:58.826366 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65417822-b62b-47b7-a16b-4e7db8240b09 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:58.826877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65417822-b62b-47b7-a16b-4e7db8240b09 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:58.827312 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65417822-b62b-47b7-a16b-4e7db8240b09 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:58.827985 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65417822-b62b-47b7-a16b-4e7db8240b09 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:22:58.828434 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65417822-b62b-47b7-a16b-4e7db8240b09 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:22:58.828850 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-65417822-b62b-47b7-a16b-4e7db8240b09 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:22:58.973343 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-65417822-b62b-47b7-a16b-4e7db8240b09 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:22:58.981833 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-65417822-b62b-47b7-a16b-4e7db8240b09 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.166611 Sep 02 10:22:58.982397 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1309/2693] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:58 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:23:00.002608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-27c173a8-acba-4f94-843a-9c2ee3a0dddd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:23:00.003259 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-27c173a8-acba-4f94-843a-9c2ee3a0dddd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:23:00.010410 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27c173a8-acba-4f94-843a-9c2ee3a0dddd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:00.010932 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27c173a8-acba-4f94-843a-9c2ee3a0dddd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:00.011369 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27c173a8-acba-4f94-843a-9c2ee3a0dddd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:00.012121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27c173a8-acba-4f94-843a-9c2ee3a0dddd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:00.012573 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27c173a8-acba-4f94-843a-9c2ee3a0dddd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:00.012999 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-27c173a8-acba-4f94-843a-9c2ee3a0dddd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:00.142608 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-27c173a8-acba-4f94-843a-9c2ee3a0dddd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:23:00.150278 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-27c173a8-acba-4f94-843a-9c2ee3a0dddd tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.151626 Sep 02 10:23:00.150878 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1385/2694] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:22:59 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:23:01.171203 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-6bd20510-afc0-44c1-bc27-906eb66153ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:23:01.171766 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-6bd20510-afc0-44c1-bc27-906eb66153ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:23:01.179151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bd20510-afc0-44c1-bc27-906eb66153ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:01.179648 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bd20510-afc0-44c1-bc27-906eb66153ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:01.180081 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bd20510-afc0-44c1-bc27-906eb66153ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:01.180776 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bd20510-afc0-44c1-bc27-906eb66153ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:01.181232 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bd20510-afc0-44c1-bc27-906eb66153ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:01.181661 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-6bd20510-afc0-44c1-bc27-906eb66153ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:01.315777 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-6bd20510-afc0-44c1-bc27-906eb66153ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:23:01.323373 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-6bd20510-afc0-44c1-bc27-906eb66153ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.156131 Sep 02 10:23:01.324069 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1310/2695] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:23:01 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:23:02.345173 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b34a930d-9083-4eff-959d-318ad4598df1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:23:02.345793 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b34a930d-9083-4eff-959d-318ad4598df1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:23:02.352766 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b34a930d-9083-4eff-959d-318ad4598df1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:02.353251 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b34a930d-9083-4eff-959d-318ad4598df1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:02.353690 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b34a930d-9083-4eff-959d-318ad4598df1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:02.354376 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b34a930d-9083-4eff-959d-318ad4598df1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:02.354860 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b34a930d-9083-4eff-959d-318ad4598df1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:02.355314 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b34a930d-9083-4eff-959d-318ad4598df1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:02.492430 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b34a930d-9083-4eff-959d-318ad4598df1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:23:02.500280 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b34a930d-9083-4eff-959d-318ad4598df1 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.158982 Sep 02 10:23:02.500845 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1386/2696] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:23:02 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:23:03.521288 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-a23c0533-1245-4775-8aa8-7361aaa230ed tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:23:03.521895 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-a23c0533-1245-4775-8aa8-7361aaa230ed tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:23:03.528333 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a23c0533-1245-4775-8aa8-7361aaa230ed tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:03.528812 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a23c0533-1245-4775-8aa8-7361aaa230ed tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:03.529240 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a23c0533-1245-4775-8aa8-7361aaa230ed tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:03.529914 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a23c0533-1245-4775-8aa8-7361aaa230ed tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:03.530369 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a23c0533-1245-4775-8aa8-7361aaa230ed tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:03.530802 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-a23c0533-1245-4775-8aa8-7361aaa230ed tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:03.660686 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-a23c0533-1245-4775-8aa8-7361aaa230ed tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:23:03.668425 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-a23c0533-1245-4775-8aa8-7361aaa230ed tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.150962 Sep 02 10:23:03.668987 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1311/2697] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:23:03 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:23:04.689329 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-b0bda66d-9015-4d82-aea3-7e6b0a9b4013 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:23:04.689939 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-b0bda66d-9015-4d82-aea3-7e6b0a9b4013 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:23:04.696836 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0bda66d-9015-4d82-aea3-7e6b0a9b4013 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:04.697312 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0bda66d-9015-4d82-aea3-7e6b0a9b4013 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:04.697742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0bda66d-9015-4d82-aea3-7e6b0a9b4013 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:04.698478 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0bda66d-9015-4d82-aea3-7e6b0a9b4013 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:04.699023 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0bda66d-9015-4d82-aea3-7e6b0a9b4013 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:04.699450 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-b0bda66d-9015-4d82-aea3-7e6b0a9b4013 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:04.718375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:23:04.832121 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-b0bda66d-9015-4d82-aea3-7e6b0a9b4013 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:23:04.840647 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-b0bda66d-9015-4d82-aea3-7e6b0a9b4013 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.155129 Sep 02 10:23:04.841375 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1387/2698] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:23:04 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:23:05.861589 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-c2d7197d-981c-491e-8e0c-6ad81e27aad3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:23:05.862296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-c2d7197d-981c-491e-8e0c-6ad81e27aad3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:23:05.868545 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2d7197d-981c-491e-8e0c-6ad81e27aad3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:05.869105 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2d7197d-981c-491e-8e0c-6ad81e27aad3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:05.869540 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2d7197d-981c-491e-8e0c-6ad81e27aad3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:05.870228 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2d7197d-981c-491e-8e0c-6ad81e27aad3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:05.870793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2d7197d-981c-491e-8e0c-6ad81e27aad3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:05.871169 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-c2d7197d-981c-491e-8e0c-6ad81e27aad3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:06.006283 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-c2d7197d-981c-491e-8e0c-6ad81e27aad3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:23:06.014296 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-c2d7197d-981c-491e-8e0c-6ad81e27aad3 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.156733 Sep 02 10:23:06.019806 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1312/2699] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:23:05 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:23:07.036350 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-85f09991-cefb-4c1b-9e57-ca428d26bfef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:23:07.036959 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-85f09991-cefb-4c1b-9e57-ca428d26bfef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:23:07.044157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f09991-cefb-4c1b-9e57-ca428d26bfef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:07.044658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f09991-cefb-4c1b-9e57-ca428d26bfef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:07.045102 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f09991-cefb-4c1b-9e57-ca428d26bfef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:07.045775 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f09991-cefb-4c1b-9e57-ca428d26bfef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:07.046221 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f09991-cefb-4c1b-9e57-ca428d26bfef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:07.046639 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-85f09991-cefb-4c1b-9e57-ca428d26bfef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:07.179422 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-85f09991-cefb-4c1b-9e57-ca428d26bfef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:23:07.187455 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-85f09991-cefb-4c1b-9e57-ca428d26bfef tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.155299 Sep 02 10:23:07.188040 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1388/2700] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:23:07 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:23:07.298729 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [req-d637dd49-afa7-4835-ab7f-3e68e7af7fb6 req-9e5bcb58-c259-42eb-a046-637aec4b3abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89f4d17-4d9d-4900-aef8-cdfca02f5260", "name": "network-vif-plugged", "status": "completed", "tag": "979cdc50-d477-426a-b650-4d2eecfc46ef"}]} {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:23:07.308509 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d637dd49-afa7-4835-ab7f-3e68e7af7fb6 req-9e5bcb58-c259-42eb-a046-637aec4b3abe service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:07.313456 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d637dd49-afa7-4835-ab7f-3e68e7af7fb6 req-9e5bcb58-c259-42eb-a046-637aec4b3abe service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:07.313456 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [req-d637dd49-afa7-4835-ab7f-3e68e7af7fb6 req-9e5bcb58-c259-42eb-a046-637aec4b3abe service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:07.321353 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.compute.server_external_events [req-d637dd49-afa7-4835-ab7f-3e68e7af7fb6 req-9e5bcb58-c259-42eb-a046-637aec4b3abe service nova] Creating event network-vif-plugged:979cdc50-d477-426a-b650-4d2eecfc46ef for instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 on hv-cinder-85083 Sep 02 10:23:07.324859 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR oslo.messaging._drivers.impl_rabbit [req-d637dd49-afa7-4835-ab7f-3e68e7af7fb6 req-9e5bcb58-c259-42eb-a046-637aec4b3abe service nova] [cbd594e0-924f-4e7a-936b-b12f86fd11e1] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 02 10:23:08.211545 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-83748892-c8a0-431b-8816-4674d8f6c7ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:23:08.212052 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-83748892-c8a0-431b-8816-4674d8f6c7ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:23:08.214648 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:23:08.219480 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83748892-c8a0-431b-8816-4674d8f6c7ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:08.219965 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83748892-c8a0-431b-8816-4674d8f6c7ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:08.220402 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83748892-c8a0-431b-8816-4674d8f6c7ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:08.221085 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83748892-c8a0-431b-8816-4674d8f6c7ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:08.221537 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83748892-c8a0-431b-8816-4674d8f6c7ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:08.221961 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-83748892-c8a0-431b-8816-4674d8f6c7ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:08.332019 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [req-d637dd49-afa7-4835-ab7f-3e68e7af7fb6 req-9e5bcb58-c259-42eb-a046-637aec4b3abe service nova] [cbd594e0-924f-4e7a-936b-b12f86fd11e1] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 33160. Sep 02 10:23:08.335398 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [req-d637dd49-afa7-4835-ab7f-3e68e7af7fb6 req-9e5bcb58-c259-42eb-a046-637aec4b3abe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.040609 Sep 02 10:23:08.336091 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1313/2701] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:23:08.358049 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-83748892-c8a0-431b-8816-4674d8f6c7ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:23:08.366383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-83748892-c8a0-431b-8816-4674d8f6c7ba tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.158877 Sep 02 10:23:08.367614 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1389/2702] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:23:08 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 10:23:09.390189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-e5a05a04-6055-4d13-8ea9-6433d9bf6994 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:23:09.390925 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-e5a05a04-6055-4d13-8ea9-6433d9bf6994 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:23:09.392989 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=31 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:23:09.397877 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a05a04-6055-4d13-8ea9-6433d9bf6994 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:09.398350 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a05a04-6055-4d13-8ea9-6433d9bf6994 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:09.399298 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a05a04-6055-4d13-8ea9-6433d9bf6994 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:09.399981 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a05a04-6055-4d13-8ea9-6433d9bf6994 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:09.400433 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a05a04-6055-4d13-8ea9-6433d9bf6994 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:09.400849 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-e5a05a04-6055-4d13-8ea9-6433d9bf6994 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:09.403524 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=83 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:23:09.534351 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-e5a05a04-6055-4d13-8ea9-6433d9bf6994 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:23:09.542557 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-e5a05a04-6055-4d13-8ea9-6433d9bf6994 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1577 microversion: 2.1 time: 0.157060 Sep 02 10:23:09.543146 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1314/2703] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:23:09 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:23:10.563931 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-57ffbe22-11d7-4246-b288-2d1b07039876 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:23:10.564658 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-57ffbe22-11d7-4246-b288-2d1b07039876 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:23:10.572014 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57ffbe22-11d7-4246-b288-2d1b07039876 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:10.572496 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57ffbe22-11d7-4246-b288-2d1b07039876 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:10.572925 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57ffbe22-11d7-4246-b288-2d1b07039876 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:10.573857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57ffbe22-11d7-4246-b288-2d1b07039876 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:23:10.574522 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57ffbe22-11d7-4246-b288-2d1b07039876 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:23:10.575233 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-57ffbe22-11d7-4246-b288-2d1b07039876 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:23:10.707377 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-57ffbe22-11d7-4246-b288-2d1b07039876 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:23:10.715383 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-57ffbe22-11d7-4246-b288-2d1b07039876 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1564 microversion: 2.1 time: 0.155797 Sep 02 10:23:10.715948 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1390/2704] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:23:10 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:24:40.513189 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-d1742296-b9a2-4335-b2f0-713490716041 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:24:40.513774 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d1742296-b9a2-4335-b2f0-713490716041 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:24:40.516152 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-3b296d8e-e012-4c60-bba0-f495e0e495ba req-edcabfa8-5a00-4f9c-93e3-5e1578160491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89f4d17-4d9d-4900-aef8-cdfca02f5260", "tag": "979cdc50-d477-426a-b650-4d2eecfc46ef"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:24:40.516636 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_api:SELECT=1 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:24:40.516919 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG dbcounter [-] [127531] Writing DB stats nova_cell1:SELECT=5 {{(pid=127531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:24:40.517728 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 10:24:40.517882 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Fri Sep 2 10:24:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 (ip 10.222.0.57) !!! Sep 02 10:24:40.524310 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_api:SELECT=3 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:24:40.525709 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG dbcounter [-] [127533] Writing DB stats nova_cell1:SELECT=20 {{(pid=127533) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 10:24:40.528196 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1742296-b9a2-4335-b2f0-713490716041 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:40.528685 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1742296-b9a2-4335-b2f0-713490716041 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:40.529121 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1742296-b9a2-4335-b2f0-713490716041 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:40.529817 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1742296-b9a2-4335-b2f0-713490716041 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:40.530263 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1742296-b9a2-4335-b2f0-713490716041 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:40.530682 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-d1742296-b9a2-4335-b2f0-713490716041 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:40.534742 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3b296d8e-e012-4c60-bba0-f495e0e495ba req-edcabfa8-5a00-4f9c-93e3-5e1578160491 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:40.535313 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3b296d8e-e012-4c60-bba0-f495e0e495ba req-edcabfa8-5a00-4f9c-93e3-5e1578160491 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:40.535830 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-3b296d8e-e012-4c60-bba0-f495e0e495ba req-edcabfa8-5a00-4f9c-93e3-5e1578160491 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:40.548990 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-3b296d8e-e012-4c60-bba0-f495e0e495ba req-edcabfa8-5a00-4f9c-93e3-5e1578160491 service nova] Creating event network-changed:979cdc50-d477-426a-b650-4d2eecfc46ef for instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 on hv-cinder-85083 Sep 02 10:24:40.554792 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-3b296d8e-e012-4c60-bba0-f495e0e495ba req-edcabfa8-5a00-4f9c-93e3-5e1578160491 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044192 Sep 02 10:24:40.556371 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1391/2705] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:24:40.561221 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-d1742296-b9a2-4335-b2f0-713490716041 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Going to try to terminate instance {{(pid=127531) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 10:24:40.808174 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-d1742296-b9a2-4335-b2f0-713490716041 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 204 len: 0 microversion: 2.1 time: 0.299808 Sep 02 10:24:40.809125 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1315/2706] 10.222.0.57 () {58 vars in 1239 bytes} [Fri Sep 2 10:24:40 2022] DELETE /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 10:24:40.818277 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-3110df66-d344-4044-8032-ee7a08e218f5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:24:40.819157 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-3110df66-d344-4044-8032-ee7a08e218f5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:24:40.828492 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3110df66-d344-4044-8032-ee7a08e218f5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:40.829141 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3110df66-d344-4044-8032-ee7a08e218f5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:40.829645 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3110df66-d344-4044-8032-ee7a08e218f5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:40.830416 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3110df66-d344-4044-8032-ee7a08e218f5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:40.831078 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3110df66-d344-4044-8032-ee7a08e218f5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:40.831503 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-3110df66-d344-4044-8032-ee7a08e218f5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:40.988070 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-3110df66-d344-4044-8032-ee7a08e218f5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:24:40.997207 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-3110df66-d344-4044-8032-ee7a08e218f5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.183603 Sep 02 10:24:40.997809 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1392/2707] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:24:40 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:24:42.020151 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-caae7f8f-0110-4942-98c8-602536d8c2e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:24:42.020852 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-caae7f8f-0110-4942-98c8-602536d8c2e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:24:42.027377 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-caae7f8f-0110-4942-98c8-602536d8c2e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:42.027920 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-caae7f8f-0110-4942-98c8-602536d8c2e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:42.028552 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-caae7f8f-0110-4942-98c8-602536d8c2e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:42.029250 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-caae7f8f-0110-4942-98c8-602536d8c2e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:42.029715 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-caae7f8f-0110-4942-98c8-602536d8c2e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:42.030147 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-caae7f8f-0110-4942-98c8-602536d8c2e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:42.221015 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-caae7f8f-0110-4942-98c8-602536d8c2e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:24:42.230039 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-caae7f8f-0110-4942-98c8-602536d8c2e4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1570 microversion: 2.1 time: 0.214143 Sep 02 10:24:42.230615 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1316/2708] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:24:42 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:24:43.158472 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [req-244d0762-a8c6-48e8-915c-76536525dd40 req-d2c2aa92-6571-4649-9d67-74a5eddf0fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89f4d17-4d9d-4900-aef8-cdfca02f5260", "name": "network-vif-deleted", "tag": "979cdc50-d477-426a-b650-4d2eecfc46ef"}]} {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 10:24:43.169365 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-244d0762-a8c6-48e8-915c-76536525dd40 req-d2c2aa92-6571-4649-9d67-74a5eddf0fe3 service nova] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:43.169871 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-244d0762-a8c6-48e8-915c-76536525dd40 req-d2c2aa92-6571-4649-9d67-74a5eddf0fe3 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:43.170294 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [req-244d0762-a8c6-48e8-915c-76536525dd40 req-d2c2aa92-6571-4649-9d67-74a5eddf0fe3 service nova] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:43.183592 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.compute.server_external_events [req-244d0762-a8c6-48e8-915c-76536525dd40 req-d2c2aa92-6571-4649-9d67-74a5eddf0fe3 service nova] Creating event network-vif-deleted:979cdc50-d477-426a-b650-4d2eecfc46ef for instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 on hv-cinder-85083 Sep 02 10:24:43.189731 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [req-244d0762-a8c6-48e8-915c-76536525dd40 req-d2c2aa92-6571-4649-9d67-74a5eddf0fe3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035333 Sep 02 10:24:43.190444 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1393/2709] 10.222.0.57 () {64 vars in 1317 bytes} [Fri Sep 2 10:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 10:24:43.251574 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-21d16f2b-8cb7-4f94-a1e0-a7866fc6d387 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:24:43.252182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-21d16f2b-8cb7-4f94-a1e0-a7866fc6d387 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:24:43.258571 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d16f2b-8cb7-4f94-a1e0-a7866fc6d387 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:43.259793 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d16f2b-8cb7-4f94-a1e0-a7866fc6d387 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:43.260233 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d16f2b-8cb7-4f94-a1e0-a7866fc6d387 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:43.260918 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d16f2b-8cb7-4f94-a1e0-a7866fc6d387 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:43.261368 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d16f2b-8cb7-4f94-a1e0-a7866fc6d387 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:43.261796 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-21d16f2b-8cb7-4f94-a1e0-a7866fc6d387 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:43.326689 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.policy [None req-21d16f2b-8cb7-4f94-a1e0-a7866fc6d387 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127531) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:24:43.334498 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-21d16f2b-8cb7-4f94-a1e0-a7866fc6d387 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1384 microversion: 2.1 time: 0.086818 Sep 02 10:24:43.335093 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1317/2710] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:24:43 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1384 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:24:44.357311 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:24:44.358002 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.compute.api [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127533) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:24:44.364506 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:44.365021 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:44.365452 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:44.366129 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:44.366577 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:44.367026 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:44.399061 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:44.399454 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:44.399886 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG oslo_concurrency.lockutils [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:44.400332 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.objects.instance [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lazy-loading 'fault' on Instance uuid a89f4d17-4d9d-4900-aef8-cdfca02f5260 {{(pid=127533) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 02 10:24:44.445392 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.policy [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29bbe80a3cc44a58ddcd0dd784f11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd00fdbe14e451fb3634ef9077b3a76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127533) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 10:24:44.453285 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-907edddd-6cd7-4a48-ad62-663e048becd4 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 200 len: 1225 microversion: 2.1 time: 0.101171 Sep 02 10:24:44.453857 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1394/2711] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:24:44 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 10:24:45.482131 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '>' {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:24:45.482739 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.compute.api [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] [instance: a89f4d17-4d9d-4900-aef8-cdfca02f5260] Fetching instance by UUID {{(pid=127531) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 10:24:45.489120 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:45.489620 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:45.490047 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:45.490724 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Acquiring lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 10:24:45.491182 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 10:24:45.491594 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG oslo_concurrency.lockutils [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Lock "4302fafa-fa9b-40be-bbd3-4d18650e680f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 10:24:45.504794 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.wsgi [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] HTTP exception thrown: Instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 could not be found. Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Request method failure captured: Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: request: GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 HTTP/1.1 Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept: application/json Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Accept-Encoding: identity Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Connection: close Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Length: 0 Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Content-Type: application/json Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Host: 10.222.0.57 Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: Openstack-System-Scope: None Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: User-Agent: python-urllib3/1.26.12 Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Auth-Token: gAAAAABjEdixBeEEPDgPh8qtYHZLnthRUwGLJsqTu4b6vLhpXUHlR0X9M7ckMcmulU3U6j8YDlEs7AqV6Ytw9E2rMYl0m1KyzTkjMAwdUls3bz_7yzc1cXAQ7grt-Ztnq_JLMqW1L89FZhAv9bw3nj2WgpJ2Ep1BS4BivxnGcWtd_O3NAdyLccI Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Id: None Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Domain-Name: None Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Identity-Status: Confirmed Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Is-Admin-Project: True Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Id: default Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Domain-Name: Default Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Id: bfd00fdbe14e451fb3634ef9077b3a76 Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Project-Name: tempest-TestShelveInstance-1775959708 Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Role: reader,member Sep 02 10:24:45.506392 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Roles: reader,member Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfd00fdbe14e451fb3634ef9077b3a76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/bfd00fdbe14e451fb3634ef9077b3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/bfd00fdbe14e451fb3634ef9077b3a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_bfd00fdbe14e451fb3634ef9077b3a76", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}] Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant: tempest-TestShelveInstance-1775959708 Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Id: bfd00fdbe14e451fb3634ef9077b3a76 Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-Tenant-Name: tempest-TestShelveInstance-1775959708 Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User: tempest-TestShelveInstance-1775959708-project Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Id: default Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Domain-Name: Default Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Id: a29bbe80a3cc44a58ddcd0dd784f11bf Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: X-User-Name: tempest-TestShelveInstance-1775959708-project Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: method: > Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: exception: Instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 could not be found. Sep 02 10:24:45.507995 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: action_args: {'id': 'a89f4d17-4d9d-4900-aef8-cdfca02f5260'} Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: {{(pid=127531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 could not be found. Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 10:24:45.508869 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 could not be found. Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 could not be found. Sep 02 10:24:45.510359 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: ERROR nova.api.openstack.wsgi Sep 02 10:24:45.511904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: DEBUG nova.api.openstack.wsgi [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Returning 404 to user: Instance a89f4d17-4d9d-4900-aef8-cdfca02f5260 could not be found. {{(pid=127531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 10:24:45.511904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: INFO nova.api.openstack.requestlog [None req-77330f68-92f5-43ea-9937-731c3ab13ef7 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260" status: 404 len: 111 microversion: 2.1 time: 0.030250 Sep 02 10:24:45.511904 dv-cinder-850831-3-iscsi devstack@n-api.service[127531]: [pid: 127531|app: 0|req: 1318/2712] 10.222.0.57 () {58 vars in 1236 bytes} [Fri Sep 2 10:24:45 2022] GET /compute/v2.1/servers/a89f4d17-4d9d-4900-aef8-cdfca02f5260 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 10:24:45.750652 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: DEBUG nova.api.openstack.wsgi [None req-eec3d714-3693-486f-befb-f708e7dc20d5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] Calling method '.version_select at 0x7f4e5fbecf70>' {{(pid=127533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 10:24:45.845508 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: INFO nova.api.openstack.requestlog [None req-eec3d714-3693-486f-befb-f708e7dc20d5 tempest-TestShelveInstance-1775959708 tempest-TestShelveInstance-1775959708-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1701919701" status: 202 len: 0 microversion: 2.1 time: 0.099487 Sep 02 10:24:45.846077 dv-cinder-850831-3-iscsi devstack@n-api.service[127533]: [pid: 127533|app: 0|req: 1395/2713] 10.222.0.57 () {58 vars in 1254 bytes} [Fri Sep 2 10:24:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1701919701 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)